These are the fundamental concepts that Mage uses to operate.
pipelines
folder under the Mage project directory.
[project_name]/transformers/
.
mage.users_v1
)?
ds = 2022-12-31
)?
S3
)?
transform_users
has finished running successfully for the current execution
date:
check_status
that handles the
logic for retrieving the status of a pipeline run for transform_users
on the
current execution date. You can optionally pass block uuid and hours
parameters to check_status
to check the status of a block run or within a
interval of time.POST
request to the http://localhost/api/events
endpoint with a custom event
payload.
Check out this
tutorial on how
to create an event trigger.
print
statements in blocks, or errors and stack traces
during code execution.
Here is an example of a log in the
Data pipeline management UI: