Use these blocks to clean, transform, and enhance data from other blocks.
transform_df
, the output data from its upstream block
is accessed by the positional argument named df
.
transform_df
function.
See below for an example:
2023-01-09T20:01:00
, once it’s renamed, can look like a string, but using an INSERT with CAST('2023-01-09T20:01:00' AS TEXT)
to a column with data type TIMESTAMPTZ
will fail.
In order to fix this, you can add column “aliases” in the pipeline’s data integration catalog.
data_integration_catalog.json
file.