- Extension block
An extension block adds extra functionality to blocks in your pipeline.
Extension blocks are part of your pipeline but don’t run as individual steps in your pipeline like data loader blocks, transformer blocks, etc. However, extension blocks are associated to other blocks within the pipeline (e.g. data loaders, transformers, data exporters, etc).
After those other blocks are executed, any associated extension blocks will also be executed. Those extension blocks will perform some function on its associated blocks.
Your pipeline has the following blocks:
Then, you add the following extension block to your pipeline:
@extension('...') def some_powerful_function(*args, **kwargs): # some code...
You associate the above extension block to the following 2 blocks:
When you run the pipeline, it’ll execute the
load_data_from_api(data loader) block first. Once that is complete, the associated extension block will run.
Next, the pipeline will execute the
clean_column_names(transformer) block. After that is done, the associated extension block will run.
save_data(data exporter) block will run. Since it has no associated extension block, the pipeline will finish.
How to add extensions to your pipeline
- Create a new pipeline or open an existing pipeline.
- Edit the pipeline.
- On the right side of the page, click the Power ups icon in the navigation. If you don’t see it, try expanding the right area of the page.
- You’ll be shown a list of power ups you can add to your pipeline.
- Click on a power up to configure it and add extension blocks to your pipeline.
Here are the currently supported extensions:
More coming soon!