Writing data pipeline code
Build the future you want to see.
Adding blocks made easy
You can quickly add blocks of code to your pipeline with these methods:
Re-arrange and hide or show blocks
Pre-built data integrations for 3rd party sources
Sync data from 3rd party sources without writing boilerplate code by using pre-built data integrations (Singer Taps and Targets) provided by the data engineering community.
Data integrations to sync your data to 3rd party destinations are also available in the same feature set.
These sources and destinations can be combined and chained together with your existing blocks.
Use AI to write code for you
A line of code you don’t write is a line of code you never have to debug. Use AI to generate the code for you.
Document and comment code (AI)
“Work smart, not hard.”
Let the robots document your code so you can focus on the fun and creative side of coding.
Block upgrades
Enhance your code with these quick power-ups:
Add new block v2
An improved experience for adding new blocks to your pipeline in the
Pipeline Editor (/pipelines/[pipeline_uuid]/edit), which allows you to
search for existing block files and use data integration blocks inside of
a standard (batch) pipeline.
Code and output side-by-side view
Run code and see its output right next to where you’re writing.
This makes it so that you don’t have to keep scrolling down every time you make a code change and want to see its results.
To enable this feature:
- Go to your project settings.
- Enable the feature named Notebook block output split view.
- Open the edit view of a pipeline.
- Under the header menu named View, click the option Show output next to code.
Was this page helpful?