DBT Integration

​

Overview

Build, run, and manage your DBT models with Mage.

​

Analytics engineers

With Mage and DBT combined, you can expand build and run complex data pipelines.

​

Data engineers

Simplify your data infrastructure and reduce the amount of redundant tools in your “modern” data stack. Replace DBT cloud and Airflow with Mage’s native integration with DBT.

​

Features

​

Schedule DBT model runs

Trigger your DBT model runs on a regular schedule, from an event, or via API request.

​

Run specific DBT models and their dependencies

​

Run all models and optionally exclude others

​

DBT models can depend on non-DBT related tasks

Examples:

• Build model after data ingestion from API
• Build model after another pipeline completes

​

Preview DBT model results as you write SQL

​

Build dynamic DBT pipelines using flexible variable interpolation

Examples:

• {{ env_var('...') }}
• {{ variables('...') }}
• {{ mage_secret_var('...') }}

​

Automatically run DBT tests every time a pipeline runs

Write checks using DBT tests, then Mage will run them and fail the pipeline if the test results produce any failures.

​

Observability built-in

Monitor your DBT pipelines and get alerted when things break.

​

Supported connectors

1. dbt-bigquery
2. dbt-core
3. dbt-postgres
4. dbt-redshift
5. dbt-snowflake
6. dbt-sqlserver
7. dbt-trino
8. dbt-spark
9. [coming soon] dbt-dremio
10. [coming soon] dbt-clickhouse

​

Tutorials

• Set up DBT models & orchestrate DBT runs