dbt (Data Build Tool)

About dbt (Data Build Tool)

Open-source transformation tool enabling data analysts and engineers to transform, test, and document data in the warehouse. Focuses on the transform part of ETL with SQL templating and Python scripting.

Key Features

• 1SQL-first transformation layer with Jinja templating and macros
• 2Dependency graph between models enables correct execution order
• 3Built-in data tests (not-null, unique, accepted-values, relationships)
• 4Auto-generated documentation and data lineage visualization
• 5Python models support for pandas and Spark transformations alongside SQL

How Python Data Engineers Use dbt (Data Build Tool)

Data engineers use dbt to manage all transformation logic inside the warehouse — writing SELECT statements as `.sql` model files that dbt compiles and runs in the right order. Python engineers also write custom dbt tests and macros in Python, and use dbt's Python models feature to run pandas or Spark logic alongside SQL in the same project.