Loading...
Orchestration Tools
End-to-End Data Pipeline Tool
★ 4.0
SQL-Based Data Transformation
★ 4.1
pip install bruin-clinpm install -g @dataform/clipip install bruin-clinpm install -g @dataform/cliPython data engineers use Bruin to define pipelines as a collection of SQL and Python files — SQL assets are automatically chained based on table references, and Python assets handle custom transformations or API calls that SQL cannot express. Bruin's CLI runs pipelines locally against DuckDB and in production against BigQuery or Snowflake.
Python data engineers use Dataform's API and CLI from Python automation scripts to trigger pipeline runs, validate assertion results, and manage compilation output programmatically. Dataform is particularly used in Google Cloud environments as a managed dbt-like alternative — engineers write SQLX files and Python orchestration scripts call the Dataform API to schedule and monitor runs.
Individual Tool Pages