Soda Core

About Soda Core

Open-source data quality tool with CLI for defining, running, and monitoring data quality checks. Write tests to verify data meets conditions like missing values, ranges, or uniqueness.

Key Features

• 1YAML-based SodaCL language for declaring data quality checks
• 2Checks for missing values, duplicates, schema changes, and custom SQL
• 3Runs against BigQuery, Snowflake, Redshift, DuckDB, Spark, and more
• 4Sends scan results to Soda Cloud for trend monitoring and alerting
• 5Python SDK for programmatic check execution and result inspection

How Python Data Engineers Use Soda Core

Data engineers integrate Soda Core into Airflow or dbt pipelines to run data quality scans after each transformation step. A scan YAML file defines checks on a specific table, the Python SDK runs them, and failed checks are reported to Soda Cloud or surfaced as pipeline task failures to block bad data from advancing.