Data Quality
Automated Data Cleaning
★ 4.2
Data Quality Testing
★ 4.6
N/A — Java-based applicationpip install soda-coreN/A — Java-based applicationpip install soda-coreData engineers use DataCleaner early in the pipeline development cycle to quickly profile new datasets — running it on a sample DataFrame to surface nulls, outliers, and type inconsistencies before writing cleaning logic. It accelerates the discovery phase by auto-detecting common quality issues that would otherwise require manual inspection.
Data engineers integrate Soda Core into Airflow or dbt pipelines to run data quality scans after each transformation step. A scan YAML file defines checks on a specific table, the Python SDK runs them, and failed checks are reported to Soda Cloud or surfaced as pipeline task failures to block bad data from advancing.
Individual Tool Pages