ETL Frameworks
Open-Source Data Integration Platform
★ 4.6
Database-to-Database CLI Tool
★ 4.1
pip install airbytepip install ingestrpip install airbytepip install ingestrPython data engineers use Airbyte to replace hand-written API ingestion scripts — selecting a pre-built connector for the source API, configuring credentials, and Airbyte handles pagination, rate limiting, and incremental sync automatically. The Python CDK is used when a required source connector doesn't exist, enabling engineers to build and publish custom connectors.
Python data engineers use ingestr as a fast way to set up one-off or recurring data copies between systems — running `ingestr ingest --source-uri pg://... --dest-uri bq://... --table schema.table` from Python subprocess calls or shell scripts. For more complex transformations or pipeline logic, ingestr handles the raw ingestion while Python handles the business logic.
Individual Tool Pages