ETL Frameworks
Database-to-Database CLI Tool
★ 4.1
Data Manipulation & Analysis Library
★ 4.9
pip install ingestrpip install pandaspip install ingestrpip install pandasPython data engineers use ingestr as a fast way to set up one-off or recurring data copies between systems — running `ingestr ingest --source-uri pg://... --dest-uri bq://... --table schema.table` from Python subprocess calls or shell scripts. For more complex transformations or pipeline logic, ingestr handles the raw ingestion while Python handles the business logic.
Pandas is the go-to tool for data wrangling in Python pipelines. Engineers use DataFrames to load raw data from CSVs or databases, clean and transform it (renaming columns, filtering rows, filling nulls), then write results to Parquet or a data warehouse. It is the standard intermediate layer between data ingestion and downstream processing.
Individual Tool Pages