ETL Frameworks
Bulk Data Loader
★ 3.9
Sheets to Data Warehouse Loader
★ 3.7
N/A — Java-based, install via embulk.orgpip install gspreadN/A — Java-based, install via embulk.orgpip install gspreadPython data engineers invoke Embulk from Python subprocess calls or Airflow BashOperator tasks — generating the YAML config file programmatically from a Python template, then running `embulk run config.yml`. Embulk's parallel file loading is used for bulk data migrations from legacy systems to modern warehouses where Python-native libraries are too slow.
Python data engineers use the `gspread` library to read business-owned datasets from Google Sheets into pandas DataFrames for pipeline processing. A common pattern is a weekly data feed maintained by a business team in Sheets — Python reads the latest values, validates them with Pydantic, transforms them, and loads them into the warehouse alongside operational data.
Individual Tool Pages