Data Ingestion
Database to Data Lake ETL
★ 3.5
Polyglot Document Intelligence
★ 3.8
pip install db2lakepip install kreuzbergpip install db2lakepip install kreuzbergPython data engineers use db2lake to bootstrap data lake migration projects — extracting historical data from relational databases and writing it as partitioned Parquet files to S3 or HDFS. Once the initial migration is done, incremental extractions keep the lake in sync, and Python-based PySpark or DuckDB pipelines take over for ongoing processing.
Python data engineers use Kreuzberg to build document ingestion pipelines that extract text from uploaded PDFs, scanned images, and Office files. The async API integrates cleanly into FastAPI-based document processing services — an endpoint accepts a file upload, Kreuzberg extracts the text asynchronously, and the pipeline stores the result in a search index or warehouse for downstream analysis.
Individual Tool Pages