Loading...
Stream Processing
Python ETL for Real-Time Data
★ 4.3
Streaming SQL Database
★ 3.8
pip install pathwayN/A — PostgreSQL extensionpip install pathwayN/A — PostgreSQL extensionPython data engineers use Pathway to write streaming pipelines in pure Python without learning a separate API — the DataFrame-like operators (filter, join, groupby, reduce) work identically on both batch files and live Kafka streams. Pathway is particularly suited for real-time feature engineering pipelines that need to update model inputs as new events arrive.
Python data engineers use PipelineDB via standard `psycopg2` connections — defining continuous views in SQL that automatically aggregate incoming rows. A Python ingestion process writes events to PipelineDB streams using standard INSERT statements, and the continuous view query results update in real time, making precomputed aggregates instantly available for dashboards.
Individual Tool Pages