Loading...
Data Ingestion
Delimited Data Preboarding
★ 3.7
Open Source Message Broker
★ 4.6
pip install csvpathpip install pikapip install csvpathpip install pikaPython data engineers use CSVPath to validate complex CSV files with business rules that go beyond column type checking — enforcing conditional constraints (if column A has value X, column B must be non-null), cross-row lookups, and custom matching expressions. CSVPath rules are stored as text files separate from the Python pipeline code, making them auditable by non-developers.
Python data engineers use `pika` or `aio-pika` to connect pipelines to RabbitMQ. A common pattern is a Python producer that publishes enriched records to a topic exchange after transformation, and multiple consumer processes that subscribe to routing key patterns for parallel downstream processing. RabbitMQ's dead-letter queues handle failed processing with configurable retry logic.
Individual Tool Pages