Stream Processing
Real-Time Computation System
★ 4.4
Streaming Database for IoT
★ 3.6
pip install streamparsepip install hstreamdbpip install streamparsepip install hstreamdbPython data engineers use Apache Storm via the streamparse library to write Storm topologies in Python. Storm is used for real-time event processing, fraud detection, and IoT telemetry pipelines where data must be processed and acted upon within milliseconds. While Kafka Streams and Flink have largely superseded Storm in new builds, it remains in production at organisations processing high-velocity event streams.
Python data engineers use the `hstreamdb` Python client to produce and consume events from HStreamDB streams in IoT and real-time analytics pipelines. SQL subscriptions let Python consumers receive only the records matching a filter condition, reducing the amount of data the Python processor needs to handle and filter client-side.
Individual Tool Pages