Stream Processing
Distributed Event Streaming Platform
★ 4.8
Real-Time Streaming Data Platform
★ 3.5
pip install confluent-kafkapip install swimospip install confluent-kafkapip install swimosPython data engineers use `confluent-kafka-python` or `kafka-python` to produce events to topics and consume them in real-time. A common pattern is a Faust or plain consumer loop that reads messages, transforms them with pandas or Pydantic, and writes results to a database or another topic. Kafka is the backbone of event-driven data architectures in Python shops.
Python data engineers use the SwimOS Python client to connect Python-based data sources and processors to a Swim server's Web Agents. A Python script continuously pushes sensor readings or processed pipeline metrics into Swim agents, which aggregate and stream the live state to connected dashboards via WebSocket — enabling real-time monitoring without a separate WebSocket server.
Individual Tool Pages