Databases & Data Warehouses
Distributed Search & Analytics
★ 4.6
Advanced Open Source Database
★ 4.8
pip install elasticsearchpip install psycopg2-binarypip install elasticsearchpip install psycopg2-binaryPython data engineers use the elasticsearch-py client to index documents, run search queries, and perform aggregations. Elasticsearch is commonly used as the serving layer for log analytics pipelines (ELK stack), product search systems, and observability platforms. Data engineers build pipelines that ingest structured data from databases or Kafka into Elasticsearch indices, enabling fast full-text search and faceted filtering for downstream applications.
PostgreSQL is the most popular database target for Python data pipelines. Engineers use `psycopg2` or `asyncpg` for direct connections, SQLAlchemy for ORM-based access, and `pd.read_sql()` for pulling query results into DataFrames. PostgreSQL's JSONB support is frequently used to store semi-structured API responses before they are normalized into relational tables.
Individual Tool Pages