Getting Started
Containerization Platform
★ 4.8
Code Editor & IDE
★ 4.8
N/A — download from docker.comN/A — download from code.visualstudio.comN/A — download from docker.comN/A — download from code.visualstudio.comDocker is the standard deployment unit for Python data pipelines. Engineers write a Dockerfile that installs Python, copies pipeline code, and installs `requirements.txt` — the resulting image runs identically on a developer laptop, CI server, Kubernetes cluster, or Airflow worker. Docker Compose is used locally to run pipelines alongside their dependencies (Postgres, Redis, Kafka).
VS Code is the most widely used editor in the Python data engineering community. Engineers use it with the Python, Pylance, and Jupyter extensions for developing ETL scripts, dbt models, and data pipeline orchestration code. The dbt Power User extension provides SQL autocompletion and model lineage views. Remote SSH and Dev Containers extensions enable engineers to develop directly inside cloud environments or Docker containers, ensuring consistency with production.
Individual Tool Pages