Poetry

About Poetry

Poetry is a Python dependency management and packaging tool that consolidates setup.py, requirements.txt, and Pipfile into a single pyproject.toml. It provides deterministic builds via a lockfile, automatic virtual environment management, and one-command PyPI publishing.

Key Features

• 1Consolidates setup.py, requirements.txt, setup.cfg, and Pipfile into a single pyproject.toml file
• 2Resolves and locks all transitive dependencies into a poetry.lock file for reproducible installs across environments
• 3Manages per-project virtual environments automatically — poetry run and poetry shell activate them without manual setup
• 4Builds and publishes Python packages to PyPI or private repositories with poetry build and poetry publish
• 5Supports dependency groups — separate lockable sets for dev, docs, and test dependencies installable on demand

How Python Data Engineers Use Poetry

Python data engineers use Poetry to standardize project setup across the team — running `poetry install` from a cloned repo installs all pinned dependencies in an isolated virtual environment in one step, eliminating environment drift between machines. The `poetry add pandas==2.0` command adds a package, resolves its transitive dependencies against the full graph, and updates `poetry.lock` atomically, preventing the 'it works on my machine' problem. For pipeline projects with separate concerns, `poetry add --group dev pytest great-expectations` keeps test and quality tooling out of the production install. Teams publishing internal data libraries to a private PyPI registry use `poetry publish --repository private-pypi` to handle build and upload in a single authenticated step.