Hamilton

About Hamilton

A lightweight Python library for defining data transformations as a directed acyclic graph (DAG). Hamilton uses Python function signatures to define dataflow, making pipelines self-documenting, testable, and easy to maintain.

Key Features

• 1Micro-framework where Python function names define the data dependency DAG
• 2Functions with typed inputs and outputs automatically form a directed graph
• 3Executors: sync, async, Spark, Dask, and Ray for scalable execution
• 4Built-in lineage tracking and documentation generation from docstrings
• 5Feature engineering-focused with pandas, Polars, and numpy support

How Python Data Engineers Use Hamilton

Python data engineers use Hamilton to define feature engineering pipelines where each column or feature is a Python function whose parameters declare its dependencies. Hamilton builds the DAG from function signatures automatically — engineers add a new feature by writing a new function, and Hamilton wires it into the execution graph without any manual DAG configuration.