// orchestration

Apache Oozie

Hadoop Workflow Scheduler

About Apache Oozie

A workflow scheduler system for managing Apache Hadoop jobs. Oozie supports MapReduce, Pig, Hive, and Sqoop jobs through a coordinator and workflow engine, enabling complex multi-stage data processing pipelines on Hadoop clusters.

Key Features

1Workflow scheduler for Hadoop jobs: MapReduce, Hive, Pig, Sqoop, and Spark
2Coordinator service schedules workflows based on time and data availability
3Bundle workflows group coordinators for multi-pipeline management
4Parameterized workflow definition for reuse across environments
5SLA monitoring with email alerts on job delay or failure

How Python Data Engineers Use Apache Oozie

Python data engineers trigger and monitor Oozie workflows via the Oozie REST API from Python management scripts. Python jobs integrate into Oozie workflows as shell action types that execute Python scripts on the Hadoop cluster nodes. Oozie coordinators are used to trigger Python-based ingestion workflows when new data files land in HDFS.

Frequently Asked Questions

What is Apache Oozie used for?▾

Is Apache Oozie free to use?▾

Yes, Apache Oozie is free to use.

What category does Apache Oozie belong to?▾

Apache Oozie is listed under the Orchestration Tools category on Python Data Engineering.

Verified Listing

Visit Website

// contains affiliate links

Details

Similar Orchestration Tools Tools

3 tools

Tool	Pricing	Rating
AT Apache Tez DAG-Based Processing Framework	Free	★ 4.0	→
PR Prestofeatured Distributed SQL Query Engine	Free	★ 4.5	→
AH Apache Hive Data Warehouse on Hadoop	Free	★ 4.3	→