// big-data-processing

Apache Hive

Data Warehouse on Hadoop

About Apache Hive

A data warehouse software that facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Hive provides a SQL-like interface (HiveQL) for querying data stored in Hadoop's HDFS and other compatible systems.

Key Features

1SQL interface for reading and writing data stored in HDFS and S3
2Partitioned and bucketed tables for query pruning and performance
3Hive Metastore serves as the central schema registry for the Hadoop ecosystem
4ACID transactions on ORC-format tables for update and delete support
5HiveServer2 provides JDBC/ODBC connectivity for BI tools and Python clients

How Python Data Engineers Use Apache Hive

Python data engineers use `PyHive` to query Hive tables from Python scripts and notebooks — executing HiveQL via a JDBC-like interface and returning results as pandas DataFrames. The Hive Metastore is used by Spark, Presto, and Glue to discover table schemas, making it the central catalog for Python-based data lake pipelines on Hadoop clusters.

Frequently Asked Questions

What is Apache Hive used for?▾

Is Apache Hive free to use?▾

Yes, Apache Hive is free to use.

What category does Apache Hive belong to?▾

Apache Hive is listed under the Big Data Processing category on Python Data Engineering.

Verified Listing

Visit Website

// contains affiliate links

Details

Similar Big Data Processing Tools

3 tools

Tool	Pricing	Rating
PR Prestofeatured Distributed SQL Query Engine	Free	★ 4.5	→
AT Apache Tez DAG-Based Processing Framework	Free	★ 4.0	→
AD Apache Drill Schema-Free SQL Query Engine	Free	★ 4.0	→