...
Hive on Spark is available from Hive 1.1+ onward. It is still under active development in "spark" and "spark2" branches, and is periodically merged into the "master" branch for Hive.
See HIVE-7292 and its sub-tasks and linked issues.
Version Compatibility
Hive on Spark is only tested with a specific version of Spark, so a given version of Hive is only guaranteed to work with a specific version of Spark. Other versions of Spark may work with a given version of Hive, but that is no guaranteed. Below is a list of Hive versions and their corresponding compatible Spark versions.
| Hive Version | Spark Version |
|---|---|
| master | 2.2.0 |
| 2.3.x | 2.0.0 |
| 2.2.x | 1.6.0 |
| 2.1.x | 1.6.0 |
| 2.0.x | 1.5.0 |
| 1.2.x | 1.3.1 |
| 1.1.x | 1.2.0 |
Spark Installation
Follow instructions to install Spark:
...