python连接hive步骤（不出错版）

84 阅读 0 评论 56 点赞

我是靠谱客的博主野性黑猫，最近开发中收集的这篇文章主要介绍python连接hive步骤（不出错版），觉得挺不错的，现在分享给大家，希望可以做个参考。

概述

环境
redhat7.2、anaconda4.3、python3.5
安装python连接hive的依赖包
- yum install gcc python-devel libsmbclient-devel openldap-devel zlib-devel libjpeg-turbo-devel libtiff-devel freetype-devel libwebp-devel lcms2-devel krb5-devel
- pip install sasl
- pip install thrift
- pip install thrift-sasl
- pip install Pyhive
进入python环境，建立连接并查询数据

from pyhive import hive
conn = hive.Connection(host='hosts', port=10000, database='your databases')
import pandas as pd
df = pd.read_sql("SELECT * FROM table limit 10", conn)