Hive数据仓库的搭建和简单的使用

75 阅读 0 评论 50 点赞

我是靠谱客的博主忐忑金毛，最近开发中收集的这篇文章主要介绍Hive数据仓库的搭建和简单的使用，觉得挺不错的，现在分享给大家，希望可以做个参考。

概述

下载安装包并解压

下载地址http://archive.cloudera.com/cdh5/cdh/5/ 选择hive-1.1.0-cdh5.7.0.tar.gz包
[hadoop@hadoop000 ~]$ ll
total 32
drwxrwxr-x 4 hadoop hadoop 4096 Jun
1 21:27 app
--软件安装路径
drwx------ 3 hadoop hadoop 4096 Jun
1 21:46 data
drwxrwxr-x 2 hadoop hadoop 4096 May 31 19:41 lib
drwxrwxr-x 2 hadoop hadoop 4096 May 31 19:41 maven_repo
drwxrwxr-x 2 hadoop hadoop 4096 Jun
1 21:46 pids
drwxrwxr-x 2 hadoop hadoop 4096 May 31 19:42 shell
drwxrwxr-x 2 hadoop hadoop 4096 May 31 19:48 software
--安装包路径
drwxrwxr-x 3 hadoop hadoop 4096 May 31 20:59 source
--源码包路径
[hadoop@hadoop000 ~]$ cd software/
[hadoop@hadoop000 software]$ pwd

配置环境变量

[hadoop@oradb3 ~]$ vi .bash_profile
# 添加下面内容：
export HIVE_HOME=/home/hadoop/app/hive-1.1.0-cdh5.7.0
export PATH=$HIVE_HOME/bin:$PATH
[hadoop@oradb3 ~]$ source .bash_profile
# 或添加到全局环境变量/etc/profile也可以

配置文件修改

[hadoop@hadoop000 conf]$ pwd
/home/hadoop/app/hive-1.1.0-cdh5.7.0/conf
[hadoop@hadoop000 conf]$ cp hive-env.sh.template
hive-env.sh
[hadoop@hadoop000 conf]$ vi hive-env.sh
# 更改HADOOP_HOME
HADOOP_HOME=/home/hadoop/app/hadoop-2.6.0-cdh5.7.0
[hadoop@hadoop000 conf]$ vi hive-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://localhost:3306/ruozedata_basic03?createDatabaseIfNotExist=true</value>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>123456</value>
</property>
</configuration>

在lib下添加MySQL驱动包

# 需要自行下载 下载地址https://dev.mysql.com/downloads/connector/j/
[hadoop@oradb3 lib]$ pwd
/home/hadoop/app/hive-1.1.0-cdh5.7.0/lib
[hadoop@oradb3 lib]$ ll mysql-connector-java-5.1.13-bin.jar
-rw-r--r-- 1 hadoop hadoop 767492 Jun
1 22:01 mysql-connector-java-5.1.13-bin.jar

创建表进行测试

[hadoop@oradb3 ~]$ hive
which: no hbase in (/home/hadoop/app/hive-1.1.0-cdh5.7.0/bin:/home/hadoop/app/hadoop-2.6.0-cdh5.7.0/bin:/usr/java/jdk1.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin)
Logging initialized using configuration in jar:file:/home/hadoop/app/hive-1.1.0-cdh5.7.0/lib/hive-common-1.1.0-cdh5.7.0.jar!/hive-log4j.properties
hive> create database ruoze;
OK
Time taken: 1.35 seconds
hive> use ruoze;
OK
Time taken: 0.05 seconds
hive> create table test (id int);
OK
Time taken: 0.65 seconds
hive> show tables;
OK