我是靠谱客的博主 雪白康乃馨,最近开发中收集的这篇文章主要介绍HQL训练进阶(50题附答案)HQL训练进阶 说明一、建表二、导入数据三、练习(答案见第四节)四、答案阶段总结1阶段总结2阶段总结3,觉得挺不错的,现在分享给大家,希望可以做个参考。
概述
HQL训练进阶 说明
HQL是数据清洗必备技能,分三个模块进阶学习
一、建表
create table student(s_id string,s_name string,s_birth string,s_sex string) row format delimited fields terminated by ' ';
create table course(c_id string,c_name string,t_id string) row format delimited fields terminated by ' ';
create table teacher(t_id string,t_name string) row format delimited fields terminated by ' ';
create table score(s_id string,c_id string,s_score int) row format delimited fields terminated by ' ';
二、导入数据
vim /home/student/student.csv
01 赵雷 1990-01-01 男
02 钱电 1990-12-21 男
03 孙风 1990-05-20 男
04 李云 1990-08-06 男
05 周梅 1991-12-01 女
06 吴兰 1992-03-01 女
07 郑竹 1989-07-01 女
08 王菊 1990-01-20 女
vim /home/student/course.csv
01 语文 02
02 数学 01
03 英语 03
vim /home/student/teacher.csv
01 张三
02 李四
03 王五
vim /home/student/score.csv
01 01 80
01 02 90
01 03 99
02 01 70
02 02 60
02 03 80
03 01 80
03 02 80
03 03 80
04 01 50
04 02 30
04 03 20
05 01 76
05 02 87
06 01 31
06 03 34
07 02 89
07 03 98
导入本地数据到Hive中
LOAD DATA LOCAL INPATH '/home/student/student.csv' INTO TABLE student;
LOAD DATA LOCAL INPATH '/home/student/score.csv' INTO TABLE score;
LOAD DATA LOCAL INPATH '/home/student/course.csv' INTO TABLE course;
LOAD DATA LOCAL INPATH '/home/student/teacher.csv' INTO TABLE teacher;
三、练习(答案见第四节)
查询语法
SELECT [ALL | DISTINCT] select_expr, select_expr, ...
FROM table_reference
[WHERE where_condition]
[GROUP BY col_list [HAVING condition]]
[CLUSTER BY col_list
| [DISTRIBUTE BY col_list] [SORT BY| ORDER BY col_list]
]
[LIMIT number]
- 查询"01"课程比"02"课程成绩高的学生的信息及课程分数
- 查询"01"课程比"02"课程成绩低的学生的信息及课程分数
- 查询平均成绩大于等于60分的同学的学生编号和学生姓名和平均成绩
- 查询平均成绩小于60分的同学的学生编号和学生姓名和平均成绩:– (包括有成绩的和无成绩的)
- 查询所有同学的学生编号、学生姓名、选课总数、所有课程的总成绩
- 查询"李"姓老师的数量
- 查询学过"张三"老师授课的同学的信息
- 查询没学过"张三"老师授课的同学的信息
- 查询学过编号为"01"并且也学过编号为"02"的课程的同学的信息
- 查询学过编号为"01"
但是
没有学过编号为"02"的课程的同学的信息 - 查询没有学全所有课程的同学的信息
- 查询至少有一门课与学号为"01"的同学所学相同的同学的信息
- 查询和"01"号的同学学习的课程完全相同的其他同学的信息
- 查询没学过"张三"老师讲授的任一门课程的学生姓名
- 查询两门及其以上不及格课程的同学的学号,姓名及其平均成绩
- 检索"01"课程分数小于60,按分数降序排列的学生信息
- 按平均成绩从高到低显示所有学生的所有课程的成绩以及平均成绩
- 查询各科成绩最高分、最低分和平均分:以如下形式显示:课程ID,课程name,最高分,最低分,平均分,及格率,中等率,优良率,优秀率(及格为>=60,中等为:70-80,优良为:80-90,优秀为:>=90)
- 按各科成绩进行排序,并显示排名
- 查询学生的总成绩并进行排名
- 查询不同老师所教不同课程平均分从高到低显示
- 查询所有课程的成绩第2名到第3名的学生信息及该课程成绩
- 统计各科成绩各分数段人数:课程编号,课程名称,[100-85],[85-70],[70-60],[0-60]及所占百分比
- 查询学生平均成绩及其名次
- 查询各科成绩前三名的记录
- 查询每门课程被选修的学生数
- 查询出只有两门课程的全部学生的学号和姓名
- 查询男生、女生人数
- 查询名字中含有"风"字的学生信息
- 查询同名同性学生名单,并统计同名人数
- 查询1990年出生的学生名单
- 查询每门课程的平均成绩,结果按平均成绩降序排列,平均成绩相同时,按课程编号升序排列
- 查询平均成绩大于等于85的所有学生的学号、姓名和平均成绩
- 查询课程名称为"数学",且分数低于60的学生姓名和分数
- 查询所有学生的课程及分数情况
- 查询任何一门课程成绩在70分以上的学生姓名、课程名称和分数
- 查询课程不及格的学生
- 查询课程编号为01且课程成绩在80分以上的学生的学号和姓名
- 求每门课程的学生人数
- 查询选修"张三"老师所授课程的学生中,成绩最高的学生信息及其成绩
- 查询不同课程成绩相同的学生的学生编号、课程编号、学生成绩
- 查询每门课程成绩最好的前三名
- 统计每门课程的学生选修人数(超过5人的课程才统计)要求输出课程号和选修人数,查询结果按人数降序排列,若人数相同,按课程号升序排列
- 检索至少选修两门课程的学生学号
- 查询选修了全部课程的学生信息
- 查询各学生的年龄(周岁)按照出生日期来算,当前月日 < 出生年月的月日则,年龄减一
- 查询本周过生日的学生
- 查询下周过生日的学生
- 查询本月过生日的学生
- 查询12月份过生日的学生
四、答案
- 查询"01"课程比"02"课程成绩高的学生的信息及课程分数
方法一
SELECT *,a.s_score as 01_score,b.s_score as 02_score
FROM student
JOIN score a on student.s_id=a.s_id AND a.c_id='01'
LEFT JOIN score b on student.s_id=b.s_id and b.c_id='02'
WHERE a.s_score > b.s_score;
方法二
SELECT *,a.s_score as 01_score,b.s_score as 02_score FROM student s
JOIN score a on a.c_id='01'
JOIN score b on b.c_id='02'
WHERE a.s_id = s.s_id AND b.s_id = s.s_id AND a.s_score > b.s_score;
- 查询"01"课程比"02"课程成绩低的学生的信息及课程分数
方法一
SELECT *,a.s_score as 01_score,b.s_score as 02_score
FROM student
JOIN score a on student.s_id=a.s_id AND a.c_id='01'
LEFT JOIN score b on student.s_id=b.s_id and b.c_id='02'
WHERE a.s_score < b.s_score;
方法二
SELECT *,a.s_score as 01_score,b.s_score as 02_score FROM student s
JOIN score a on a.c_id='01'
JOIN score b on b.c_id='02'
WHERE a.s_id = s.s_id AND b.s_id = s.s_id AND a.s_score < b.s_score;
- 查询平均成绩大于等于60分的同学的学生编号和学生姓名和平均成绩
SELECT student.s_id,s_name,avg(a.s_score) as ‘平均成绩’ FROM student
JOIN score a on a.s_id = student.s_id
GROUP BY student.s_id,student.s_name
HAVING avg(a.s_score) >= 60;
- 查询平均成绩小于60分的同学的学生编号和学生姓名和平均成绩:– (包括有成绩的和无成绩的)
SELECT s_id,s_name,avg(a.s_score) FROM student
JOIN score a ON a.s_id = student.s_id
GROUP BY student.s_id,student.s_name
HAVING avg(a.s_score) <= 60
UNION all
select s.s_id,s.s_name,0 FROM student s
WHERE s.s_id NOT IN (SELECT DISTINCT sc.s_id FROM score sc)
- 查询所有同学的学生编号、学生姓名、选课总数、所有课程的总成绩
SELECT student.s_id,student.s_name,(count(score.c_id)) as total_count,sum(score.s_score) as total_score
FROM student
LEFT JOIN score on student.s_id = score.s_id
GROUP BY student.s_id,student.s_name;
- 查询"李"姓老师的数量
SELECT t_name,count(t_name) FROM teacher WHERE t_name like '李%' GROUP BY t_name;
- 查询学过"张三"老师授课的同学的信息
select student.* from student
join score on student.s_id =score.s_id
join course on course.c_id=score.c_id
join teacher on course.t_id=teacher.t_id and t_name='张三';
- 查询没学过"张三"老师授课的同学的信息
select student.* from student
left join (select s_id from score
join course on course.c_id=score.c_id
join teacher on course.t_id=teacher.t_id and t_name='张三')tmp
on student.s_id =tmp.s_id
where tmp.s_id is null;
- 查询学过编号为"01"并且也学过编号为"02"的课程的同学的信息
SELECT student.* FROM student
JOIN (SELECT s_id FROM score WHERE c_id = '1')tmp1
on student.s_id = tmp1.s_id
JOIN (SELECT s_id FROM score WHERE c_id = '2')tmp2
on student.s_id=tmp2.s_id;
- 查询学过编号为"01"但是没有学过编号为"02"的课程的同学的信息
select student.* from student
join (select s_id from score where c_id =1 )tmp1
on student.s_id=tmp1.s_id
left join (select s_id from score where c_id =2 )tmp2
on student.s_id =tmp2.s_id
where tmp2.s_id is null;
- 查询没有学全所有课程的同学的信息
SELECT * FROM student
JOIN (SELECT count(c_id)num1 FROM course)tmp1
LEFT JOIN(
SELECT s_id,count(c_id)num2
FROM score GROUP BY s_id
)tmp2
on student.s_id=tmp2.s_id and tmp1.num1=tmp2.num2
WHERE tmp2.s_id is NULL;
- 查询至少有一门课与学号为"01"的同学所学相同的同学的信息
select student.* from student
join (select c_id from score where score.s_id='01')tmp1
join (select s_id,c_id from score)tmp2
on tmp1.c_id =tmp2.c_id and student.s_id =tmp2.s_id
where student.s_id not in('01');
- 查询和"01"号的同学学习的课程完全相同的其他同学的信息
select student.*,tmp1.course_id from student
join (select s_id ,concat_ws('|', collect_set(c_id)) course_id from score
group by s_id having s_id not in (1))tmp1
on student.s_id = tmp1.s_id
join (select concat_ws('|', collect_set(c_id)) course_id2
from score where s_id=1)tmp2
on tmp1.course_id = tmp2.course_id2;
- 查询没学过"张三"老师讲授的任一门课程的学生姓名
select student.* from student
left join (select s_id from score
join (select c_id from course join teacher on course.t_id=teacher.t_id and t_name='张三')tmp2
on score.c_id=tmp2.c_id )tmp
on student.s_id = tmp.s_id
where tmp.s_id is null;
- 查询两门及其以上不及格课程的同学的学号,姓名及其平均成绩
select student.s_id,student.s_name,tmp.avg_score from student
inner join (select s_id from score
where s_score<60
group by score.s_id having count(s_id)>1)tmp2
on student.s_id = tmp2.s_id
left join (
select s_id,round(AVG (score.s_score)) avg_score
from score group by s_id)tmp
on tmp.s_id=student.s_id;
- 检索"01"课程分数小于60,按分数降序排列的学生信息
select student.*,s_score from student,score
where student.s_id=score.s_id and s_score<60 and c_id='01'
order by s_score desc;
- 按平均成绩从高到低显示所有学生的所有课程的成绩以及平均成绩
select a.s_id,tmp1.s_score as chinese,tmp2.s_score as math,tmp3.s_score as english,
round(avg (a.s_score),2) as avgScore
from score a
left join (select s_id,s_score from score s1 where c_id='01')tmp1 on tmp1.s_id=a.s_id
left join (select s_id,s_score from score s2 where c_id='02')tmp2 on tmp2.s_id=a.s_id
left join (select s_id,s_score from score s3 where c_id='03')tmp3 on tmp3.s_id=a.s_id
group by a.s_id,tmp1.s_score,tmp2.s_score,tmp3.s_score order by avgScore desc;
- 查询各科成绩最高分、最低分和平均分:以如下形式显示:课程ID,课程name,最高分,最低分,平均分,及格率,中等率,优良率,优秀率:
–及格为>=60,中等为:70-80,优良为:80-90,优秀为:>=90
select course.c_id,course.c_name,tmp.maxScore,tmp.minScore,tmp.avgScore,tmp.passRate,tmp.moderate,tmp.goodRate,tmp.excellentRates from course
join(select c_id,max(s_score) as maxScore,min(s_score)as minScore,
round(avg(s_score),2) avgScore,
round(sum(case when s_score>=60 then 1 else 0 end)/count(c_id),2)passRate,
round(sum(case when s_score>=60 and s_score<70 then 1 else 0 end)/count(c_id),2) moderate,
round(sum(case when s_score>=70 and s_score<80 then 1 else 0 end)/count(c_id),2) goodRate,
round(sum(case when s_score>=80 and s_score<90 then 1 else 0 end)/count(c_id),2) excellentRates
from score group by c_id)tmp on tmp.c_id=course.c_id;
- 按各科成绩进行排序,并显示排名:
– row_number() over()分组排序功能(mysql没有该方法)
select s1.*,row_number()over(order by s1.s_score desc) Ranking
from score s1 where s1.c_id='01'order by Ranking asc
union all select s2.*,row_number()over(order by s2.s_score desc) Ranking
from score s2 where s2.c_id='02'order by Ranking asc
union all select s3.*,row_number()over(order by s3.s_score desc) Ranking
from score s3 where s3.c_id='03'order by Ranking asc;
- 查询学生的总成绩并进行排名
select score.s_id,s_name,sum(s_score) sumscore,row_number()over(order by sum(s_score) desc) Ranking
from score ,student
where score.s_id=student.s_id
group by score.s_id,s_name order by sumscore desc;
阶段总结1
(1).Hive不支持join的非等值连接,不支持or
分别举例如下及实现解决办法。
不支持不等值连接
错误:select * from a inner join b on a.id<>b.id
替代方法:select * from a inner join b on a.id=b.id and a.id is null;
不支持or
错误:select * from a inner join b on a.id=b.id or a.name=b.name
替代方法:select * from a inner join b on a.id=b.id
union all
select * from a inner join b on a.name=b.name
两个sql union all的字段名必须一样或者列别名要一样。
(2).分号字符:不能智能识别concat(‘;’,key),只会将‘;’当做SQL结束符号。
•分号是SQL语句结束标记,在HiveQL中也是,但是在HiveQL中,对分号的识别没有那么智慧,例如:
•select concat(key,concat(';',key)) from dual;
•但HiveQL在解析语句时提示:
FAILED: Parse Error: line 0:-1 mismatched input '<EOF>' expecting ) in function specification
•解决的办法是,使用分号的八进制的ASCII码进行转义,那么上述语句应写成:
•select concat(key,concat('