提示spark读取hive找不到库
Exception in thread "main" org.apache.spark.sql.catalyst.analysis.NoSuchDatabaseException: Database 'hxh' not found;
at org.apache.spark.sql.catalyst.catalog.ExternalCatalog.requireDbExists(ExternalCatalog.scala:40)
at org.apache.spark.sql.catalyst.catalog.InMemoryCatalog.tableExists(InMemoryCatalog.scala:323)
at org.apache.spark.sql.catalyst.catalog.ExternalCatalog.requireTableExists(ExternalCatalog.scala:45)
at org.apache.spark.sql.catalyst.catalog.InMemoryCatalog.getTable(InMemoryCatalog.scala:314)
at org.apache.spark.sql.catalyst.catalog.SessionCatalog.lookupRelation(SessionCatalog.scala:681)
at org.apache.spark.sql.SparkSession.table(SparkSession.scala:609)
at org.apache.spark.sql.SparkSession.table(SparkSession.scala:605)
at org.apache.spark.sql.DataFrameReader.table(DataFrameReader.scala:591)
at com.hxh.spark.SqlNetworkWordCount$.main(SqlNetworkWordCount.scala:44)
at com.hxh.spark.SqlNetworkWordCount.main(SqlNetworkWordCount.scala)
解决方案:
加上enableHiveSupport()即可,否则默认不读hive-site.xml。
val sparkConf = new SparkConf().setAppName("SqlNetworkWordCount").setMaster("local[*]").enableHiveSupport().getOrCreate()
最后
以上就是自由牛排最近收集整理的关于spark读取Hive出错: Database 'hxh' not found;的全部内容,更多相关spark读取Hive出错:内容请搜索靠谱客的其他文章。
本图文内容来源于网友提供,作为学习参考使用,或来自网络收集整理,版权属于原作者所有。
发表评论 取消回复