|
1、例行模式
step 1:将$HIVE_HOME/conf/hive-site.xml拷贝到$SPARK_HOME/conf目录下,如果是cdh版的,则将/var/run/cloudera-scm-agent/process/259-hive-HIVESERVER2下面的hive-site.xml拷贝到/etc/spark/conf下面即可
step 2:spark-shell模式:./spark-shell --master local[2] --jars ../jars/mysql-connector-java-5.1.49.jar

step3:spark-sql模式:./spark-sql --master local[2] --jars ../jars/mysql-connector-java-5.1.49.jar --driver-class-path ../jars/mysql-connector-java-5.1.49.jar
注意:spark-sql模式比spark-shell模式多一个driver-class-path参数,但也可以不用,测试两者都通过了

2、Server模式
启动服务端:$SPARK_HOME/sbin/start-thriftserver.sh --master local --jars ../jars/mysql-connector-java-5.1.49.jar
启动客户端:$SPARK_HOME/bin/beeline -u jdbc:hive2://master:10000
3、IDEA访问,首先将hive-site.xml复制到项目的resources文件夹下,如图所示,不然会提示相关的表不存在。

|