安装sqoop1.99.7

发布时间:2020-03-18 11:00:50 作者:白话
来源:网络 阅读:790

sqoop2和sqoop1有较大的区别。将整体的ETL过程分割成server和client两部分执行,sqoop2是交互式的操作。


解压安装

[hadoop@fa01 ~]$ tar -zxvf sqoop-1.99.7-bin-hadoop200.tar.gz -C ./

重命名

[hadoop@fa01 ~]$ mv sqoop-1.99.7-bin-hadoop200 sqoop-1.99.7


同时新建一个extra文件,放置mysql的驱动文件(文件名随意,配置文件相对应上就可以)

[hadoop@fa01 sqoop-1.99.7]$ mkdir extra

[hadoop@fa01 ~]$ mv mysql-connector-java-5.1.5-bin.jar /home/hadoop/sqoop-1.99.7/extra/


配置环境变量。配置sqoop第三方jar包引用变量

[hadoop@fa01 ~]$ vim .bash_profile

export SQOOP_HOME=/home/hadoop/sqoopsqoop-1.99.7

export SQOOP_SERVER_EXTRA_LIB=/home/hadoop/sqoop-1.99.7/extra


修改hadoop的core-site.xml文件,这里的hadoop为用户名

[hadoop@fa01 ~]$ cd hadoop-2.6.0-cdh6.5.2/etc/hadoop

[hadoop@fa01 hadoop]$ vim core-site.xml

<property>

<name>hadoop.proxyuser.hadoop.hosts</name>

<value>*</value>

</property>

<property>

<name>hadoop.proxyuser.hadoop.groups</name>

<value>*</value>

</property>


配置sqoop里的conf文件里面的# Hadoop configuration directory

[hadoop@fa01 ~]$ cd sqoop-1.99.7/conf/

[hadoop@fa01 conf]$ vim sqoop.properties

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/hadoop/hadoop-2.6.0-cdh6.5.2/etc/hadoop


检查sqoop是否配置成功

[hadoop@fa01 bin]$ ./sqoop2-tool verify

Setting conf dir: /home/hadoop/sqoop-1.99.7/bin/../conf

Sqoop home directory: /home/hadoop/sqoop-1.99.7

Sqoop tool executor:

Version: 1.99.7

Revision:435d5e61b922a32d7bce567fe5fb1a9c0d9b1bbb

Compiled on Tue Jul 19 16:08:27 PDT 2016 by abefine

Running tool: class org.apache.sqoop.tools.tool.VerifyTool

2017-06-21 01:31:48,489 INFO  [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.

2017-06-21 01:31:48,539 INFO  [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread

Verification was successful.

Tool class org.apache.sqoop.tools.tool.VerifyTool has finished correctly.


启动sqoop

[hadoop@fa01 bin]$ ./sqoop2-server start

Setting conf dir: /home/hadoop/sqoop-1.99.7/bin/../conf

Sqoop home directory: /home/hadoop/sqoop-1.99.7

Starting the Sqoop2 server...

2017-06-21 01:32:31,088 INFO  [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.

2017-06-21 01:32:31,100 INFO  [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread

Sqoop2 server started.


推荐阅读:
  1. PHPstudy 安装redis扩展 以及安装redis
  2. Hbase安装-单机安装

免责声明:本站发布的内容(图片、视频和文字)以原创、转载和分享为主,文章观点不代表本网站立场,如果涉及侵权请联系站长邮箱:is@yisu.com进行举报,并提供相关证据,一经查实,将立刻删除涉嫌侵权内容。

sqoop2 qo

上一篇:升级curl版本

下一篇:通用电气GE微服务实践:在容器中部署有状态应用

相关阅读

您好,登录后才能下订单哦!

密码登录
登录注册
其他方式登录
点击 登录注册 即表示同意《亿速云用户服务条款》