十年网站开发经验 + 多家企业客户 + 靠谱的建站团队
量身定制 + 运营维护+专业推广+无忧售后,网站问题一站解决
sqoop2和sqoop1有较大的区别。将整体的ETL过程分割成server和client两部分执行,sqoop2是交互式的操作。
创新互联建站主营北林网站建设的网络公司,主营网站建设方案,重庆APP开发,北林h5微信平台小程序开发搭建,北林网站营销推广欢迎北林等地区企业咨询解压安装
[hadoop@fa01 ~]$ tar -zxvf sqoop-1.99.7-bin-hadoop200.tar.gz -C ./
重命名
[hadoop@fa01 ~]$ mv sqoop-1.99.7-bin-hadoop200 sqoop-1.99.7
同时新建一个extra文件,放置mysql的驱动文件(文件名随意,配置文件相对应上就可以)
[hadoop@fa01 sqoop-1.99.7]$ mkdir extra
[hadoop@fa01 ~]$ mv mysql-connector-java-5.1.5-bin.jar /home/hadoop/sqoop-1.99.7/extra/
配置环境变量。配置sqoop第三方jar包引用变量
[hadoop@fa01 ~]$ vim .bash_profile
export SQOOP_HOME=/home/hadoop/sqoopsqoop-1.99.7
export SQOOP_SERVER_EXTRA_LIB=/home/hadoop/sqoop-1.99.7/extra
修改hadoop的core-site.xml文件,这里的hadoop为用户名
[hadoop@fa01 ~]$ cd hadoop-2.6.0-cdh6.5.2/etc/hadoop
[hadoop@fa01 hadoop]$ vim core-site.xml
配置sqoop里的conf文件里面的# Hadoop configuration directory
[hadoop@fa01 ~]$ cd sqoop-1.99.7/conf/
[hadoop@fa01 conf]$ vim sqoop.properties
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/hadoop/hadoop-2.6.0-cdh6.5.2/etc/hadoop
检查sqoop是否配置成功
[hadoop@fa01 bin]$ ./sqoop2-tool verify
Setting conf dir: /home/hadoop/sqoop-1.99.7/bin/../conf
Sqoop home directory: /home/hadoop/sqoop-1.99.7
Sqoop tool executor:
Version: 1.99.7
Revision:435d5e61b922a32d7bce567fe5fb1a9c0d9b1bbb
Compiled on Tue Jul 19 16:08:27 PDT 2016 by abefine
Running tool: class org.apache.sqoop.tools.tool.VerifyTool
2017-06-21 01:31:48,489 INFO [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.
2017-06-21 01:31:48,539 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread
Verification was successful.
Tool class org.apache.sqoop.tools.tool.VerifyTool has finished correctly.
启动sqoop
[hadoop@fa01 bin]$ ./sqoop2-server start
Setting conf dir: /home/hadoop/sqoop-1.99.7/bin/../conf
Sqoop home directory: /home/hadoop/sqoop-1.99.7
Starting the Sqoop2 server...
2017-06-21 01:32:31,088 INFO [main] core.SqoopServer (SqoopServer.java:initialize(55)) - Initializing Sqoop server.
2017-06-21 01:32:31,100 INFO [main] core.PropertiesConfigurationProvider (PropertiesConfigurationProvider.java:initialize(99)) - Starting config file poller thread
Sqoop2 server started.
另外有需要云服务器可以了解下创新互联scvps.cn,海内外云服务器15元起步,三天无理由+7*72小时售后在线,公司持有idc许可证,提供“云服务器、裸金属服务器、高防服务器、香港服务器、美国服务器、虚拟主机、免备案服务器”等云主机租用服务以及企业上云的综合解决方案,具有“安全稳定、简单易用、服务可用性高、性价比高”等特点与优势,专为企业上云打造定制,能够满足用户丰富、多元化的应用场景需求。