Sqoop returns "response status of 404 Not Found" -
i have installed latest hadoop 2.5.1 , sqoop 1.99.3 (from tarball files) on centos 7. sqoop installed according instructions here: http://sqoop.apache.org/docs/1.99.3/installation.html
i wanted test sqoop server according page: http://sqoop.apache.org/docs/1.99.3/sqoop5minutesdemo.html
i ran following command:
show version --all and got following error message:
exception: com.sun.jersey.api.client.uniforminterfaceexception message: http://localhost:12000/sqoop/version returned response status of 404 not found this config , log files contain after tried start sqoop server (by running sqoop.sh server start):
sqoop variables in /etc/bashrc:
export sqoop_home="/usr/local/sqoop" export sqoop_conf_dir=$sqoop_home/server/conf /usr/local/sqoop/server/conf/catalina.properties:
/usr/local/hadoop/share/hadoop/common/*.jar, /usr/local/hadoop/share/hadoop/common/lib/*.jar, /usr/local/hadoop/share/hadoop/hdfs/*.jar, /usr/local/hadoop/share/hadoop/hdfs/lib/*.jar, /usr/local/hadoop/share/hadoop/mapreduce/*.jar, /usr/local/hadoop/share/hadoop/mapreduce/lib/*.jar, /usr/local/hadoop/share/hadoop/tools/*.jar, /usr/local/hadoop/share/hadoop/tools/lib/*.jar, /usr/local/hadoop/share/hadoop/yarn/*.jar, /usr/local/hadoop/share/hadoop/yarn/lib/*.jar /usr/local/sqoop/server/conf/sqoop.properties:
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/usr/local/hadoop/etc/hadoop/ /usr/local/sqoop/server/logs/localhost.2014-11-13.log:
severe: exception sending context initialized event listener instance of class org.apache.sqoop.server.serverinitializer java.lang.noclassdeffounderror: org/apache/hadoop/conf/configuration /usr/local/sqoop/log/sqoop.log:
2014-11-13 08:19:55,466 info audit.auditloggermanager [org.apache.sqoop.audit.auditloggermanager.initialize(auditloggermanager.java:79)] begin audit logger manager initialization 2014-11-13 08:19:55,470 warn audit.fileauditlogger [org.apache.sqoop.audit.fileauditlogger.initialize(fileauditlogger.java:67)] appender: log4j.appender.defaultappender 2014-11-13 08:19:55,471 info audit.auditloggermanager [org.apache.sqoop.audit.auditloggermanager.initializeloggers(auditloggermanager.java:126)] audit logger has been initialized: default 2014-11-13 08:19:55,471 info audit.auditloggermanager [org.apache.sqoop.audit.auditloggermanager.initialize(auditloggermanager.java:85)] audit logger manager initialized: ok 2014-11-13 08:19:55,472 info repository.repositorymanager [org.apache.sqoop.repository.repositorymanager.initialize(repositorymanager.java:80)] setting system properties: {derby.stream.error.file=/usr/loc 2014-11-13 08:19:55,478 info repository.jdbcrepositorycontext [org.apache.sqoop.repository.jdbcrepositorycontext.<init>(jdbcrepositorycontext.java:154)] [repo-ctx] handler=org.apache.sqoop.repository.derb 2014-11-13 08:19:55,683 info derby.derbyrepositoryhandler [org.apache.sqoop.repository.derby.derbyrepositoryhandler.initialize(derbyrepositoryhandler.java:207)] derbyrepositoryhandler initialized. 2014-11-13 08:19:55,686 info repository.jdbcrepositoryprovider [org.apache.sqoop.repository.jdbcrepositoryprovider.initializerepositoryhandler(jdbcrepositoryprovider.java:160)] jdbcrepositoryprovider init 2014-11-13 08:19:55,686 info repository.jdbcrepositoryprovider [org.apache.sqoop.repository.jdbcrepositoryprovider.initialize(jdbcrepositoryprovider.java:67)] jdbcrepository initialized. 2014-11-13 08:19:55,686 info repository.repositorymanager [org.apache.sqoop.repository.repositorymanager.initialize(repositorymanager.java:118)] creating or upgrading on disk structures if necessary 2014-11-13 08:19:56,022 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.begin(jdbcrepositorytransaction.java:73)] tx count-begin: 1, rollback: false 2014-11-13 08:19:56,022 info repository.jdbcrepository [org.apache.sqoop.repository.jdbcrepository$1.doit(jdbcrepository.java:130)] creating repository schema objects 2014-11-13 08:19:56,198 debug derby.derbyrepositoryhandler [org.apache.sqoop.repository.derby.derbyrepositoryhandler.detectversion(derbyrepositoryhandler.java:272)] detecting old version of repository 2014-11-13 08:19:56,354 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.commit(jdbcrepositorytransaction.java:84)] tx count-commit: 1, rollback: false 2014-11-13 08:19:56,354 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:103)] tx count-close: 0, rollback: false 2014-11-13 08:19:56,354 info repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:111)] attempting transaction commit 2014-11-13 08:19:56,360 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.begin(jdbcrepositorytransaction.java:73)] tx count-begin: 1, rollback: false 2014-11-13 08:19:56,375 debug derby.derbyrepositoryhandler [org.apache.sqoop.repository.derby.derbyrepositoryhandler.detectversion(derbyrepositoryhandler.java:272)] detecting old version of repository 2014-11-13 08:19:56,375 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.commit(jdbcrepositorytransaction.java:84)] tx count-commit: 1, rollback: false 2014-11-13 08:19:56,376 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:103)] tx count-close: 0, rollback: false 2014-11-13 08:19:56,376 info repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:111)] attempting transaction commit 2014-11-13 08:19:56,376 info repository.repositorymanager [org.apache.sqoop.repository.repositorymanager.initialize(repositorymanager.java:128)] repository initialized: ok 2014-11-13 08:19:56,377 info connector.connectormanager [org.apache.sqoop.connector.connectormanager.initialize(connectormanager.java:174)] connector config urls: [jar:file:/usr/local/sqoop-1.99.3-bin-had 2014-11-13 08:19:56,378 debug connector.connectorhandler [org.apache.sqoop.connector.connectorhandler.<init>(connectorhandler.java:58)] connector configuration: {org.apache.sqoop.connector.class=org.apache 2014-11-13 08:19:56,415 info connector.connectorhandler [org.apache.sqoop.connector.connectorhandler.<init>(connectorhandler.java:113)] connector [org.apache.sqoop.connector.jdbc.genericjdbcconnector] ini 2014-11-13 08:19:56,416 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.begin(jdbcrepositorytransaction.java:73)] tx count-begin: 1, rollback: false 2014-11-13 08:19:56,416 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.begin(jdbcrepositorytransaction.java:73)] tx count-begin: 2, rollback: false 2014-11-13 08:19:56,416 debug derby.derbyrepositoryhandler [org.apache.sqoop.repository.derby.derbyrepositoryhandler.findconnector(derbyrepositoryhandler.java:441)] looking connector: generic-jdbc-conne 2014-11-13 08:19:56,477 debug derby.derbyrepositoryhandler [org.apache.sqoop.repository.derby.derbyrepositoryhandler.findconnector(derbyrepositoryhandler.java:488)] looking connector: generic-jdbc-conne 2014-11-13 08:19:56,477 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.commit(jdbcrepositorytransaction.java:84)] tx count-commit: 2, rollback: false 2014-11-13 08:19:56,477 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:103)] tx count-close: 1, rollback: false 2014-11-13 08:19:56,478 debug connector.connectormanager [org.apache.sqoop.connector.connectormanager.registerconnectors(connectormanager.java:227)] registered connector: connector-generic-jdbc-connector:1 2014-11-13 08:19:56,478 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.commit(jdbcrepositorytransaction.java:84)] tx count-commit: 1, rollback: false 2014-11-13 08:19:56,478 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:103)] tx count-close: 0, rollback: false 2014-11-13 08:19:56,478 info repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:111)] attempting transaction commit 2014-11-13 08:19:56,478 info connector.connectormanager [org.apache.sqoop.connector.connectormanager.initialize(connectormanager.java:200)] connectors loaded: {generic-jdbc-connector={generic-jdbc-connect 2014-11-13 08:19:56,486 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.begin(jdbcrepositorytransaction.java:73)] tx count-begin: 1, rollback: false 2014-11-13 08:19:56,486 debug derby.derbyrepositoryhandler [org.apache.sqoop.repository.derby.derbyrepositoryhandler.findframework(derbyrepositoryhandler.java:537)] looking framework metadata 2014-11-13 08:19:56,503 debug derby.derbyrepositoryhandler [org.apache.sqoop.repository.derby.derbyrepositoryhandler.findframework(derbyrepositoryhandler.java:583)] looking framework metadta found: fram 2014-11-13 08:19:56,503 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.commit(jdbcrepositorytransaction.java:84)] tx count-commit: 1, rollback: false 2014-11-13 08:19:56,503 debug repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:103)] tx count-close: 0, rollback: false 2014-11-13 08:19:56,503 info repository.jdbcrepositorytransaction [org.apache.sqoop.repository.jdbcrepositorytransaction.close(jdbcrepositorytransaction.java:111)] attempting transaction commit 2014-11-13 08:19:56,504 info framework.frameworkmanager [org.apache.sqoop.framework.frameworkmanager.initialize(frameworkmanager.java:159)] submission manager initialized: ok 2014-11-13 08:19:56,507 info mapreduce.mapreducesubmissionengine [org.apache.sqoop.submission.mapreduce.mapreducesubmissionengine.initialize(mapreducesubmissionengine.java:75)] initializing map-reduce sub 2014-11-13 08:19:56,512 info core.sqoopserver [org.apache.sqoop.core.sqoopserver.destroy(sqoopserver.java:35)] shutting down sqoop server according last line in log file, sqoop server shutdown , doesn't start. googled every possible combination of error messages above , didn't find have helped. how can troubleshoot problem?
this common when hadoop libs can't found. there 2 things can do:
- install sqoop through apache big top or through 1 of hadoop distributors (ie cloudera)
- edit tomcat configuration include these jars (as you've tried above). log file giving specifics in terms of classes missing. can search missing jars via command line.
i highly recommend first option.
Comments
Post a Comment