HadoopDruidIndexer (Druid 0.7.0) issue with Hadoop 2.5.0 (CDH 5.3.2)

I’m trying to run Druid 0.7.0 HadoopDruidIndexer against CDH 5.3.2

I added the following line to the test spec (index_task.json)

“hadoopDependencyCoordinates”: [“org.apache.hadoop:hadoop-client:2.5.0-cdh5.3.2”]

And ran indexer with the following command line :

hadoop_classpath=hadoop classpath

druid_classpath="/usr/local/druid/lib/*:/home/produser/indexer/conf"

java -Xmx256m -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Ddruid.metadata.storage.type=mysql -classpath {druid_classpath}:{hadoop_classpath} io.druid.cli.Main index hadoop index_task.json

And here is the stdout on the console I ran this (errors in red) :

WARN [org.apache.hadoop.util.NativeCodeLoader] Unable to load native-hadoop library for your platform… using builtin-java classes where applicable

2015-03-13T22:59:11,763 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-pool-1.6.jar]

2015-03-13T22:59:12,065 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/maven-aether-provider-3.1.1.jar]

2015-03-13T22:59:12,092 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/airline-0.6.jar]

2015-03-13T22:59:12,117 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/maven-model-3.1.1.jar]

2015-03-13T22:59:12,143 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aether-util-0.9.0.M2.jar]

2015-03-13T22:59:12,207 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/asm-3.1.jar]

2015-03-13T22:59:12,231 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-jaxrs-smile-provider-2.4.4.jar]

2015-03-13T22:59:12,255 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/guava-16.0.1.jar]

2015-03-13T22:59:12,320 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/rhino-1.7R4.jar]

2015-03-13T22:59:12,368 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-codec-1.7.jar]

2015-03-13T22:59:12,400 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/joda-time-2.6.jar]

2015-03-13T22:59:12,473 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aether-connector-file-0.9.0.M2.jar]

2015-03-13T22:59:12,497 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/log4j-api-2.1.jar]

2015-03-13T22:59:12,564 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/httpcore-4.2.jar]

2015-03-13T22:59:12,591 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-server-1.17.1.jar]

2015-03-13T22:59:12,622 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jline-0.9.94.jar]

2015-03-13T22:59:12,645 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-jaxrs-json-provider-2.4.4.jar]

2015-03-13T22:59:12,668 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-continuation-9.2.5.v20141112.jar]

2015-03-13T22:59:12,687 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-databind-2.4.4.jar]

2015-03-13T22:59:12,733 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/guice-servlet-4.0-beta.jar]

2015-03-13T22:59:12,796 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aether-impl-0.9.0.M2.jar]

2015-03-13T22:59:12,825 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-logging-1.1.1.jar]

2015-03-13T22:59:12,845 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-annotations-2.4.4.jar]

2015-03-13T22:59:12,868 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/org.abego.treelayout.core-1.0.1.jar]

2015-03-13T22:59:12,888 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-core-asl-1.9.12.jar]

2015-03-13T22:59:12,918 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-datatype-joda-2.4.4.jar]

2015-03-13T22:59:12,939 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/classmate-1.0.0.jar]

2015-03-13T22:59:12,987 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-security-9.2.5.v20141112.jar]

2015-03-13T22:59:13,053 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/plexus-utils-3.0.15.jar]

2015-03-13T22:59:13,083 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/emitter-0.3.0.jar]

2015-03-13T22:59:13,104 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-server-0.7.0.jar]

2015-03-13T22:59:13,154 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/log4j-1.2.16.jar]

2015-03-13T22:59:13,189 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-io-2.0.1.jar]

2015-03-13T22:59:13,216 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-api-0.3.4.jar]

2015-03-13T22:59:13,278 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/tesla-aether-0.0.5.jar]

2015-03-13T22:59:13,304 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aether-connector-okhttp-0.0.9.jar]

2015-03-13T22:59:13,323 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-core-2.4.4.jar]

2015-03-13T22:59:13,350 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/javax.el-api-3.0.0.jar]

2015-03-13T22:59:13,411 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aopalliance-1.0.jar]

2015-03-13T22:59:13,434 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-client-9.2.5.v20141112.jar]

2015-03-13T22:59:13,458 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/lz4-1.3.0.jar]

2015-03-13T22:59:13,480 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/java-util-0.26.14.jar]

2015-03-13T22:59:13,509 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/compress-lzf-1.0.3.jar]

2015-03-13T22:59:13,531 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/google-http-client-jackson2-1.15.0-rc.jar]

2015-03-13T22:59:13,547 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/netty-3.9.5.Final.jar]

2015-03-13T22:59:13,633 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jboss-logging-3.1.3.GA.jar]

2015-03-13T22:59:13,655 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-indexing-hadoop-0.7.0.jar]

2015-03-13T22:59:13,682 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-mapper-asl-1.9.13.jar]

2015-03-13T22:59:13,721 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/javax.inject-1.jar]

2015-03-13T22:59:13,743 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/RoaringBitmap-0.4.5.jar]

2015-03-13T22:59:13,765 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-module-jaxb-annotations-2.4.4.jar]

2015-03-13T22:59:13,787 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aws-java-sdk-core-1.8.11.jar]

2015-03-13T22:59:13,862 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-proxy-9.2.5.v20141112.jar]

2015-03-13T22:59:13,890 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/mapdb-1.0.6.jar]

2015-03-13T22:59:13,917 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-aws-common-0.7.0.jar]

2015-03-13T22:59:13,938 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/spymemcached-2.11.4.jar]

2015-03-13T22:59:13,974 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/maven-repository-metadata-3.1.1.jar]

2015-03-13T22:59:13,996 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/google-http-client-1.15.0-rc.jar]

2015-03-13T22:59:14,028 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/config-magic-0.9.jar]

2015-03-13T22:59:14,055 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/protobuf-java-2.5.0.jar]

2015-03-13T22:59:14,088 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/okhttp-1.0.2.jar]

2015-03-13T22:59:14,116 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-cli-1.2.jar]

2015-03-13T22:59:14,137 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-server-9.2.5.v20141112.jar]

2015-03-13T22:59:14,170 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-util-9.2.5.v20141112.jar]

2015-03-13T22:59:14,195 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/guice-multibindings-4.0-beta.jar]

2015-03-13T22:59:14,220 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-pool2-2.2.jar]

2015-03-13T22:59:14,248 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aether-api-0.9.0.M2.jar]

2015-03-13T22:59:14,312 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/zookeeper-3.4.6.jar]

2015-03-13T22:59:14,393 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/derbyclient-10.11.1.1.jar]

2015-03-13T22:59:14,422 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/bytebuffer-collections-0.1.5.jar]

2015-03-13T22:59:14,489 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/slf4j-api-1.6.4.jar]

2015-03-13T22:59:14,511 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/derby-10.11.1.1.jar]

2015-03-13T22:59:14,578 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-servlet-1.17.1.jar]

2015-03-13T22:59:14,608 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/curator-framework-2.7.0.jar]

2015-03-13T22:59:14,631 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/guice-4.0-beta.jar]

2015-03-13T22:59:14,691 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-dataformat-smile-2.4.4.jar]

2015-03-13T22:59:14,755 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-dbcp2-2.0.1.jar]

2015-03-13T22:59:14,782 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/plexus-interpolation-1.19.jar]

2015-03-13T22:59:14,804 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-http-9.2.5.v20141112.jar]

2015-03-13T22:59:14,833 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/javax.servlet-api-3.1.0.jar]

2015-03-13T22:59:14,856 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/java-xmlbuilder-0.4.jar]

2015-03-13T22:59:14,878 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/javax.el-3.0.0.jar]

2015-03-13T22:59:14,907 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/curator-client-2.7.0.jar]

2015-03-13T22:59:14,966 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/server-metrics-0.1.0.jar]

2015-03-13T22:59:14,997 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-servlet-9.2.5.v20141112.jar]

2015-03-13T22:59:15,025 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/xpp3-1.1.4c.jar]

2015-03-13T22:59:15,047 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-processing-0.7.0.jar]

2015-03-13T22:59:15,089 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-common-0.7.0.jar]

2015-03-13T22:59:15,154 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jdbi-2.32.jar]

2015-03-13T22:59:15,189 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-lang-2.6.jar]

2015-03-13T22:59:15,220 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/irc-api-1.0-0011.jar]

2015-03-13T22:59:15,249 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/geoip2-0.4.0.jar]

2015-03-13T22:59:15,270 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/bcprov-jdk15-1.46.jar]

2015-03-13T22:59:15,326 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/opencsv-2.3.jar]

2015-03-13T22:59:15,351 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/mail-1.4.7.jar]

2015-03-13T22:59:15,381 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aws-java-sdk-1.8.11.jar]

2015-03-13T22:59:15,586 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-services-0.7.0.jar]

2015-03-13T22:59:15,652 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/maxminddb-0.2.0.jar]

2015-03-13T22:59:15,679 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-guice-1.17.1.jar]

2015-03-13T22:59:15,705 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-indexing-service-0.7.0.jar]

2015-03-13T22:59:15,740 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-datatype-guava-2.4.4.jar]

2015-03-13T22:59:15,764 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/maven-settings-3.1.1.jar]

2015-03-13T22:59:15,789 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/disruptor-3.3.0.jar]

2015-03-13T22:59:15,855 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/validation-api-1.1.0.Final.jar]

2015-03-13T22:59:15,881 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/antlr4-runtime-4.0.jar]

2015-03-13T22:59:15,908 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/icu4j-4.8.1.jar]

2015-03-13T22:59:16,021 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-jaxrs-base-2.4.4.jar]

2015-03-13T22:59:16,046 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jets3t-0.9.1.jar]

2015-03-13T22:59:16,107 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/derbynet-10.11.1.1.jar]

2015-03-13T22:59:16,176 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/log4j-core-2.1.jar]

2015-03-13T22:59:16,212 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/wagon-provider-api-2.4.jar]

2015-03-13T22:59:16,239 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/mx4j-3.0.2.jar]

2015-03-13T22:59:16,341 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hibernate-validator-5.1.3.Final.jar]

2015-03-13T22:59:16,373 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/http-client-1.0.0.jar]

2015-03-13T22:59:16,402 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jsr305-2.0.1.jar]

2015-03-13T22:59:16,421 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/activation-1.1.1.jar]

2015-03-13T22:59:16,483 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-servlets-9.2.5.v20141112.jar]

2015-03-13T22:59:16,507 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/extendedset-1.3.8.jar]

2015-03-13T22:59:16,536 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/maven-settings-builder-3.1.1.jar]

2015-03-13T22:59:16,554 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/curator-x-discovery-2.7.0.jar]

2015-03-13T22:59:16,574 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-io-9.2.5.v20141112.jar]

2015-03-13T22:59:16,596 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aether-spi-0.9.0.M2.jar]

2015-03-13T22:59:16,621 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/curator-recipes-2.7.0.jar]

2015-03-13T22:59:16,652 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/httpclient-4.2.jar]

2015-03-13T22:59:16,681 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-core-1.17.1.jar]

2015-03-13T22:59:16,717 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/maven-model-builder-3.1.1.jar]

2015-03-13T22:59:16,746 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/log4j-slf4j-impl-2.1.jar]

2015-03-13T22:59:16,770 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-logging-1.1.3.jar]

2015-03-13T22:59:16,797 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-json-1.9.jar]

2015-03-13T22:59:16,865 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/xz-1.0.jar]

2015-03-13T22:59:16,891 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hamcrest-core-1.3.jar]

2015-03-13T22:59:16,911 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-compress-1.4.1.jar]

2015-03-13T22:59:16,940 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jaxb-impl-2.2.3-1.jar]

2015-03-13T22:59:16,978 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/aws-java-sdk-1.7.4.jar]

2015-03-13T22:59:17,176 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jets3t-0.9.0.jar]

2015-03-13T22:59:17,209 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/junit-4.11.jar]

2015-03-13T22:59:17,239 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-net-3.1.jar]

2015-03-13T22:59:17,264 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-xc-1.8.8.jar]

2015-03-13T22:59:17,288 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-configuration-1.6.jar]

2015-03-13T22:59:17,318 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/api-asn1-api-1.0.0-M20.jar]

2015-03-13T22:59:17,337 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/netty-3.6.2.Final.jar]

2015-03-13T22:59:17,386 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/paranamer-2.3.jar]

2015-03-13T22:59:17,410 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jettison-1.1.jar]

2015-03-13T22:59:17,472 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/snappy-java-1.0.4.1.jar]

2015-03-13T22:59:17,508 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jasper-compiler-5.5.23.jar]

2015-03-13T22:59:17,533 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-util-6.1.26.cloudera.4.jar]

2015-03-13T22:59:17,557 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/curator-client-2.6.0.jar]

2015-03-13T22:59:17,621 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/slf4j-api-1.7.5.jar]

2015-03-13T22:59:17,646 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/mockito-all-1.8.5.jar]

2015-03-13T22:59:17,699 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-jaxrs-1.8.8.jar]

2015-03-13T22:59:17,719 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-6.1.26.cloudera.4.jar]

2015-03-13T22:59:17,754 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/servlet-api-2.5.jar]

2015-03-13T22:59:17,776 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jaxb-api-2.2.2.jar]

2015-03-13T22:59:17,800 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jsr305-1.3.9.jar]

2015-03-13T22:59:17,820 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/api-util-1.0.0-M20.jar]

2015-03-13T22:59:17,845 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jsp-api-2.1.jar]

2015-03-13T22:59:17,909 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-math3-3.1.1.jar]

2015-03-13T22:59:17,952 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/slf4j-log4j12-1.7.5.jar]

2015-03-13T22:59:17,975 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-core-1.9.jar]

2015-03-13T22:59:18,006 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-el-1.0.jar]

2015-03-13T22:59:18,033 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/httpcore-4.2.5.jar]

2015-03-13T22:59:18,057 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-digester-1.8.jar]

2015-03-13T22:59:18,080 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/activation-1.1.jar]

2015-03-13T22:59:18,107 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/log4j-1.2.17.jar]

2015-03-13T22:59:18,139 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/apacheds-kerberos-codec-2.0.0-M15.jar]

2015-03-13T22:59:18,173 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/avro-1.7.6-cdh5.3.2.jar]

2015-03-13T22:59:18,205 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/guava-11.0.2.jar]

2015-03-13T22:59:18,254 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-codec-1.4.jar]

2015-03-13T22:59:18,278 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/curator-recipes-2.6.0.jar]

2015-03-13T22:59:18,310 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/apacheds-i18n-2.0.0-M15.jar]

2015-03-13T22:59:18,330 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/zookeeper-3.4.5-cdh5.3.2.jar]

2015-03-13T22:59:18,376 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-io-2.4.jar]

2015-03-13T22:59:18,401 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hue-plugins-3.7.0-cdh5.3.2.jar]

2015-03-13T22:59:18,458 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jasper-runtime-5.5.23.jar]

2015-03-13T22:59:18,482 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/gson-2.2.4.jar]

2015-03-13T22:59:18,509 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/asm-3.2.jar]

2015-03-13T22:59:18,527 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-beanutils-core-1.8.0.jar]

2015-03-13T22:59:18,589 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/stax-api-1.0-2.jar]

2015-03-13T22:59:18,611 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/curator-framework-2.6.0.jar]

2015-03-13T22:59:18,640 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-server-1.9.jar]

2015-03-13T22:59:18,675 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-mapper-asl-1.8.8.jar]

2015-03-13T22:59:18,712 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-httpclient-3.1.jar]

2015-03-13T22:59:18,744 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-collections-3.2.1.jar]

2015-03-13T22:59:18,788 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jsch-0.1.42.jar]

2015-03-13T22:59:18,815 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-core-asl-1.8.8.jar]

2015-03-13T22:59:18,843 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/httpclient-4.2.5.jar]

2015-03-13T22:59:18,884 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/xmlenc-0.52.jar]

2015-03-13T22:59:18,903 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-beanutils-1.7.0.jar]

2015-03-13T22:59:18,931 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-common-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,006 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-auth-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,071 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-generator-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,095 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-encoding-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,126 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-column-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,161 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-aws-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,390 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-nfs-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,418 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-scrooge_2.10-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,439 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-annotations-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,463 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-pig-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,497 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-common-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,515 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-hadoop-bundle-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,581 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-cascading-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,603 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-format-2.1.0-cdh5.3.2-sources.jar]

2015-03-13T22:59:19,626 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-jackson-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,666 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-pig-bundle-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,731 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-scala_2.10-1.5.0-cdh5.4.0-SNAPSHOT.jar]

2015-03-13T22:59:19,753 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-test-hadoop2-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,776 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-common-2.5.0-cdh5.3.2-tests.jar]

2015-03-13T22:59:19,825 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-format-2.1.0-cdh5.3.2.jar]

2015-03-13T22:59:19,852 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-tools-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,874 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-thrift-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,902 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-hadoop-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,924 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-avro-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,943 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-protobuf-1.5.0-cdh5.3.2.jar]

2015-03-13T22:59:19,963 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/parquet-format-2.1.0-cdh5.3.2-javadoc.jar]

2015-03-13T22:59:19,996 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/commons-daemon-1.0.13.jar]

2015-03-13T22:59:20,021 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-hdfs-2.5.0-cdh5.3.2-tests.jar]

2015-03-13T22:59:20,085 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-hdfs-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,207 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-hdfs-nfs-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,233 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-client-1.9.jar]

2015-03-13T22:59:20,301 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/guice-3.0.jar]

2015-03-13T22:59:20,339 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jersey-guice-1.9.jar]

2015-03-13T22:59:20,393 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/guice-servlet-3.0.jar]

2015-03-13T22:59:20,425 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/leveldbjni-all-1.8.jar]

2015-03-13T22:59:20,463 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-common-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,553 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-server-nodemanager-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,591 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-client-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,653 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-applications-distributedshell-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,680 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-api-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,733 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-server-web-proxy-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,763 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-server-applicationhistoryservice-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,797 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-server-resourcemanager-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,832 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-server-common-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,900 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-applications-unmanaged-am-launcher-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,921 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-server-tests-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,965 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-streaming-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:20,989 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-azure-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,019 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.2-tests.jar]

2015-03-13T22:59:21,063 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-app-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,090 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-extras-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,156 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-sls-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,186 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-common-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,218 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-core-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,279 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-hs-plugins-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,297 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-nativetask-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,324 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-archives-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,345 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-databind-2.2.3.jar]

2015-03-13T22:59:21,404 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-distcp-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,435 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-gridmix-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,460 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-rumen-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,487 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/microsoft-windowsazure-storage-sdk-0.6.0.jar]

2015-03-13T22:59:21,548 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-hs-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,576 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-examples-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,600 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-datajoin-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,633 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-shuffle-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,659 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.2.jar]

2015-03-13T22:59:21,678 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-core-2.2.3.jar]

2015-03-13T22:59:21,712 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/metrics-core-3.0.1.jar]

2015-03-13T22:59:21,742 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-annotations-2.2.3.jar]

2015-03-13T22:59:21,778 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/druid-hdfs-storage-0.7.0.jar]

2015-03-13T22:59:21,805 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jackson-mapper-asl-1.9.12.jar]

2015-03-13T22:59:21,889 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-client-2.3.0.jar]

2015-03-13T22:59:21,905 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-common-2.3.0.jar]

2015-03-13T22:59:21,987 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/avro-1.7.4.jar]

2015-03-13T22:59:22,049 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-auth-2.3.0.jar]

2015-03-13T22:59:22,072 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/zookeeper-3.4.5.jar]

2015-03-13T22:59:22,113 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-hdfs-2.3.0.jar]

2015-03-13T22:59:22,222 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/jetty-util-6.1.26.jar]

2015-03-13T22:59:22,249 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-app-2.3.0.jar]

2015-03-13T22:59:22,287 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-common-2.3.0.jar]

2015-03-13T22:59:22,366 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-client-2.3.0.jar]

2015-03-13T22:59:22,431 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-server-common-2.3.0.jar]

2015-03-13T22:59:22,462 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-shuffle-2.3.0.jar]

2015-03-13T22:59:22,481 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-api-2.3.0.jar]

2015-03-13T22:59:22,527 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-core-2.3.0.jar]

2015-03-13T22:59:22,570 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-yarn-common-2.3.0.jar]

2015-03-13T22:59:22,622 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-mapreduce-client-jobclient-2.3.0.jar]

2015-03-13T22:59:22,642 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/hadoop-annotations-2.3.0.jar]

2015-03-13T22:59:22,668 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/mysql-metadata-storage-0.7.0.jar]

2015-03-13T22:59:22,683 INFO [main] io.druid.indexer.JobHelper - Uploading jar to path[/tmp/druid-tmp/classpath/mysql-connector-java-5.1.33.jar]

2015-03-13T22:59:22,724 INFO [main] io.druid.indexer.path.StaticPathSpec - Adding paths[/tmp/druid/data/mmx/dt=2015-03-11-19/000002_0.gz]

WARN [org.apache.hadoop.mapreduce.JobSubmitter] Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.

WARN [org.apache.hadoop.mapreduce.JobSubmitter] No job jar file set. User classes may not be found. See Job or Job#setJar(String).

2015-03-13T22:59:25,605 INFO [main] io.druid.indexer.DeterminePartitionsJob - Job druid_test-determine_partitions_groupby-Optional.of([2015-03-11T00:00:00.000Z/2015-03-12T00:00:00.000Z]) submitted, status available at:

Error: class com.fasterxml.jackson.datatype.guava.deser.HostAndPortDeserializer overrides final method deserialize.(Lcom/fasterxml/jackson/core/JsonParser;Lcom/fasterxml/jackson/databind/DeserializationContext;)Ljava/lang/Object;

Error: class com.fasterxml.jackson.datatype.guava.deser.HostAndPortDeserializer overrides final method deserialize.(Lcom/fasterxml/jackson/core/JsonParser;Lcom/fasterxml/jackson/databind/DeserializationContext;)Ljava/lang/Object;

Error: class com.fasterxml.jackson.datatype.guava.deser.HostAndPortDeserializer overrides final method deserialize.(Lcom/fasterxml/jackson/core/JsonParser;Lcom/fasterxml/jackson/databind/DeserializationContext;)Ljava/lang/Object;

2015-03-13T23:00:16,328 ERROR [main] io.druid.indexer.DeterminePartitionsJob - Job failed: job_1425953620938_0009

2015-03-13T23:00:16,328 INFO [main] io.druid.indexer.JobHelper - Deleting path[/tmp/druid-tmp/druid_test/2015-03-13T225910.054Z]

2015-03-13T23:00:16,360 ERROR [main] io.druid.cli.CliHadoopIndexer - failure!!!

java.lang.reflect.InvocationTargetException

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_51]

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_51]

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_51]

at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_51]

at io.druid.cli.CliHadoopIndexer.run(CliHadoopIndexer.java:120) [druid-services-0.7.0.jar:0.7.0]

at io.druid.cli.Main.main(Main.java:88) [druid-services-0.7.0.jar:0.7.0]

Caused by: com.metamx.common.ISE: Job[class io.druid.indexer.DeterminePartitionsJob] failed!

at io.druid.indexer.JobHelper.runJobs(JobHelper.java:153) ~[druid-indexing-hadoop-0.7.0.jar:0.7.0]

at io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:84) ~[druid-indexing-hadoop-0.7.0.jar:0.7.0]

at io.druid.indexer.JobHelper.runJobs(JobHelper.java:133) ~[druid-indexing-hadoop-0.7.0.jar:0.7.0]

at io.druid.cli.CliInternalHadoopIndexer.run(CliInternalHadoopIndexer.java:104) ~[druid-services-0.7.0.jar:0.7.0]

at io.druid.cli.Main.main(Main.java:88) ~[druid-services-0.7.0.jar:0.7.0]

… 6 more

So it seems there are some dependency conflict with druid and CDH hadoop. Is there anybody who’s been through this and got it working? or can anybody suggest where I should dig in to resolve this?

Thanks,

Jaebin

Hi Jaebin,

A couple of people ran into a similar problem trying to get things running on EMR and from the looks of things, did find a solution. There may be something in this thread that can help you: https://groups.google.com/forum/#!topic/druid-development/jNxhMZpp-rc

This particular one looks like a conflict in jackson versions.
com.fasterxml.jackson.databind.deser.std.FromStringDeserializer#deserialize

``

hasn’t been final in many versions compared to the most recent, so I suspect CDH might be pulling in old jackson somewhere?

Hi Gian,
Thanks for quickly pointing the previous post with similar problem.
Yeah it seems they had same problem in that thread with jackson jar. Let me try out what was suggested there and update the result later.

Thanks!

Jaebin

As Nick explained in https://groups.google.com/d/msg/druid-development/jNxhMZpp-rc/XwAFP2xYe60J,
The jackson version Druid 0.7.0 is using (2.4.4) has backward compatibility issue with the one that is included by Hadoop 2.5.0 (CDH 5.3.2), which is jackson 2.2.3.

So I just recompiled Druid 0.7.0 with jackson version 2.2.3 and it worked fine.

Thanks a lot for your help, Gian.

Jaebin