Some problems with Recompile Druid<version 0.9.1.1> together with CDH 5.4.1

Hi there,

Druid version 0.9.1.1

I changed hadoop compile version to <hadoop.compile.version>2.6.0-cdh5.4.1</hadoop.compile.version> and I also downgrade <jackson.version>2.3.5</jackson.version>

After I complied Druid,I deployed , started bin/coordinator.sh start

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/home/druid-0.9.1/druid-0.9.1.1/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/home/druid-0.9.1/druid-0.9.1.1/lib/log4j-slf4j-impl-2.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

log4j:WARN No appenders could be found for logger (io.druid.guice.PropertiesModule).

log4j:WARN Please initialize the log4j system properly.

log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

2016-07-05T04:10:16,569 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class

2016-07-05T04:10:16,572 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class

2016-07-05T04:10:16,573 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.initialization.jetty.CustomExceptionMapper as a provider class

2016-07-05T04:10:16,573 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.StatusResource as a root resource class

2016-07-05T04:10:16,579 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version ‘Jersey: 1.19 02/11/2015 03:25 AM’

2016-07-05T04:10:16,756 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope “Singleton”

2016-07-05T04:10:16,761 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope “Singleton”

2016-07-05T04:10:16,777 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope “Singleton”

2016-07-05T04:10:17,590 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,620 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.CoordinatorResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,632 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.ConfigResourceFilter to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,642 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.CoordinatorDynamicConfigsResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,648 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.TiersResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,656 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.RulesResourceFilter to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,663 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.RulesResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,671 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.ServersResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,683 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.DatasourceResourceFilter to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,691 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.DatasourcesResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,702 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.MetadataResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,707 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.IntervalsResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,718 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.LookupCoordinatorResource to GuiceInstantiatedComponentProvider

2016-07-05T04:10:17,720 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope “Undefined”

Then the log stopped.

Could anyone helped me.

Thanks a lot!

Johnny

Hey Johnny,

Instead of downgrading Jackson, could you instead try setting “mapreduce.job.user.classpath.first”: “true” in your hadoop job properties? You can do this by adding it to the “jobProperties” of the “tuningConfig”. See here: http://druid.io/docs/latest/ingestion/batch-ingestion.html

Hi, Johnny, just to echo Gian, setting mapreduce.job.user.classpath.first to true with a similar setup to you worked for me. It did raise another issue, here’s the conversation so far: https://groups.google.com/forum/#!topic/druid-user/kZVNO0MgCs4
–T