Indexing issue with 0.9.1.1 & HDP

Hello Druid Gurus,

We use Druid 0.9.1.1 for our production cluster. We had our hadoop cluster upgraded to 2.5.3.58-3 recently. After the necessary config changes, we are facing issues with the data ingestion. We always assembled our own FAT jar to avoid Jackson Jar issues.

Attached is the index logs, overlord logs and also the index specs. Below is the error snippet.

2017-05-24T16:51:58,795 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@19ed6877]

2017-05-24T16:51:58,796 ERROR [main] io.druid.cli.CliPeon - Error when starting up. Failing.

com.google.inject.ProvisionException: Guice provision errors:

  1. druid.announcer. – Injected field[batchAnnouncer] not bound!? - may not be null

at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:131)

at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:131)

while locating com.google.common.base.Supplier<io.druid.server.coordination.DataSegmentAnnouncerProvider>

at io.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:132)

while locating io.druid.server.coordination.DataSegmentAnnouncerProvider

while locating io.druid.server.coordination.DataSegmentAnnouncer

for parameter 7 at io.druid.indexing.common.TaskToolboxFactory.(TaskToolboxFactory.java:95)

at io.druid.cli.CliPeon$1.configure(CliPeon.java:153)

while locating io.druid.indexing.common.TaskToolboxFactory

for parameter 0 at io.druid.indexing.overlord.ThreadPoolTaskRunner.(ThreadPoolTaskRunner.java:96)

at io.druid.cli.CliPeon$1.configure(CliPeon.java:180)

while locating io.druid.indexing.overlord.ThreadPoolTaskRunner

while locating io.druid.indexing.overlord.TaskRunner

for parameter 3 at io.druid.indexing.worker.executor.ExecutorLifecycle.(ExecutorLifecycle.java:78)

at io.druid.cli.CliPeon$1.configure(CliPeon.java:170)

while locating io.druid.indexing.worker.executor.ExecutorLifecycle

1 error

at com.google.inject.internal.InjectorImpl$3.get(InjectorImpl.java:1014) ~[druid_build-assembly-0.2-SNAPSHOT.jar:0.1-SNAPSHOT]

at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1036) ~[druid_build-assembly-0.2-SNAPSHOT.jar:0.1-SNAPSHOT]

at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:153) ~[druid_build-assembly-0.2-SNAPSHOT.jar:0.1-SNAPSHOT]

at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:91) [druid_build-assembly-0.2-SNAPSHOT.jar:0.1-SNAPSHOT]

at io.druid.cli.CliPeon.run(CliPeon.java:274) [druid_build-assembly-0.2-SNAPSHOT.jar:0.1-SNAPSHOT]

at io.druid.cli.Main.main(Main.java:105) [druid_build-assembly-0.2-SNAPSHOT.jar:0.1-SNAPSHOT]

Thanks,

Kasi.

audience_insights_visitor_count.json (1.71 KB)

index_hadoop.log (28.2 KB)

overlord.log (67.7 KB)