Segments created through supervisor but indexing fails

Hi,

i am using supervisor for data ingestion from Kafka topics and i see segments and metrics created but the ingestion status shows as failed. I am not sure whats missing ?

2018-10-30T20:07:12,348 INFO [Thread-27] io.druid.cli.CliPeon - Running shutdown hook

2018-10-30T20:07:12,352 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.stop()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@1f736d00].

2018-10-30T20:07:12,352 INFO [Thread-27] io.druid.curator.announcement.Announcer - unannouncing [/druid/listeners/lookups/__default/localhost:8101]

2018-10-30T20:07:12,363 INFO [parent-monitor-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Triggering JVM shutdown.

2018-10-30T20:07:12,365 INFO [Thread-27] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Unannouncing start time on [/druid/listeners/lookups/__default/localhost:8101]

2018-10-30T20:07:12,367 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.query.lookup.LookupReferencesManager.stop()] on object[io.druid.query.lookup.LookupReferencesManager@52d3fafd].

2018-10-30T20:07:12,367 INFO [Thread-27] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopping.

2018-10-30T20:07:12,367 INFO [LookupReferencesManager-MainThread] io.druid.query.lookup.LookupReferencesManager - Lookup Management loop exited, Lookup notices are not handled anymore.

2018-10-30T20:07:12,367 INFO [Thread-27] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopped.

2018-10-30T20:07:12,371 INFO [Thread-27] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@131a7516{HTTP/1.1,[http/1.1]}{0.0.0.0:8101}

2018-10-30T20:07:12,372 INFO [Thread-27] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@23468512{/,null,UNAVAILABLE}

2018-10-30T20:07:12,375 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@2a39aa2b].

2018-10-30T20:07:12,376 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@567168a5].

2018-10-30T20:07:12,376 INFO [Thread-27] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_kafka_data-test-supervisor-test_d8dcb3d99fdc6b5_mcdmnpdb] status changed to [FAILED].

2018-10-30T20:07:12,376 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@542f6803].

2018-10-30T20:07:12,377 INFO [task-runner-0-priority-0] io.druid.segment.realtime.appenderator.AppenderatorDriver - Persisting data.

2018-10-30T20:07:12,379 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@5e5aafc6].

2018-10-30T20:07:12,380 INFO [Thread-27] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/localhost:8101]

2018-10-30T20:07:12,383 INFO [Thread-27] io.druid.curator.announcement.Announcer - unannouncing [/druid/segments/localhost:8101/localhost:8101_indexer-executor__default_tier_2018-10-30T19:42:17.582Z_66e3b3aa18934c4f8ed2c331e8cb0db00]

2018-10-30T20:07:12,389 INFO [task-runner-0-priority-0] io.druid.segment.realtime.appenderator.AppenderatorImpl - Submitting persist runnable for dataSource[data-test-supervisor-test]

2018-10-30T20:07:12,389 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.realtime.appenderator.AppenderatorImpl - Segment[data-test-supervisor-test_2018-10-30T02:00:00.000Z_2018-10-30T03:00:00.000Z_2018-10-30T19:00:00.766Z], persisting Hydrant[FireHydrant{index=io.druid.segment.incremental.OnheapIncrementalIndex@3933e4ad, queryable=data-test-supervisor-test_2018-10-30T02:00:00.000Z_2018-10-30T03:00:00.000Z_2018-10-30T19:00:00.766Z, ****=1}]

2018-10-30T20:07:12,389 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@40f35e52].

2018-10-30T20:07:12,390 INFO [Thread-27] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@794366a5].

2018-10-30T20:07:12,390 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMerger - Starting persist for interval[2018-10-30T02:00:00.000Z/2018-10-30T03:00:00.000Z], rows[12]

2018-10-30T20:07:12,390 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Start making v9 index files, outDir:/data/druid/tasks/work/index_kafka_data-test-supervisor-test_d8dcb3d99fdc6b5_mcdmnpdb/work/persist/data-test-supervisor-test_2018-10-30T02:00:00.000Z_2018-10-30T03:00:00.000Z_2018-10-30T19:00:00.766Z/1

2018-10-30T20:07:12,391 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed ****.bin in 1 millis.

2018-10-30T20:07:12,391 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed factory.json in 0 millis

2018-10-30T20:07:12,391 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[7] in 0 millis.

2018-10-30T20:07:12,392 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[2] in 1 millis.

2018-10-30T20:07:12,393 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 0 millis.

2018-10-30T20:07:12,393 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[3] in 0 millis.

2018-10-30T20:07:12,394 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 1 millis.

2018-10-30T20:07:12,394 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[12] in 0 millis.

2018-10-30T20:07:12,395 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[11] in 0 millis.

2018-10-30T20:07:12,396 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 1 millis.

2018-10-30T20:07:12,396 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 0 millis.

2018-10-30T20:07:12,397 INFO [task-runner-0-priority-0] io.druid.segment.realtime.appenderator.AppenderatorImpl - Shutting down…

2018-10-30T20:07:12,397 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 0 millis.

2018-10-30T20:07:12,397 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed dim conversions in 6 millis.

2018-10-30T20:07:12,400 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - completed walk through of 12 rows in 1 millis.

2018-10-30T20:07:12,401 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed time column in 1 millis.

2018-10-30T20:07:12,401 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed metric column[****] in 0 millis.

2018-10-30T20:07:12,402 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed metric column[****] in 1 millis.

2018-10-30T20:07:12,402 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed metric column[****] in 0 millis.

2018-10-30T20:07:12,403 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed metric column[****] in 1 millis.

2018-10-30T20:07:12,403 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed metric column[****] in 0 millis.

2018-10-30T20:07:12,403 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed metric column[****] in 0 millis.

2018-10-30T20:07:12,404 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed metric column[****] in 1 millis.

2018-10-30T20:07:12,404 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed metric columns in 3 millis.

2018-10-30T20:07:12,404 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[7] in 0 millis.

2018-10-30T20:07:12,405 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[2] in 0 millis.

2018-10-30T20:07:12,407 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[1] in 1 millis.

2018-10-30T20:07:12,408 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[3] in 1 millis.

2018-10-30T20:07:12,409 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[1] in 0 millis.

2018-10-30T20:07:12,410 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[12] in 0 millis.

2018-10-30T20:07:12,411 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[11] in 0 millis.

2018-10-30T20:07:12,412 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[1] in 0 millis.

2018-10-30T20:07:12,414 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[1] in 1 millis.

2018-10-30T20:07:12,415 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] inverted with cardinality[1] in 1 millis.

2018-10-30T20:07:12,416 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed index.drd in 1 millis.

2018-10-30T20:07:12,416 INFO [data-test-supervisor-test-incremental-persist] io.druid.java.util.common.io.smoosh.FileSmoosher - Created smoosh file [/data/druid/tasks/work/data-box-test-supervisor-test_d8dcb3d99fdc6b5_mcdmnpdb/work/persist/data-test-supervisor-test_2018-10-30T02:00:00.000Z_2018-10-30T03:00:00.000Z_2018-10-30T19:00:00.766Z/1/00000.smoosh] of size [10351] bytes.

2018-10-30T20:07:12,420 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.ReferenceCountingSegment - Closing data-test-supervisor-test_2018-10-30T02:00:00.000Z_2018-10-30T03:00:00.000Z_2018-10-30T19:00:00.766Z

2018-10-30T20:07:12,421 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.ReferenceCountingSegment - Closing data-test-supervisor-test_2018-10-30T02:00:00.000Z_2018-10-30T03:00:00.000Z_2018-10-30T19:00:00.766Z, numReferences: 0

2018-10-30T20:07:12,421 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.realtime.appenderator.AppenderatorImpl - Segment[data-test-supervisor-test_2018-10-30T07:00:00.000Z_2018-10-30T08:00:00.000Z_2018-10-30T19:00:00.901Z], persisting Hydrant[FireHydrant{index=io.druid.segment.incremental.OnheapIncrementalIndex@dfd92f6, queryable=data-test-supervisor-test_2018-10-30T07:00:00.000Z_2018-10-30T08:00:00.000Z_2018-10-30T19:00:00.901Z, ****=1}]

2018-10-30T20:07:12,421 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMerger - Starting persist for interval[2018-10-30T07:00:00.000Z/2018-10-30T08:00:00.000Z], rows[3]

2018-10-30T20:07:12,422 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Start making v9 index files, outDir:/data/druid/tasks/work/data-box-test-supervisor-test_d8dcb3d99fdc6b5_mcdmnpdb/work/persist/data-test-supervisor-test_2018-10-30T07:00:00.000Z_2018-10-30T08:00:00.000Z_2018-10-30T19:00:00.901Z/1

2018-10-30T20:07:12,422 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@1b2df3aa].

2018-10-30T20:07:12,422 INFO [Thread-27] io.druid.curator.CuratorModule - Stopping Curator

2018-10-30T20:07:12,422 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed ****.bin in 0 millis.

2018-10-30T20:07:12,422 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.IndexMergerV9 - Completed factory.json in 0 millis

2018-10-30T20:07:12,422 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[2] in 0 millis.

2018-10-30T20:07:12,423 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting

2018-10-30T20:07:12,427 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 1 millis.

2018-10-30T20:07:12,427 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 0 millis.

2018-10-30T20:07:12,428 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 0 millis.

2018-10-30T20:07:12,428 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 0 millis.

2018-10-30T20:07:12,429 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[3] in 0 millis.

2018-10-30T20:07:12,429 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[3] in 0 millis.

2018-10-30T20:07:12,430 INFO [Thread-27] org.apache.zookeeper.ZooKeeper - Session: 0x3645e016f1c075a closed

2018-10-30T20:07:12,430 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 0 millis.

2018-10-30T20:07:12,430 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@75e09567].

2018-10-30T20:07:12,430 INFO [Thread-27] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@5634a861].

2018-10-30T20:07:12,430 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x3645e016f1c075a

2018-10-30T20:07:12,440 INFO [data-test-supervisor-test-incremental-persist] io.druid.segment.StringDimensionMergerV9 - Completed dim[****] conversions with cardinality[1] in 0 millis.