Getting Error While Segment Creation : KAFKA Indexing Service

PFB the exception - Please let us know if you need any further details.

We are able to push data via kafka indexing service but it fails while creating segment out of the data. Yes the data is too huge but not sure how to resolve it.

2017-02-09T12:20:02,294 INFO [appenderator_merge_0]
io.druid.segment.IndexMerger -
outDir[var/druid/task/index_kafka_yukonSEGMENT_df94b1d26a6b0d7_eafaeflh/work/persist/yukonSEGMENT_2017-02-07T12:00:00.000Z_2017-02-07T12:15:00.000Z_2017-02-09T07:16:45.273Z_7/merged/v8-tmp]
completed index.drd in 0 millis.

2017-02-09T12:20:03,536 INFO [appenderator_merge_0]
io.druid.segment.StringDimensionMergerV9 - Completed dim[SUBELEMENT_ID]
conversions with cardinality[1,475,236] in 1,242 millis.

2017-02-09T12:20:20,563 INFO [appenderator_merge_0]
io.druid.segment.StringDimensionMergerV9 - Completed dim[PMP_HLOG_US]
conversions with cardinality[1,427,796] in 16,987 millis.

2017-02-09T12:20:21,051 WARN [appenderator_merge_0]
io.druid.segment.realtime.appenderator.AppenderatorImpl - Failed to push merged
index for
segment[yukonSEGMENT_2017-02-07T12:00:00.000Z_2017-02-07T12:15:00.000Z_2017-02-09T07:16:45.273Z_7].

java.lang.IllegalStateException: Wrote[2935546528] bytes,
which is too many.

at com.google.common.base.Preconditions.checkState(Preconditions.java:200)
~[guava-16.0.1.jar:?]

at
io.druid.segment.data.GenericIndexedWriter.close(GenericIndexedWriter.java:110)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.StringDimensionMergerV9.writeMergedValueMetadata(StringDimensionMergerV9.java:198)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.IndexMerger.makeIndexFiles(IndexMerger.java:693)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.IndexMerger.merge(IndexMerger.java:438)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.IndexMerger.mergeQueryableIndex(IndexMerger.java:242)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.IndexMerger.mergeQueryableIndex(IndexMerger.java:214)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:561)
[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.realtime.appenderator.AppenderatorImpl.access$600(AppenderatorImpl.java:93)
[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.realtime.appenderator.AppenderatorImpl$3.apply(AppenderatorImpl.java:467)
[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.realtime.appenderator.AppenderatorImpl$3.apply(AppenderatorImpl.java:455)
[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
[guava-16.0.1.jar:?]

at
com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
[guava-16.0.1.jar:?]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[?:1.8.0_91]

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[?:1.8.0_91]

at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]

2017-02-09T12:20:21,052 WARN [task-runner-0-priority-0]
io.druid.segment.realtime.appenderator.FiniteAppenderatorDriver - Failed
publishAll (try 25), retrying in 68,478ms.

java.util.concurrent.ExecutionException:
java.lang.IllegalStateException: Wrote[2935546528] bytes, which is too many.

at
com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
~[guava-16.0.1.jar:?]

at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
~[guava-16.0.1.jar:?]

at
com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
~[guava-16.0.1.jar:?]

at
io.druid.segment.realtime.appenderator.FiniteAppenderatorDriver.publishAll(FiniteAppenderatorDriver.java:417)
[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.realtime.appenderator.FiniteAppenderatorDriver.finish(FiniteAppenderatorDriver.java:256)
[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.indexing.kafka.KafkaIndexTask.run(KafkaIndexTask.java:522)
[druid-kafka-indexing-service-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
[druid-indexing-service-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
[druid-indexing-service-0.9.2-rc2.jar:0.9.2-rc2]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_91]

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[?:1.8.0_91]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[?:1.8.0_91]

at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]

Caused by: java.lang.IllegalStateException:
Wrote[2935546528] bytes, which is too many.

at com.google.common.base.Preconditions.checkState(Preconditions.java:200)
~[guava-16.0.1.jar:?]

at
io.druid.segment.data.GenericIndexedWriter.close(GenericIndexedWriter.java:110)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.StringDimensionMergerV9.writeMergedValueMetadata(StringDimensionMergerV9.java:198)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.IndexMerger.makeIndexFiles(IndexMerger.java:693)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.IndexMerger.merge(IndexMerger.java:438)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.IndexMerger.mergeQueryableIndex(IndexMerger.java:242)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.IndexMerger.mergeQueryableIndex(IndexMerger.java:214)
~[druid-processing-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.realtime.appenderator.AppenderatorImpl.mergeAndPush(AppenderatorImpl.java:561)
~[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.realtime.appenderator.AppenderatorImpl.access$600(AppenderatorImpl.java:93)
~[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at io.druid.segment.realtime.appenderator.AppenderatorImpl$3.apply(AppenderatorImpl.java:467)
~[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at
io.druid.segment.realtime.appenderator.AppenderatorImpl$3.apply(AppenderatorImpl.java:455)
~[druid-server-0.9.2-rc2.jar:0.9.2-rc2]

at com.google.common.util.concurrent.Futures$1.apply(Futures.java:713)
~[guava-16.0.1.jar:?]

at
com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:861)
~[guava-16.0.1.jar:?]

… 3 more