Exception of GroupBy/TopN query

I encountered a Exception while querying data with GroupBy/TopN, but timeseries qeury is OK. Can anyone give me some hints how to solve the problem? Thanks.

TopN query exception log on Historical Node:

581.070: [GC581.070: [ParNew: 5124024K->101676K(5662336K), 0.0300180 secs] 5124024K->101676K(11953792K), 0.0301450 secs] [Times: user=0.26 sys=0.02, real=0.03 secs]

581.896: [GC581.896: [ParNew: 5134892K->64133K(5662336K), 0.4335420 secs] 5134892K->140654K(11953792K), 0.4337110 secs] [Times: user=1.47 sys=0.17, real=0.44 secs]

2016-08-19T07:47:50,650 WARN [topN_bo_adid_[2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z]] io.druid.collections.StupidPool - Already closed

com.metamx.common.ISE: Already Closed!

at io.druid.collections.StupidPool$ObjectResourceHolder.close(StupidPool.java:93) [druid-common-0.9.0.jar:0.9.0]

at io.druid.segment.data.CompressedObjectStrategy$1.close(CompressedObjectStrategy.java:303) [druid-processing-0.9.0.jar:0.9.0]

at com.google.common.io.Closeables.close(Closeables.java:77) [guava-16.0.1.jar:?]

at io.druid.segment.data.CompressedVSizeIntsIndexedSupplier$CompressedVSizeIndexedInts.close(CompressedVSizeIntsIndexedSupplier.java:403) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.column.SimpleDictionaryEncodedColumn.close(SimpleDictionaryEncodedColumn.java:99) [druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.CloseQuietly.close(CloseQuietly.java:36) [java-util-0.27.7.jar:?]

at io.druid.segment.QueryableIndexStorageAdapter$CursorSequenceBuilder$2.close(QueryableIndexStorageAdapter.java:721) [druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.CloseQuietly.close(CloseQuietly.java:36) [java-util-0.27.7.jar:?]

at com.metamx.common.guava.ResourceClosingSequence.toYielder(ResourceClosingSequence.java:44) [java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteredSequence.toYielder(FilteredSequence.java:52) [java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) [java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteredSequence.toYielder(FilteredSequence.java:52) [java-util-0.27.7.jar:?]

at com.metamx.common.guava.ResourceClosingSequence.toYielder(ResourceClosingSequence.java:41) [java-util-0.27.7.jar:?]

at com.metamx.common.guava.YieldingSequenceBase.accumulate(YieldingSequenceBase.java:34) [java-util-0.27.7.jar:?]

at io.druid.query.MetricsEmittingQueryRunner$1.accumulate(MetricsEmittingQueryRunner.java:118) [druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.Sequences.toList(Sequences.java:113) [java-util-0.27.7.jar:?]

at io.druid.query.BySegmentQueryRunner.run(BySegmentQueryRunner.java:56) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.MetricsEmittingQueryRunner$1.accumulate(MetricsEmittingQueryRunner.java:118) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2$1.call(SpecificSegmentQueryRunner.java:87) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner.doNamed(SpecificSegmentQueryRunner.java:171) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner.access$400(SpecificSegmentQueryRunner.java:41) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2.doItNamed(SpecificSegmentQueryRunner.java:162) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2.accumulate(SpecificSegmentQueryRunner.java:80) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.CPUTimeMetricQueryRunner$1.accumulate(CPUTimeMetricQueryRunner.java:81) [druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.Sequences$1.accumulate(Sequences.java:90) [java-util-0.27.7.jar:?]

at com.metamx.common.guava.Sequences.toList(Sequences.java:113) [java-util-0.27.7.jar:?]

at io.druid.query.ChainedExecutionQueryRunner$1$1$1.call(ChainedExecutionQueryRunner.java:129) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.ChainedExecutionQueryRunner$1$1$1.call(ChainedExecutionQueryRunner.java:119) [druid-processing-0.9.0.jar:0.9.0]

at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_75]

at io.druid.query.PrioritizedListenableFutureTask.run(PrioritizedExecutorService.java:271) [druid-processing-0.9.0.jar:0.9.0]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_75]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_75]

at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]

2016-08-19T07:47:50,651 ERROR [processing-5] io.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!

com.metamx.common.IAE: Index[33] >= size[33]

at io.druid.segment.data.GenericIndexed$BufferIndexed._get(GenericIndexed.java:194) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.GenericIndexed$1.get(GenericIndexed.java:292) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.CompressedVSizeIntsIndexedSupplier$CompressedVSizeIndexedInts.loadBuffer(CompressedVSizeIntsIndexedSupplier.java:383) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.CompressedVSizeIntsIndexedSupplier$CompressedVSizeIndexedInts.get(CompressedVSizeIntsIndexedSupplier.java:344) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.column.SimpleDictionaryEncodedColumn.getSingleValueRow(SimpleDictionaryEncodedColumn.java:65) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.QueryableIndexStorageAdapter$CursorSequenceBuilder$1$1$2$1.get(QueryableIndexStorageAdapter.java:437) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.PooledTopNAlgorithm.scanAndAggregate(PooledTopNAlgorithm.java:299) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.PooledTopNAlgorithm.scanAndAggregate(PooledTopNAlgorithm.java:38) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.BaseTopNAlgorithm.run(BaseTopNAlgorithm.java:95) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNMapFn.apply(TopNMapFn.java:58) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNMapFn.apply(TopNMapFn.java:27) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNQueryEngine$1.apply(TopNQueryEngine.java:84) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNQueryEngine$1.apply(TopNQueryEngine.java:79) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.MappingYieldingAccumulator.accumulate(MappingYieldingAccumulator.java:57) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteringYieldingAccumulator.accumulate(FilteringYieldingAccumulator.java:69) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappingYieldingAccumulator.accumulate(MappingYieldingAccumulator.java:57) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.makeYielder(BaseSequence.java:104) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.toYielder(BaseSequence.java:81) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.ResourceClosingSequence.toYielder(ResourceClosingSequence.java:41) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteredSequence.toYielder(FilteredSequence.java:52) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteredSequence.toYielder(FilteredSequence.java:52) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.ResourceClosingSequence.toYielder(ResourceClosingSequence.java:41) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.YieldingSequenceBase.accumulate(YieldingSequenceBase.java:34) ~[java-util-0.27.7.jar:?]

at io.druid.query.MetricsEmittingQueryRunner$1.accumulate(MetricsEmittingQueryRunner.java:118) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.Sequences.toList(Sequences.java:113) ~[java-util-0.27.7.jar:?]

at io.druid.query.BySegmentQueryRunner.run(BySegmentQueryRunner.java:56) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.MetricsEmittingQueryRunner$1.accumulate(MetricsEmittingQueryRunner.java:118) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2$1.call(SpecificSegmentQueryRunner.java:87) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner.doNamed(SpecificSegmentQueryRunner.java:171) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner.access$400(SpecificSegmentQueryRunner.java:41) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2.doItNamed(SpecificSegmentQueryRunner.java:162) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2.accumulate(SpecificSegmentQueryRunner.java:80) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.CPUTimeMetricQueryRunner$1.accumulate(CPUTimeMetricQueryRunner.java:81) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.Sequences$1.accumulate(Sequences.java:90) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.Sequences.toList(Sequences.java:113) ~[java-util-0.27.7.jar:?]

at io.druid.query.ChainedExecutionQueryRunner$1$1$1.call(ChainedExecutionQueryRunner.java:129) [druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.ChainedExecutionQueryRunner$1$1$1.call(ChainedExecutionQueryRunner.java:119) [druid-processing-0.9.0.jar:0.9.0]

at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_75]

at io.druid.query.PrioritizedListenableFutureTask.run(PrioritizedExecutorService.java:271) [druid-processing-0.9.0.jar:0.9.0]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_75]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_75]

at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]

2016-08-19T07:47:50,654 WARN [qtp269109579-21] io.druid.server.QueryResource - Exception occurred on request [TopNQuery{dataSource=‘bo_adid’, dimensionSpec=DefaultDimensionSpec{dimension=‘service_name’, outputName=‘service_name’}, topNMetricSpec=NumericTopNMetricSpec{metric=‘count’}, threshold=1000, querySegmentSpec=MultipleSpecificSegmentSpec{descriptors=[SegmentDescriptor{interval=2016-08-14T16:00:00.000Z/2016-08-14T17:00:00.000Z, version=‘2016-08-14T16:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T16:00:00.000Z/2016-08-14T17:00:00.000Z, version=‘2016-08-14T16:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T17:00:00.000Z/2016-08-14T18:00:00.000Z, version=‘2016-08-14T17:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T17:00:00.000Z/2016-08-14T18:00:00.000Z, version=‘2016-08-14T17:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T19:00:00.000Z/2016-08-14T20:00:00.000Z, version=‘2016-08-14T19:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T19:00:00.000Z/2016-08-14T20:00:00.000Z, version=‘2016-08-14T19:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T20:00:00.000Z/2016-08-14T21:00:00.000Z, version=‘2016-08-14T20:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T20:00:00.000Z/2016-08-14T21:00:00.000Z, version=‘2016-08-14T20:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T20:00:00.000Z/2016-08-14T21:00:00.000Z, version=‘2016-08-14T20:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T21:00:00.000Z/2016-08-14T22:00:00.000Z, version=‘2016-08-14T21:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T21:00:00.000Z/2016-08-14T22:00:00.000Z, version=‘2016-08-14T21:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T21:00:00.000Z/2016-08-14T22:00:00.000Z, version=‘2016-08-14T21:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T22:00:00.000Z/2016-08-14T23:00:00.000Z, version=‘2016-08-14T22:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T22:00:00.000Z/2016-08-14T23:00:00.000Z, version=‘2016-08-14T22:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T22:00:00.000Z/2016-08-14T23:00:00.000Z, version=‘2016-08-14T22:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T23:00:00.000Z/2016-08-15T00:00:00.000Z, version=‘2016-08-14T23:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T23:00:00.000Z/2016-08-15T00:00:00.000Z, version=‘2016-08-14T23:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T23:00:00.000Z/2016-08-15T00:00:00.000Z, version=‘2016-08-14T23:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T00:00:00.000Z/2016-08-15T01:00:00.000Z, version=‘2016-08-15T00:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T00:00:00.000Z/2016-08-15T01:00:00.000Z, version=‘2016-08-15T00:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T00:00:00.000Z/2016-08-15T01:00:00.000Z, version=‘2016-08-15T00:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T01:00:00.000Z/2016-08-15T02:00:00.000Z, version=‘2016-08-15T01:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T01:00:00.000Z/2016-08-15T02:00:00.000Z, version=‘2016-08-15T01:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T01:00:00.000Z/2016-08-15T02:00:00.000Z, version=‘2016-08-15T01:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T02:00:00.000Z/2016-08-15T03:00:00.000Z, version=‘2016-08-15T02:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T02:00:00.000Z/2016-08-15T03:00:00.000Z, version=‘2016-08-15T02:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T02:00:00.000Z/2016-08-15T03:00:00.000Z, version=‘2016-08-15T02:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T03:00:00.000Z/2016-08-15T04:00:00.000Z, version=‘2016-08-15T03:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T03:00:00.000Z/2016-08-15T04:00:00.000Z, version=‘2016-08-15T03:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T03:00:00.000Z/2016-08-15T04:00:00.000Z, version=‘2016-08-15T03:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T04:00:00.000Z/2016-08-15T05:00:00.000Z, version=‘2016-08-15T04:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T04:00:00.000Z/2016-08-15T05:00:00.000Z, version=‘2016-08-15T04:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T04:00:00.000Z/2016-08-15T05:00:00.000Z, version=‘2016-08-15T04:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T05:00:00.000Z/2016-08-15T06:00:00.000Z, version=‘2016-08-15T05:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T05:00:00.000Z/2016-08-15T06:00:00.000Z, version=‘2016-08-15T05:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T05:00:00.000Z/2016-08-15T06:00:00.000Z, version=‘2016-08-15T05:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T06:00:00.000Z/2016-08-15T07:00:00.000Z, version=‘2016-08-15T06:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T06:00:00.000Z/2016-08-15T07:00:00.000Z, version=‘2016-08-15T06:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T06:00:00.000Z/2016-08-15T07:00:00.000Z, version=‘2016-08-15T06:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T07:00:00.000Z/2016-08-15T08:00:00.000Z, version=‘2016-08-15T07:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T07:00:00.000Z/2016-08-15T08:00:00.000Z, version=‘2016-08-15T07:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T07:00:00.000Z/2016-08-15T08:00:00.000Z, version=‘2016-08-15T07:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T08:00:00.000Z/2016-08-15T09:00:00.000Z, version=‘2016-08-15T08:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T08:00:00.000Z/2016-08-15T09:00:00.000Z, version=‘2016-08-15T08:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T08:00:00.000Z/2016-08-15T09:00:00.000Z, version=‘2016-08-15T08:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T09:00:00.000Z/2016-08-15T10:00:00.000Z, version=‘2016-08-15T09:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T09:00:00.000Z/2016-08-15T10:00:00.000Z, version=‘2016-08-15T09:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T09:00:00.000Z/2016-08-15T10:00:00.000Z, version=‘2016-08-15T09:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T10:00:00.000Z/2016-08-15T11:00:00.000Z, version=‘2016-08-15T10:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T10:00:00.000Z/2016-08-15T11:00:00.000Z, version=‘2016-08-15T10:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T10:00:00.000Z/2016-08-15T11:00:00.000Z, version=‘2016-08-15T10:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T11:00:00.000Z/2016-08-15T12:00:00.000Z, version=‘2016-08-15T11:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T11:00:00.000Z/2016-08-15T12:00:00.000Z, version=‘2016-08-15T11:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T11:00:00.000Z/2016-08-15T12:00:00.000Z, version=‘2016-08-15T11:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T12:00:00.000Z/2016-08-15T13:00:00.000Z, version=‘2016-08-15T12:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T12:00:00.000Z/2016-08-15T13:00:00.000Z, version=‘2016-08-15T12:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T12:00:00.000Z/2016-08-15T13:00:00.000Z, version=‘2016-08-15T12:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T13:00:00.000Z/2016-08-15T14:00:00.000Z, version=‘2016-08-15T13:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T13:00:00.000Z/2016-08-15T14:00:00.000Z, version=‘2016-08-15T13:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T13:00:00.000Z/2016-08-15T14:00:00.000Z, version=‘2016-08-15T13:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T14:00:00.000Z/2016-08-15T15:00:00.000Z, version=‘2016-08-15T14:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T14:00:00.000Z/2016-08-15T15:00:00.000Z, version=‘2016-08-15T14:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T14:00:00.000Z/2016-08-15T15:00:00.000Z, version=‘2016-08-15T14:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T15:00:00.000Z/2016-08-15T16:00:00.000Z, version=‘2016-08-15T15:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T15:00:00.000Z/2016-08-15T16:00:00.000Z, version=‘2016-08-15T15:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T15:00:00.000Z/2016-08-15T16:00:00.000Z, version=‘2016-08-15T15:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T16:00:00.000Z/2016-08-15T17:00:00.000Z, version=‘2016-08-15T16:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T16:00:00.000Z/2016-08-15T17:00:00.000Z, version=‘2016-08-15T16:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T16:00:00.000Z/2016-08-15T17:00:00.000Z, version=‘2016-08-15T16:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T17:00:00.000Z/2016-08-15T18:00:00.000Z, version=‘2016-08-15T17:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T17:00:00.000Z/2016-08-15T18:00:00.000Z, version=‘2016-08-15T17:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T17:00:00.000Z/2016-08-15T18:00:00.000Z, version=‘2016-08-15T17:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T18:00:00.000Z/2016-08-15T19:00:00.000Z, version=‘2016-08-15T18:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T18:00:00.000Z/2016-08-15T19:00:00.000Z, version=‘2016-08-15T18:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T18:00:00.000Z/2016-08-15T19:00:00.000Z, version=‘2016-08-15T18:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T19:00:00.000Z/2016-08-15T20:00:00.000Z, version=‘2016-08-15T19:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T19:00:00.000Z/2016-08-15T20:00:00.000Z, version=‘2016-08-15T19:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T19:00:00.000Z/2016-08-15T20:00:00.000Z, version=‘2016-08-15T19:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T20:00:00.000Z/2016-08-15T21:00:00.000Z, version=‘2016-08-15T20:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T20:00:00.000Z/2016-08-15T21:00:00.000Z, version=‘2016-08-15T20:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T20:00:00.000Z/2016-08-15T21:00:00.000Z, version=‘2016-08-15T20:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T21:00:00.000Z/2016-08-15T22:00:00.000Z, version=‘2016-08-15T21:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T21:00:00.000Z/2016-08-15T22:00:00.000Z, version=‘2016-08-15T21:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T21:00:00.000Z/2016-08-15T22:00:00.000Z, version=‘2016-08-15T21:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T22:00:00.000Z/2016-08-15T23:00:00.000Z, version=‘2016-08-15T22:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T22:00:00.000Z/2016-08-15T23:00:00.000Z, version=‘2016-08-15T22:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T22:00:00.000Z/2016-08-15T23:00:00.000Z, version=‘2016-08-15T22:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T23:00:00.000Z/2016-08-16T00:00:00.000Z, version=‘2016-08-15T23:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T23:00:00.000Z/2016-08-16T00:00:00.000Z, version=‘2016-08-15T23:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T23:00:00.000Z/2016-08-16T00:00:00.000Z, version=‘2016-08-15T23:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T00:00:00.000Z/2016-08-16T01:00:00.000Z, version=‘2016-08-16T00:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T00:00:00.000Z/2016-08-16T01:00:00.000Z, version=‘2016-08-16T00:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T00:00:00.000Z/2016-08-16T01:00:00.000Z, version=‘2016-08-16T00:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T01:00:00.000Z/2016-08-16T02:00:00.000Z, version=‘2016-08-16T01:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T01:00:00.000Z/2016-08-16T02:00:00.000Z, version=‘2016-08-16T01:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T01:00:00.000Z/2016-08-16T02:00:00.000Z, version=‘2016-08-16T01:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z, version=‘2016-08-16T02:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z, version=‘2016-08-16T02:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z, version=‘2016-08-16T02:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z, version=‘2016-08-16T02:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T03:00:00.000Z/2016-08-16T04:00:00.000Z, version=‘2016-08-16T03:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T03:00:00.000Z/2016-08-16T04:00:00.000Z, version=‘2016-08-16T03:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T03:00:00.000Z/2016-08-16T04:00:00.000Z, version=‘2016-08-16T03:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T03:00:00.000Z/2016-08-16T04:00:00.000Z, version=‘2016-08-16T03:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T04:00:00.000Z/2016-08-16T05:00:00.000Z, version=‘2016-08-16T04:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T04:00:00.000Z/2016-08-16T05:00:00.000Z, version=‘2016-08-16T04:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T04:00:00.000Z/2016-08-16T05:00:00.000Z, version=‘2016-08-16T04:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T04:00:00.000Z/2016-08-16T05:00:00.000Z, version=‘2016-08-16T04:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T05:00:00.000Z/2016-08-16T06:00:00.000Z, version=‘2016-08-16T05:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T05:00:00.000Z/2016-08-16T06:00:00.000Z, version=‘2016-08-16T05:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T05:00:00.000Z/2016-08-16T06:00:00.000Z, version=‘2016-08-16T05:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T06:00:00.000Z/2016-08-16T07:00:00.000Z, version=‘2016-08-16T06:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T06:00:00.000Z/2016-08-16T07:00:00.000Z, version=‘2016-08-16T06:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T06:00:00.000Z/2016-08-16T07:00:00.000Z, version=‘2016-08-16T06:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T06:00:00.000Z/2016-08-16T07:00:00.000Z, version=‘2016-08-16T06:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T07:00:00.000Z/2016-08-16T08:00:00.000Z, version=‘2016-08-16T07:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T07:00:00.000Z/2016-08-16T08:00:00.000Z, version=‘2016-08-16T07:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T07:00:00.000Z/2016-08-16T08:00:00.000Z, version=‘2016-08-16T07:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T08:00:00.000Z/2016-08-16T09:00:00.000Z, version=‘2016-08-16T08:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T08:00:00.000Z/2016-08-16T09:00:00.000Z, version=‘2016-08-16T08:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T08:00:00.000Z/2016-08-16T09:00:00.000Z, version=‘2016-08-16T08:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T09:00:00.000Z/2016-08-16T10:00:00.000Z, version=‘2016-08-16T09:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T09:00:00.000Z/2016-08-16T10:00:00.000Z, version=‘2016-08-16T09:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T10:00:00.000Z/2016-08-16T11:00:00.000Z, version=‘2016-08-16T10:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T10:00:00.000Z/2016-08-16T11:00:00.000Z, version=‘2016-08-16T10:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T10:00:00.000Z/2016-08-16T11:00:00.000Z, version=‘2016-08-16T10:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T11:00:00.000Z/2016-08-16T12:00:00.000Z, version=‘2016-08-16T11:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T11:00:00.000Z/2016-08-16T12:00:00.000Z, version=‘2016-08-16T11:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T11:00:00.000Z/2016-08-16T12:00:00.000Z, version=‘2016-08-16T11:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T12:00:00.000Z/2016-08-16T13:00:00.000Z, version=‘2016-08-16T12:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T12:00:00.000Z/2016-08-16T13:00:00.000Z, version=‘2016-08-16T12:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T12:00:00.000Z/2016-08-16T13:00:00.000Z, version=‘2016-08-16T12:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T13:00:00.000Z/2016-08-16T14:00:00.000Z, version=‘2016-08-16T13:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T13:00:00.000Z/2016-08-16T14:00:00.000Z, version=‘2016-08-16T13:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T13:00:00.000Z/2016-08-16T14:00:00.000Z, version=‘2016-08-16T13:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T14:00:00.000Z/2016-08-16T15:00:00.000Z, version=‘2016-08-16T14:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T14:00:00.000Z/2016-08-16T15:00:00.000Z, version=‘2016-08-16T14:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T14:00:00.000Z/2016-08-16T15:00:00.000Z, version=‘2016-08-16T14:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T15:00:00.000Z/2016-08-16T16:00:00.000Z, version=‘2016-08-16T15:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T15:00:00.000Z/2016-08-16T16:00:00.000Z, version=‘2016-08-16T15:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T15:00:00.000Z/2016-08-16T16:00:00.000Z, version=‘2016-08-16T15:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-19T02:00:00.000Z/2016-08-19T03:00:00.000Z, version=‘2016-08-19T02:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-19T02:00:00.000Z/2016-08-19T03:00:00.000Z, version=‘2016-08-19T02:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-19T02:00:00.000Z/2016-08-19T03:00:00.000Z, version=‘2016-08-19T02:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-19T03:00:00.000Z/2016-08-19T04:00:00.000Z, version=‘2016-08-19T03:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-19T03:00:00.000Z/2016-08-19T04:00:00.000Z, version=‘2016-08-19T03:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-19T03:00:00.000Z/2016-08-19T04:00:00.000Z, version=‘2016-08-19T03:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-19T04:00:00.000Z/2016-08-19T05:00:00.000Z, version=‘2016-08-19T04:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-19T04:00:00.000Z/2016-08-19T05:00:00.000Z, version=‘2016-08-19T04:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-19T04:00:00.000Z/2016-08-19T05:00:00.000Z, version=‘2016-08-19T04:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-19T05:00:00.000Z/2016-08-19T06:00:00.000Z, version=‘2016-08-19T05:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-19T05:00:00.000Z/2016-08-19T06:00:00.000Z, version=‘2016-08-19T05:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-19T05:00:00.000Z/2016-08-19T06:00:00.000Z, version=‘2016-08-19T05:00:00.000Z’, partitionNumber=5}]}, dimFilter=null, granularity=‘AllGranularity’, aggregatorSpecs=[DoubleSumAggregatorFactory{fieldName=‘count’, name=‘count’}], postAggregatorSpecs=}]

com.metamx.common.IAE: Index[33] >= size[33]

at io.druid.segment.data.GenericIndexed$BufferIndexed._get(GenericIndexed.java:194) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.GenericIndexed$1.get(GenericIndexed.java:292) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.CompressedVSizeIntsIndexedSupplier$CompressedVSizeIndexedInts.loadBuffer(CompressedVSizeIntsIndexedSupplier.java:383) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.CompressedVSizeIntsIndexedSupplier$CompressedVSizeIndexedInts.get(CompressedVSizeIntsIndexedSupplier.java:344) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.column.SimpleDictionaryEncodedColumn.getSingleValueRow(SimpleDictionaryEncodedColumn.java:65) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.QueryableIndexStorageAdapter$CursorSequenceBuilder$1$1$2$1.get(QueryableIndexStorageAdapter.java:437) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.PooledTopNAlgorithm.scanAndAggregate(PooledTopNAlgorithm.java:299) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.PooledTopNAlgorithm.scanAndAggregate(PooledTopNAlgorithm.java:38) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.BaseTopNAlgorithm.run(BaseTopNAlgorithm.java:95) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNMapFn.apply(TopNMapFn.java:58) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNMapFn.apply(TopNMapFn.java:27) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNQueryEngine$1.apply(TopNQueryEngine.java:84) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNQueryEngine$1.apply(TopNQueryEngine.java:79) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.MappingYieldingAccumulator.accumulate(MappingYieldingAccumulator.java:57) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteringYieldingAccumulator.accumulate(FilteringYieldingAccumulator.java:69) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappingYieldingAccumulator.accumulate(MappingYieldingAccumulator.java:57) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.makeYielder(BaseSequence.java:104) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.toYielder(BaseSequence.java:81) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.ResourceClosingSequence.toYielder(ResourceClosingSequence.java:41) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteredSequence.toYielder(FilteredSequence.java:52) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteredSequence.toYielder(FilteredSequence.java:52) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.ResourceClosingSequence.toYielder(ResourceClosingSequence.java:41) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.YieldingSequenceBase.accumulate(YieldingSequenceBase.java:34) ~[java-util-0.27.7.jar:?]

at io.druid.query.MetricsEmittingQueryRunner$1.accumulate(MetricsEmittingQueryRunner.java:118) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.Sequences.toList(Sequences.java:113) ~[java-util-0.27.7.jar:?]

at io.druid.query.BySegmentQueryRunner.run(BySegmentQueryRunner.java:56) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.MetricsEmittingQueryRunner$1.accumulate(MetricsEmittingQueryRunner.java:118) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2$1.call(SpecificSegmentQueryRunner.java:87) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner.doNamed(SpecificSegmentQueryRunner.java:171) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner.access$400(SpecificSegmentQueryRunner.java:41) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2.doItNamed(SpecificSegmentQueryRunner.java:162) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2.accumulate(SpecificSegmentQueryRunner.java:80) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.CPUTimeMetricQueryRunner$1.accumulate(CPUTimeMetricQueryRunner.java:81) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.Sequences$1.accumulate(Sequences.java:90) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.Sequences.toList(Sequences.java:113) ~[java-util-0.27.7.jar:?]

at io.druid.query.ChainedExecutionQueryRunner$1$1$1.call(ChainedExecutionQueryRunner.java:129) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.ChainedExecutionQueryRunner$1$1$1.call(ChainedExecutionQueryRunner.java:119) ~[druid-processing-0.9.0.jar:0.9.0]

at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[?:1.7.0_75]

at io.druid.query.PrioritizedListenableFutureTask.run(PrioritizedExecutorService.java:271) ~[druid-processing-0.9.0.jar:0.9.0]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[?:1.7.0_75]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[?:1.7.0_75]

at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]

2016-08-19T07:47:50,657 ERROR [qtp269109579-21] io.druid.server.QueryResource - Exception handling request: {class=io.druid.server.QueryResource, exceptionType=class com.metamx.common.IAE, exceptionMessage=Index[33] >= size[33], exception=com.metamx.common.IAE: Index[33] >= size[33], query=TopNQuery{dataSource=‘bo_adid’, dimensionSpec=DefaultDimensionSpec{dimension=‘service_name’, outputName=‘service_name’}, topNMetricSpec=NumericTopNMetricSpec{metric=‘count’}, threshold=1000, querySegmentSpec=MultipleSpecificSegmentSpec{descriptors=[SegmentDescriptor{interval=2016-08-14T16:00:00.000Z/2016-08-14T17:00:00.000Z, version=‘2016-08-14T16:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T16:00:00.000Z/2016-08-14T17:00:00.000Z, version=‘2016-08-14T16:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T17:00:00.000Z/2016-08-14T18:00:00.000Z, version=‘2016-08-14T17:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T17:00:00.000Z/2016-08-14T18:00:00.000Z, version=‘2016-08-14T17:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T19:00:00.000Z/2016-08-14T20:00:00.000Z, version=‘2016-08-14T19:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T19:00:00.000Z/2016-08-14T20:00:00.000Z, version=‘2016-08-14T19:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T20:00:00.000Z/2016-08-14T21:00:00.000Z, version=‘2016-08-14T20:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T20:00:00.000Z/2016-08-14T21:00:00.000Z, version=‘2016-08-14T20:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T20:00:00.000Z/2016-08-14T21:00:00.000Z, version=‘2016-08-14T20:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T21:00:00.000Z/2016-08-14T22:00:00.000Z, version=‘2016-08-14T21:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T21:00:00.000Z/2016-08-14T22:00:00.000Z, version=‘2016-08-14T21:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T21:00:00.000Z/2016-08-14T22:00:00.000Z, version=‘2016-08-14T21:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T22:00:00.000Z/2016-08-14T23:00:00.000Z, version=‘2016-08-14T22:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T22:00:00.000Z/2016-08-14T23:00:00.000Z, version=‘2016-08-14T22:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T22:00:00.000Z/2016-08-14T23:00:00.000Z, version=‘2016-08-14T22:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-14T23:00:00.000Z/2016-08-15T00:00:00.000Z, version=‘2016-08-14T23:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-14T23:00:00.000Z/2016-08-15T00:00:00.000Z, version=‘2016-08-14T23:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-14T23:00:00.000Z/2016-08-15T00:00:00.000Z, version=‘2016-08-14T23:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T00:00:00.000Z/2016-08-15T01:00:00.000Z, version=‘2016-08-15T00:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T00:00:00.000Z/2016-08-15T01:00:00.000Z, version=‘2016-08-15T00:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T00:00:00.000Z/2016-08-15T01:00:00.000Z, version=‘2016-08-15T00:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T01:00:00.000Z/2016-08-15T02:00:00.000Z, version=‘2016-08-15T01:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T01:00:00.000Z/2016-08-15T02:00:00.000Z, version=‘2016-08-15T01:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T01:00:00.000Z/2016-08-15T02:00:00.000Z, version=‘2016-08-15T01:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T02:00:00.000Z/2016-08-15T03:00:00.000Z, version=‘2016-08-15T02:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T02:00:00.000Z/2016-08-15T03:00:00.000Z, version=‘2016-08-15T02:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T02:00:00.000Z/2016-08-15T03:00:00.000Z, version=‘2016-08-15T02:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T03:00:00.000Z/2016-08-15T04:00:00.000Z, version=‘2016-08-15T03:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T03:00:00.000Z/2016-08-15T04:00:00.000Z, version=‘2016-08-15T03:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T03:00:00.000Z/2016-08-15T04:00:00.000Z, version=‘2016-08-15T03:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T04:00:00.000Z/2016-08-15T05:00:00.000Z, version=‘2016-08-15T04:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T04:00:00.000Z/2016-08-15T05:00:00.000Z, version=‘2016-08-15T04:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T04:00:00.000Z/2016-08-15T05:00:00.000Z, version=‘2016-08-15T04:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T05:00:00.000Z/2016-08-15T06:00:00.000Z, version=‘2016-08-15T05:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T05:00:00.000Z/2016-08-15T06:00:00.000Z, version=‘2016-08-15T05:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T05:00:00.000Z/2016-08-15T06:00:00.000Z, version=‘2016-08-15T05:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T06:00:00.000Z/2016-08-15T07:00:00.000Z, version=‘2016-08-15T06:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T06:00:00.000Z/2016-08-15T07:00:00.000Z, version=‘2016-08-15T06:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T06:00:00.000Z/2016-08-15T07:00:00.000Z, version=‘2016-08-15T06:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T07:00:00.000Z/2016-08-15T08:00:00.000Z, version=‘2016-08-15T07:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T07:00:00.000Z/2016-08-15T08:00:00.000Z, version=‘2016-08-15T07:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T07:00:00.000Z/2016-08-15T08:00:00.000Z, version=‘2016-08-15T07:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T08:00:00.000Z/2016-08-15T09:00:00.000Z, version=‘2016-08-15T08:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T08:00:00.000Z/2016-08-15T09:00:00.000Z, version=‘2016-08-15T08:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T08:00:00.000Z/2016-08-15T09:00:00.000Z, version=‘2016-08-15T08:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T09:00:00.000Z/2016-08-15T10:00:00.000Z, version=‘2016-08-15T09:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T09:00:00.000Z/2016-08-15T10:00:00.000Z, version=‘2016-08-15T09:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T09:00:00.000Z/2016-08-15T10:00:00.000Z, version=‘2016-08-15T09:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T10:00:00.000Z/2016-08-15T11:00:00.000Z, version=‘2016-08-15T10:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T10:00:00.000Z/2016-08-15T11:00:00.000Z, version=‘2016-08-15T10:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T10:00:00.000Z/2016-08-15T11:00:00.000Z, version=‘2016-08-15T10:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T11:00:00.000Z/2016-08-15T12:00:00.000Z, version=‘2016-08-15T11:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T11:00:00.000Z/2016-08-15T12:00:00.000Z, version=‘2016-08-15T11:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T11:00:00.000Z/2016-08-15T12:00:00.000Z, version=‘2016-08-15T11:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T12:00:00.000Z/2016-08-15T13:00:00.000Z, version=‘2016-08-15T12:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T12:00:00.000Z/2016-08-15T13:00:00.000Z, version=‘2016-08-15T12:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T12:00:00.000Z/2016-08-15T13:00:00.000Z, version=‘2016-08-15T12:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T13:00:00.000Z/2016-08-15T14:00:00.000Z, version=‘2016-08-15T13:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T13:00:00.000Z/2016-08-15T14:00:00.000Z, version=‘2016-08-15T13:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T13:00:00.000Z/2016-08-15T14:00:00.000Z, version=‘2016-08-15T13:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T14:00:00.000Z/2016-08-15T15:00:00.000Z, version=‘2016-08-15T14:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T14:00:00.000Z/2016-08-15T15:00:00.000Z, version=‘2016-08-15T14:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T14:00:00.000Z/2016-08-15T15:00:00.000Z, version=‘2016-08-15T14:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T15:00:00.000Z/2016-08-15T16:00:00.000Z, version=‘2016-08-15T15:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T15:00:00.000Z/2016-08-15T16:00:00.000Z, version=‘2016-08-15T15:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T15:00:00.000Z/2016-08-15T16:00:00.000Z, version=‘2016-08-15T15:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T16:00:00.000Z/2016-08-15T17:00:00.000Z, version=‘2016-08-15T16:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T16:00:00.000Z/2016-08-15T17:00:00.000Z, version=‘2016-08-15T16:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T16:00:00.000Z/2016-08-15T17:00:00.000Z, version=‘2016-08-15T16:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T17:00:00.000Z/2016-08-15T18:00:00.000Z, version=‘2016-08-15T17:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T17:00:00.000Z/2016-08-15T18:00:00.000Z, version=‘2016-08-15T17:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T17:00:00.000Z/2016-08-15T18:00:00.000Z, version=‘2016-08-15T17:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T18:00:00.000Z/2016-08-15T19:00:00.000Z, version=‘2016-08-15T18:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T18:00:00.000Z/2016-08-15T19:00:00.000Z, version=‘2016-08-15T18:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T18:00:00.000Z/2016-08-15T19:00:00.000Z, version=‘2016-08-15T18:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T19:00:00.000Z/2016-08-15T20:00:00.000Z, version=‘2016-08-15T19:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T19:00:00.000Z/2016-08-15T20:00:00.000Z, version=‘2016-08-15T19:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T19:00:00.000Z/2016-08-15T20:00:00.000Z, version=‘2016-08-15T19:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T20:00:00.000Z/2016-08-15T21:00:00.000Z, version=‘2016-08-15T20:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T20:00:00.000Z/2016-08-15T21:00:00.000Z, version=‘2016-08-15T20:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T20:00:00.000Z/2016-08-15T21:00:00.000Z, version=‘2016-08-15T20:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T21:00:00.000Z/2016-08-15T22:00:00.000Z, version=‘2016-08-15T21:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T21:00:00.000Z/2016-08-15T22:00:00.000Z, version=‘2016-08-15T21:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T21:00:00.000Z/2016-08-15T22:00:00.000Z, version=‘2016-08-15T21:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T22:00:00.000Z/2016-08-15T23:00:00.000Z, version=‘2016-08-15T22:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T22:00:00.000Z/2016-08-15T23:00:00.000Z, version=‘2016-08-15T22:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T22:00:00.000Z/2016-08-15T23:00:00.000Z, version=‘2016-08-15T22:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-15T23:00:00.000Z/2016-08-16T00:00:00.000Z, version=‘2016-08-15T23:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-15T23:00:00.000Z/2016-08-16T00:00:00.000Z, version=‘2016-08-15T23:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-15T23:00:00.000Z/2016-08-16T00:00:00.000Z, version=‘2016-08-15T23:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T00:00:00.000Z/2016-08-16T01:00:00.000Z, version=‘2016-08-16T00:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T00:00:00.000Z/2016-08-16T01:00:00.000Z, version=‘2016-08-16T00:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T00:00:00.000Z/2016-08-16T01:00:00.000Z, version=‘2016-08-16T00:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T01:00:00.000Z/2016-08-16T02:00:00.000Z, version=‘2016-08-16T01:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T01:00:00.000Z/2016-08-16T02:00:00.000Z, version=‘2016-08-16T01:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T01:00:00.000Z/2016-08-16T02:00:00.000Z, version=‘2016-08-16T01:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z, version=‘2016-08-16T02:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z, version=‘2016-08-16T02:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z, version=‘2016-08-16T02:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T02:00:00.000Z/2016-08-16T03:00:00.000Z, version=‘2016-08-16T02:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T03:00:00.000Z/2016-08-16T04:00:00.000Z, version=‘2016-08-16T03:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T03:00:00.000Z/2016-08-16T04:00:00.000Z, version=‘2016-08-16T03:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T03:00:00.000Z/2016-08-16T04:00:00.000Z, version=‘2016-08-16T03:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T03:00:00.000Z/2016-08-16T04:00:00.000Z, version=‘2016-08-16T03:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T04:00:00.000Z/2016-08-16T05:00:00.000Z, version=‘2016-08-16T04:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T04:00:00.000Z/2016-08-16T05:00:00.000Z, version=‘2016-08-16T04:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T04:00:00.000Z/2016-08-16T05:00:00.000Z, version=‘2016-08-16T04:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T04:00:00.000Z/2016-08-16T05:00:00.000Z, version=‘2016-08-16T04:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T05:00:00.000Z/2016-08-16T06:00:00.000Z, version=‘2016-08-16T05:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T05:00:00.000Z/2016-08-16T06:00:00.000Z, version=‘2016-08-16T05:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T05:00:00.000Z/2016-08-16T06:00:00.000Z, version=‘2016-08-16T05:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T06:00:00.000Z/2016-08-16T07:00:00.000Z, version=‘2016-08-16T06:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T06:00:00.000Z/2016-08-16T07:00:00.000Z, version=‘2016-08-16T06:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T06:00:00.000Z/2016-08-16T07:00:00.000Z, version=‘2016-08-16T06:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T06:00:00.000Z/2016-08-16T07:00:00.000Z, version=‘2016-08-16T06:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T07:00:00.000Z/2016-08-16T08:00:00.000Z, version=‘2016-08-16T07:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T07:00:00.000Z/2016-08-16T08:00:00.000Z, version=‘2016-08-16T07:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T07:00:00.000Z/2016-08-16T08:00:00.000Z, version=‘2016-08-16T07:00:00.000Z’, partitionNumber=6}, SegmentDescriptor{interval=2016-08-16T08:00:00.000Z/2016-08-16T09:00:00.000Z, version=‘2016-08-16T08:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T08:00:00.000Z/2016-08-16T09:00:00.000Z, version=‘2016-08-16T08:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T08:00:00.000Z/2016-08-16T09:00:00.000Z, version=‘2016-08-16T08:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T09:00:00.000Z/2016-08-16T10:00:00.000Z, version=‘2016-08-16T09:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T09:00:00.000Z/2016-08-16T10:00:00.000Z, version=‘2016-08-16T09:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T10:00:00.000Z/2016-08-16T11:00:00.000Z, version=‘2016-08-16T10:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T10:00:00.000Z/2016-08-16T11:00:00.000Z, version=‘2016-08-16T10:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T10:00:00.000Z/2016-08-16T11:00:00.000Z, version=‘2016-08-16T10:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T11:00:00.000Z/2016-08-16T12:00:00.000Z, version=‘2016-08-16T11:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T11:00:00.000Z/2016-08-16T12:00:00.000Z, version=‘2016-08-16T11:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T11:00:00.000Z/2016-08-16T12:00:00.000Z, version=‘2016-08-16T11:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T12:00:00.000Z/2016-08-16T13:00:00.000Z, version=‘2016-08-16T12:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T12:00:00.000Z/2016-08-16T13:00:00.000Z, version=‘2016-08-16T12:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T12:00:00.000Z/2016-08-16T13:00:00.000Z, version=‘2016-08-16T12:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T13:00:00.000Z/2016-08-16T14:00:00.000Z, version=‘2016-08-16T13:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T13:00:00.000Z/2016-08-16T14:00:00.000Z, version=‘2016-08-16T13:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T13:00:00.000Z/2016-08-16T14:00:00.000Z, version=‘2016-08-16T13:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T14:00:00.000Z/2016-08-16T15:00:00.000Z, version=‘2016-08-16T14:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T14:00:00.000Z/2016-08-16T15:00:00.000Z, version=‘2016-08-16T14:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T14:00:00.000Z/2016-08-16T15:00:00.000Z, version=‘2016-08-16T14:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-16T15:00:00.000Z/2016-08-16T16:00:00.000Z, version=‘2016-08-16T15:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-16T15:00:00.000Z/2016-08-16T16:00:00.000Z, version=‘2016-08-16T15:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-16T15:00:00.000Z/2016-08-16T16:00:00.000Z, version=‘2016-08-16T15:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-19T02:00:00.000Z/2016-08-19T03:00:00.000Z, version=‘2016-08-19T02:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-19T02:00:00.000Z/2016-08-19T03:00:00.000Z, version=‘2016-08-19T02:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-19T02:00:00.000Z/2016-08-19T03:00:00.000Z, version=‘2016-08-19T02:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-19T03:00:00.000Z/2016-08-19T04:00:00.000Z, version=‘2016-08-19T03:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-19T03:00:00.000Z/2016-08-19T04:00:00.000Z, version=‘2016-08-19T03:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-19T03:00:00.000Z/2016-08-19T04:00:00.000Z, version=‘2016-08-19T03:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-19T04:00:00.000Z/2016-08-19T05:00:00.000Z, version=‘2016-08-19T04:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-19T04:00:00.000Z/2016-08-19T05:00:00.000Z, version=‘2016-08-19T04:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-19T04:00:00.000Z/2016-08-19T05:00:00.000Z, version=‘2016-08-19T04:00:00.000Z’, partitionNumber=5}, SegmentDescriptor{interval=2016-08-19T05:00:00.000Z/2016-08-19T06:00:00.000Z, version=‘2016-08-19T05:00:00.000Z’, partitionNumber=0}, SegmentDescriptor{interval=2016-08-19T05:00:00.000Z/2016-08-19T06:00:00.000Z, version=‘2016-08-19T05:00:00.000Z’, partitionNumber=4}, SegmentDescriptor{interval=2016-08-19T05:00:00.000Z/2016-08-19T06:00:00.000Z, version=‘2016-08-19T05:00:00.000Z’, partitionNumber=5}]}, dimFilter=null, granularity=‘AllGranularity’, aggregatorSpecs=[DoubleSumAggregatorFactory{fieldName=‘count’, name=‘count’}], postAggregatorSpecs=}, peer=172.16.89.128}

com.metamx.common.IAE: Index[33] >= size[33]

at io.druid.segment.data.GenericIndexed$BufferIndexed._get(GenericIndexed.java:194) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.GenericIndexed$1.get(GenericIndexed.java:292) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.CompressedVSizeIntsIndexedSupplier$CompressedVSizeIndexedInts.loadBuffer(CompressedVSizeIntsIndexedSupplier.java:383) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.data.CompressedVSizeIntsIndexedSupplier$CompressedVSizeIndexedInts.get(CompressedVSizeIntsIndexedSupplier.java:344) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.column.SimpleDictionaryEncodedColumn.getSingleValueRow(SimpleDictionaryEncodedColumn.java:65) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.segment.QueryableIndexStorageAdapter$CursorSequenceBuilder$1$1$2$1.get(QueryableIndexStorageAdapter.java:437) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.PooledTopNAlgorithm.scanAndAggregate(PooledTopNAlgorithm.java:299) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.PooledTopNAlgorithm.scanAndAggregate(PooledTopNAlgorithm.java:38) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.BaseTopNAlgorithm.run(BaseTopNAlgorithm.java:95) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNMapFn.apply(TopNMapFn.java:58) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNMapFn.apply(TopNMapFn.java:27) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNQueryEngine$1.apply(TopNQueryEngine.java:84) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.topn.TopNQueryEngine$1.apply(TopNQueryEngine.java:79) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.MappingYieldingAccumulator.accumulate(MappingYieldingAccumulator.java:57) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteringYieldingAccumulator.accumulate(FilteringYieldingAccumulator.java:69) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappingYieldingAccumulator.accumulate(MappingYieldingAccumulator.java:57) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.makeYielder(BaseSequence.java:104) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.toYielder(BaseSequence.java:81) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.ResourceClosingSequence.toYielder(ResourceClosingSequence.java:41) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteredSequence.toYielder(FilteredSequence.java:52) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.FilteredSequence.toYielder(FilteredSequence.java:52) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.ResourceClosingSequence.toYielder(ResourceClosingSequence.java:41) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.YieldingSequenceBase.accumulate(YieldingSequenceBase.java:34) ~[java-util-0.27.7.jar:?]

at io.druid.query.MetricsEmittingQueryRunner$1.accumulate(MetricsEmittingQueryRunner.java:118) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.Sequences.toList(Sequences.java:113) ~[java-util-0.27.7.jar:?]

at io.druid.query.BySegmentQueryRunner.run(BySegmentQueryRunner.java:56) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.MetricsEmittingQueryRunner$1.accumulate(MetricsEmittingQueryRunner.java:118) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2$1.call(SpecificSegmentQueryRunner.java:87) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner.doNamed(SpecificSegmentQueryRunner.java:171) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner.access$400(SpecificSegmentQueryRunner.java:41) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2.doItNamed(SpecificSegmentQueryRunner.java:162) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.spec.SpecificSegmentQueryRunner$2.accumulate(SpecificSegmentQueryRunner.java:80) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.CPUTimeMetricQueryRunner$1.accumulate(CPUTimeMetricQueryRunner.java:81) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.Sequences$1.accumulate(Sequences.java:90) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.Sequences.toList(Sequences.java:113) ~[java-util-0.27.7.jar:?]

at io.druid.query.ChainedExecutionQueryRunner$1$1$1.call(ChainedExecutionQueryRunner.java:129) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.ChainedExecutionQueryRunner$1$1$1.call(ChainedExecutionQueryRunner.java:119) ~[druid-processing-0.9.0.jar:0.9.0]

at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[?:1.7.0_75]

at io.druid.query.PrioritizedListenableFutureTask.run(PrioritizedExecutorService.java:271) ~[druid-processing-0.9.0.jar:0.9.0]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[?:1.7.0_75]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[?:1.7.0_75]

at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]

GroupBy Query Exception Log on Broker Node:

curl -H ‘Content-Type: application/json’ ‘http://uve-node128:8082/druid/v2’ -d @impressions-query.json

{“error”:“Failure getting results from[http://uve-node128:8084/druid/v2/] because of [Invalid type marker byte 0x3c for expected value token\n at [Source: java.io.SequenceInputStream@5a39aa16; line: -1, column: 1]]”}

2016-08-19T08:12:23,627 WARN [qtp226390817-112] io.druid.server.QueryResource - Exception occurred on request [GroupByQuery{dataSource=‘bo_adid’, querySegmentSpec=LegacySegmentSpec{intervals=[2016-08-13T16:00:00.000Z/2016-08-18T16:00:00.000Z]}, limitSpec=NoopLimitSpec, dimFilter=null, granularity=PeriodGranularity{period=P1D, timeZone=Asia/Shanghai, origin=null}, dimensions=[DefaultDimensionSpec{dimension=‘product’, outputName=‘product’}, DefaultDimensionSpec{dimension=‘is_unread_pool’, outputName=‘is_unread_pool’}, DefaultDimensionSpec{dimension=‘platform’, outputName=‘platform’}, DefaultDimensionSpec{dimension=‘category’, outputName=‘category’}, DefaultDimensionSpec{dimension=‘service_name’, outputName=‘service_name’}, DefaultDimensionSpec{dimension=‘version’, outputName=‘version’}, DefaultDimensionSpec{dimension=‘loadmore’, outputName=‘loadmore’}], aggregatorSpecs=[LongSumAggregatorFactory{fieldName=‘count’, name=‘impression_pv’}, HyperUniquesAggregatorFactory{name=‘impression_uv’, fieldName=‘uv’}, LongSumAggregatorFactory{fieldName=‘cardnum’, name=‘card_sum’}], postAggregatorSpecs=, havingSpec=null}]

com.metamx.common.RE: Failure getting results from[http://uve-node128:8084/druid/v2/] because of [Invalid type marker byte 0x3c for expected value token

at [Source: java.io.SequenceInputStream@98fcc5a; line: -1, column: 1]]

at io.druid.client.DirectDruidClient$JsonParserIterator.init(DirectDruidClient.java:497) ~[druid-server-0.9.0.jar:0.9.0]

at io.druid.client.DirectDruidClient$JsonParserIterator.hasNext(DirectDruidClient.java:441) ~[druid-server-0.9.0.jar:0.9.0]

at com.metamx.common.guava.BaseSequence.makeYielder(BaseSequence.java:103) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.toYielder(BaseSequence.java:81) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MergeSequence$2.accumulate(MergeSequence.java:66) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MergeSequence$2.accumulate(MergeSequence.java:62) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.YieldingAccumulators$1.accumulate(YieldingAccumulators.java:32) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.makeYielder(BaseSequence.java:104) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.toYielder(BaseSequence.java:81) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.accumulate(BaseSequence.java:67) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MergeSequence.toYielder(MergeSequence.java:59) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.LazySequence.toYielder(LazySequence.java:43) ~[java-util-0.27.7.jar:?]

at io.druid.query.RetryQueryRunner$1.toYielder(RetryQueryRunner.java:105) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.YieldingSequenceBase.accumulate(YieldingSequenceBase.java:34) ~[java-util-0.27.7.jar:?]

at io.druid.query.groupby.GroupByQueryQueryToolChest.makeIncrementalIndex(GroupByQueryQueryToolChest.java:295) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.groupby.GroupByQueryQueryToolChest.mergeGroupByResults(GroupByQueryQueryToolChest.java:239) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.groupby.GroupByQueryQueryToolChest.access$000(GroupByQueryQueryToolChest.java:85) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.groupby.GroupByQueryQueryToolChest$3.run(GroupByQueryQueryToolChest.java:134) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.FinalizeResultsQueryRunner.run(FinalizeResultsQueryRunner.java:103) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.CPUTimeMetricQueryRunner.run(CPUTimeMetricQueryRunner.java:72) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.BaseQuery.run(BaseQuery.java:151) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.BaseQuery.run(BaseQuery.java:146) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.server.QueryResource.doPost(QueryResource.java:159) [druid-server-0.9.0.jar:0.9.0]

at sun.reflect.GeneratedMethodAccessor64.invoke(Unknown Source) ~[?:?]

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_75]

at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_75]

at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409) [jersey-servlet-1.19.jar:1.19]

at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558) [jersey-servlet-1.19.jar:1.19]

at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733) [jersey-servlet-1.19.jar:1.19]

at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [javax.servlet-api-3.1.0.jar:3.1.0]

at com.google.inject.servlet.ServletDefinition.doServiceImpl(ServletDefinition.java:278) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:268) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:180) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:85) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:120) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.GuiceFilter$1.call(GuiceFilter.java:132) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.GuiceFilter$1.call(GuiceFilter.java:129) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.GuiceFilter$Context.call(GuiceFilter.java:206) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:129) [guice-servlet-4.0-beta.jar:?]

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364) [jetty-servlets-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:52) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.Server.handle(Server.java:497) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) [jetty-io-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620) [jetty-util-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540) [jetty-util-9.2.5.v20141112.jar:9.2.5.v20141112]

at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]

Caused by: com.fasterxml.jackson.core.JsonParseException: Invalid type marker byte 0x3c for expected value token

at [Source: java.io.SequenceInputStream@98fcc5a; line: -1, column: 1]

at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1419) ~[jackson-core-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:508) ~[jackson-core-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.dataformat.smile.SmileParser.nextToken(SmileParser.java:688) ~[jackson-dataformat-smile-2.4.6.jar:2.4.6]

at io.druid.client.DirectDruidClient$JsonParserIterator.init(DirectDruidClient.java:479) ~[druid-server-0.9.0.jar:0.9.0]

… 71 more

2016-08-19T08:12:23,633 ERROR [qtp226390817-112] io.druid.server.QueryResource - Exception handling request: {class=io.druid.server.QueryResource, exceptionType=class com.metamx.common.RE, exceptionMessage=Failure getting results from[http://uve-node:8084/druid/v2/] because of [Invalid type marker byte 0x3c for expected value token

at [Source: java.io.SequenceInputStream@98fcc5a; line: -1, column: 1]], exception=com.metamx.common.RE: Failure getting results from[http://uve-node128:8084/druid/v2/] because of [Invalid type marker byte 0x3c for expected value token

at [Source: java.io.SequenceInputStream@98fcc5a; line: -1, column: 1]], query=GroupByQuery{dataSource=‘bo_adid’, querySegmentSpec=LegacySegmentSpec{intervals=[2016-08-13T16:00:00.000Z/2016-08-18T16:00:00.000Z]}, limitSpec=NoopLimitSpec, dimFilter=null, granularity=PeriodGranularity{period=P1D, timeZone=Asia/Shanghai, origin=null}, dimensions=[DefaultDimensionSpec{dimension=‘product’, outputName=‘product’}, DefaultDimensionSpec{dimension=‘is_unread_pool’, outputName=‘is_unread_pool’}, DefaultDimensionSpec{dimension=‘platform’, outputName=‘platform’}, DefaultDimensionSpec{dimension=‘category’, outputName=‘category’}, DefaultDimensionSpec{dimension=‘service_name’, outputName=‘service_name’}, DefaultDimensionSpec{dimension=‘version’, outputName=‘version’}, DefaultDimensionSpec{dimension=‘loadmore’, outputName=‘loadmore’}], aggregatorSpecs=[LongSumAggregatorFactory{fieldName=‘count’, name=‘impression_pv’}, HyperUniquesAggregatorFactory{name=‘impression_uv’, fieldName=‘uv’}, LongSumAggregatorFactory{fieldName=‘cardnum’, name=‘card_sum’}], postAggregatorSpecs=, havingSpec=null}, peer=10.77.96.56}

com.metamx.common.RE: Failure getting results from[http://uve-node128:8084/druid/v2/] because of [Invalid type marker byte 0x3c for expected value token

at [Source: java.io.SequenceInputStream@98fcc5a; line: -1, column: 1]]

at io.druid.client.DirectDruidClient$JsonParserIterator.init(DirectDruidClient.java:497) ~[druid-server-0.9.0.jar:0.9.0]

at io.druid.client.DirectDruidClient$JsonParserIterator.hasNext(DirectDruidClient.java:441) ~[druid-server-0.9.0.jar:0.9.0]

at com.metamx.common.guava.BaseSequence.makeYielder(BaseSequence.java:103) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.toYielder(BaseSequence.java:81) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MappedSequence.toYielder(MappedSequence.java:46) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MergeSequence$2.accumulate(MergeSequence.java:66) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MergeSequence$2.accumulate(MergeSequence.java:62) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.YieldingAccumulators$1.accumulate(YieldingAccumulators.java:32) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.makeYielder(BaseSequence.java:104) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.toYielder(BaseSequence.java:81) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.BaseSequence.accumulate(BaseSequence.java:67) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.MergeSequence.toYielder(MergeSequence.java:59) ~[java-util-0.27.7.jar:?]

at com.metamx.common.guava.LazySequence.toYielder(LazySequence.java:43) ~[java-util-0.27.7.jar:?]

at io.druid.query.RetryQueryRunner$1.toYielder(RetryQueryRunner.java:105) ~[druid-processing-0.9.0.jar:0.9.0]

at com.metamx.common.guava.YieldingSequenceBase.accumulate(YieldingSequenceBase.java:34) ~[java-util-0.27.7.jar:?]

at io.druid.query.groupby.GroupByQueryQueryToolChest.makeIncrementalIndex(GroupByQueryQueryToolChest.java:295) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.groupby.GroupByQueryQueryToolChest.mergeGroupByResults(GroupByQueryQueryToolChest.java:239) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.groupby.GroupByQueryQueryToolChest.access$000(GroupByQueryQueryToolChest.java:85) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.groupby.GroupByQueryQueryToolChest$3.run(GroupByQueryQueryToolChest.java:134) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.FinalizeResultsQueryRunner.run(FinalizeResultsQueryRunner.java:103) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.CPUTimeMetricQueryRunner.run(CPUTimeMetricQueryRunner.java:72) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.BaseQuery.run(BaseQuery.java:151) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.query.BaseQuery.run(BaseQuery.java:146) ~[druid-processing-0.9.0.jar:0.9.0]

at io.druid.server.QueryResource.doPost(QueryResource.java:159) [druid-server-0.9.0.jar:0.9.0]

at sun.reflect.GeneratedMethodAccessor64.invoke(Unknown Source) ~[?:?]

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_75]

at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_75]

at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409) [jersey-server-1.19.jar:1.19]

at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409) [jersey-servlet-1.19.jar:1.19]

at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558) [jersey-servlet-1.19.jar:1.19]

at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733) [jersey-servlet-1.19.jar:1.19]

at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [javax.servlet-api-3.1.0.jar:3.1.0]

at com.google.inject.servlet.ServletDefinition.doServiceImpl(ServletDefinition.java:278) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:268) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:180) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:93) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:85) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:120) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.GuiceFilter$1.call(GuiceFilter.java:132) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.GuiceFilter$1.call(GuiceFilter.java:129) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.GuiceFilter$Context.call(GuiceFilter.java:206) [guice-servlet-4.0-beta.jar:?]

at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:129) [guice-servlet-4.0-beta.jar:?]

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364) [jetty-servlets-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:52) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.Server.handle(Server.java:497) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248) [jetty-server-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) [jetty-io-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:620) [jetty-util-9.2.5.v20141112.jar:9.2.5.v20141112]

at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:540) [jetty-util-9.2.5.v20141112.jar:9.2.5.v20141112]

at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]

Caused by: com.fasterxml.jackson.core.JsonParseException: Invalid type marker byte 0x3c for expected value token

at [Source: java.io.SequenceInputStream@98fcc5a; line: -1, column: 1]

at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1419) ~[jackson-core-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:508) ~[jackson-core-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.dataformat.smile.SmileParser.nextToken(SmileParser.java:688) ~[jackson-dataformat-smile-2.4.6.jar:2.4.6]

at io.druid.client.DirectDruidClient$JsonParserIterator.init(DirectDruidClient.java:479) ~[druid-server-0.9.0.jar:0.9.0]

Hi James, what version of Druid is this?

Hi, Fangjin

My Druid version is 0.9.0

Hey James,

com.metamx.common.IAE: Index[33] >= size[33] in GenericIndexed on the historical is suspicious – that could indicate a corrupted segment file or a bug in Druid. Does this error happen every time you make a particular query? Could you try to narrow it down to a specific hour? If it’s a corrupted segment, I bet only one hour will trigger that error. At that point it would be useful to look at the segments and see if/how they are corrupted (and also see if the corruption extends to the version on deep storage too, or if it’s just local to that particular historical).

The DumpSegment tool might help with that. Its docs are here: https://github.com/druid-io/druid/blob/master/docs/content/operations/dump-segment.md. You’ll need to build Druid from master to use it, since it’s not in a release yet. You may find that dumping a particular segment causes the DumpSegment tool to crash too, which would be a really good indication that something is wrong.

Hi Gian,

It’s caused by segments of a few specific hours, I’ll use the dump tool to inspect the problem, thanks.