io.druid.java.util.common.ISE: Offset Error

Hi Team,

Was getting below error today (have not seen this earlier). Does anyone know what this could be about ?

2017-04-25T14:43:30,316 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[

KafkaIndexTask{id=index_kafka_DSLAM_41554612951ca12_kafhgaig, type=index_kafka, dataSource=DSLAM}]

io.druid.java.util.common.ISE: WTF?! Got offset[3,250,875,251] after offset[3,250,875,222] in partition[0].

at io.druid.indexing.kafka.KafkaIndexTask.run(KafkaIndexTask.java:410) ~[?:?]

at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-index

ing-service-0.10.0.jar:0.10.0]

at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-index

ing-service-0.10.0.jar:0.10.0]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_91]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_91]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_91]

at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]

2017-04-25T14:43:30,325 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_kafka_DSLAM_41554612951

ca12_kafhgaig] status changed to [FAILED].

2017-04-25T14:43:30,328 INFO [task-runner-0-priority-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status

: {

Regards,

Arpan Khagram

Hey Arpan,

That means there was an unexpected gap in the message offsets, which upsets the Kafka task because it’s expecting to get messages in order.

Is this by chance a compacted topic, or are you using MapR Streams instead of Kafka? (offset gaps could be possible with both of those situations)

Hi Gian, We are using Apache KAFKA for streams - yes we found out some issues with apache kafka it was’t stable. We faced one of the bug of apache kafka although we are using the latest version 0.10.2.0.

https://issues.apache.org/jira/browse/KAFKA-4477

Regards,

Arpan Khagram