Task failure due to offset error

Hi All,

  Tasks failing with this below offset error. I have

applied reset for the tasks But still
the tasks are showing the same error. Please suggest how to proceed

PFA the error for task logs

2019-07-11T13:50:06,638 DEBUG
[main-SendThread(xx.xx.xx.xx:2181)] org.apache.zookeeper.ClientCnxn - Reading
reply sessionid:0x16bdf50b6fe266b, packet:: clientPath:null serverPath:null
finished:false header:: 566,14
replyHeader:: 566,32250831,0
request:: org.apache.zookeeper.MultiTransactionRecord@1823b76b
response:: org.apache.zookeeper.MultiResponse@25

2019-07-11T13:50:06,638 ERROR [task-runner-0-priority-0]
org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner -
Encountered exception while running task.

org.apache.druid.java.util.common.ISE:
WTF?! Got offset[70,501,467] after offset[70,501,468] in partition[0].

at
org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner.runInternal(IncrementalPublishingKafkaIndexTaskRunner.java:484)
~[druid-kafka-indexing-service-0.13.0-incubating.jar:0.13.0-incubating]

at
org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner.run(IncrementalPublishingKafkaIndexTaskRunner.java:232)
[druid-kafka-indexing-service-0.13.0-incubating.jar:0.13.0-incubating]

at
org.apache.druid.indexing.kafka.KafkaIndexTask.run(KafkaIndexTask.java:210)
[druid-kafka-indexing-service-0.13.0-incubating.jar:0.13.0-incubating]

at
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:421)
[druid-indexing-service-0.13.0-incubating.jar:0.13.0-incubating]

at
org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:393)
[druid-indexing-service-0.13.0-incubating.jar:0.13.0-incubating]

at
java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_152]

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_152]

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_152]

at
java.lang.Thread.run(Thread.java:748) [?:1.8.0_152]

2019-07-11T13:50:06,639 DEBUG [Announcer-0]
org.apache.druid.curator.anno

Thanks in Advance

Hi Praveen:

How did you reset the Kafka supervisor ?

And have you tried setting “resetOffsetAutomatically” property? https://druid.apache.org/docs/latest/development/extensions-core/kafka-ingestion

Hope this helps

Hi Ming

I have already tried reset of kafka supervisor for that data source using below command . But still I am getting the same error. Is there any other way, I can solve this issue?

POST /druid/indexer/v1/supervisor/<supervisorId>/reset

Note : “resetOffsetAutomatically”: true option is already present in tuningConfig ingestion specs of the task

Thanks in advance