kafkaIndexer task..worked briefly..than..stopped?

Being a ‘complete’ noob here…

Yesterday I was able to get the do bulk load of my data (kafka->disk->druid). :slight_smile:

Today I’m attempting to tackle process->kafka->druid.

I had it working briefly…

I then stopped my process->kafka for a bit…then restarted process->kafka

now I no longer see data getting loaded into druid…

looking at the logs I see:

2019-02-06T18:00:05,246 WARN [KafkaSupervisor-teststuff-Reporting-0] io.druid.indexing.kafka.supervisor.KafkaSupervisor - Lag metric: Kafka partitions [0, 1, 2] do not match task partitions
2019-02-06T18:00:10,261 INFO [KafkaIndexTaskClient-teststuff-0] io.druid.indexing.kafka.KafkaIndexTaskClient - No TaskLocation available for task [index_kafka_teststuff_4b31d20e8614bdd_paggmkhf], this task may not have been assigned to a worker yet or may have already completed
2019-02-06T18:00:10,263 INFO [KafkaSupervisor-teststuff] io.druid.indexing.kafka.supervisor.KafkaSupervisor - {id=‘teststuff’, generationTime=2019-02-06T18:00:10.263Z, payload={dataSource=‘teststuff’, topic=‘gdi.sms.messages’, partitions=3, replicas=1, durationSeconds=600, active=[{id=‘index_kafka_teststuff_4b31d20e8614bdd_paggmkhf’, startTime=null, remainingSeconds=null}], publishing=[{id=‘index_kafka_teststuff_4b31d20e8614bdd_jogimiin’, startTime=2019-02-06T17:33:52.314Z, remainingSeconds=223}]}}
2019-02-06T18:00:25,247 INFO [KafkaIndexTaskClient-teststuff-0] io.druid.indexing.kafka.KafkaIndexTaskClient - No TaskLocation available for task [index_kafka_teststuff_4b31d20e8614bdd_paggmkhf], this task may not have been assigned to a worker yet or may have already completed
2019-02-06T18:00:25,249 INFO [KafkaIndexTaskClient-teststuff-0] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://wdc-tst-bdrd-003.openmarket.com:8101
2019-02-06T18:00:40,260 INFO [KafkaIndexTaskClient-teststuff-0] io.druid.indexing.kafka.KafkaIndexTaskClient - No TaskLocation available for task [index_kafka_teststuff_4b31d20e8614bdd_paggmkhf], this task may not have been assigned to a worker yet or may have already completed
2019-02-06T18:00:40,263 INFO [KafkaSupervisor-teststuff] io.druid.indexing.kafka.supervisor.KafkaSupervisor - {id=‘teststuff’, generationTime=2019-02-06T18:00:40.263Z, payload={dataSource=‘teststuff’, topic=‘gdi.sms.messages’, partitions=3, replicas=1, durationSeconds=600, active=[{id=‘index_kafka_teststuff_4b31d20e8614bdd_paggmkhf’, startTime=null, remainingSeconds=null}], publishing=[{id=‘index_kafka_teststuff_4b31d20e8614bdd_jogimiin’, startTime=2019-02-06T17:33:52.314Z, remainingSeconds=193}]}}
2019-02-06T18:00:55,247 INFO [KafkaIndexTaskClient-teststuff-0] io.druid.indexing.kafka.KafkaIndexTaskClient - No TaskLocation available for task [index_kafka_teststuff_4b31d20e8614bdd_paggmkhf], this task may not have been assigned to a worker yet or may have already completed
2019-02-06T18:00:55,251 INFO [KafkaIndexTaskClient-teststuff-0] io.druid.java.util.http.client.pool.ChannelResourceFactory - Generating: http://wdc-tst-bdrd-003.openmarket.com:8101
2019-02-06T18:01:00,839 INFO [TaskQueue-StorageSync] io.druid.indexing.overlord.TaskQueue - Synced 2 tasks from storage (0 tasks added, 0 tasks removed).

``

I am running druid 0.12.1.

This may the same issue as:

https://groups.google.com/forum/#!searchin/druid-user/"no$20tasklocation$20available"|sort:date/druid-user/4xUE39ow6C0/v5FaOARTCAAJ

Thoughts?

well…it start working again…without me doing anything…

I’m thinking maybe because data wasn’t being loaded into kafka…for a brief period…it caused the ‘kafka-indexor’ to report/appear to fail for a bit?

Essentially I see 2 Kafka tasks listed as failed, (the first one has a log), the second one…if attempt to look at the log…it fails…saying:

No log was found for this task. The task may not exist, or it may not have begun running yet.