Druid Kafka Ingestion Tasks killed (Druid 0.14.2). No error seen in logs

Hi Team,

I am seeing an issue with Druid (0.14.2) Kafka ingestion tasks killed, although I do not see any error in task logs. However on overlord, I see the below logs, and after some time the tasks are killed.

2020-09-11 08:27:51,664 INFO o.a.d.i.s.SeekableStreamIndexTaskClient [IndexTaskClient-test-0] Still waiting for task [index_test_9b78a1080f41e19_gmmhdkoc] to change its status to [PAUSED]; will try again in [PT2S]

2020-09-11 08:27:51,670 INFO o.a.d.i.s.SeekableStreamIndexTaskClient [IndexTaskClient-test-7] Still waiting for task [index_kafka_test__7e5327874b5dd24_aabkfdon] to change its status to [PAUSED]; will try again in [PT2S]

2020-09-11 08:27:51,677 INFO o.a.d.i.s.SeekableStreamIndexTaskClient [IndexTaskClient-test-4] Still waiting for task [index_kafka_test__9aa214a0abac242_dijfhnlo] to change its status to [PAUSED]; will try again in [PT2S]

2020-09-11 08:27:51,677 INFO o.a.d.i.s.SeekableStreamIndexTaskClient [IndexTaskClient-test-1] Still waiting for task [index_kafka_test__aaaa0019acb892f_ollipaii] to change its status to [PAUSED]; will try again in [PT2S]

Did someone face this issue, what might be causing this and what action needs to be taken to resolve this?

Regards,

Vinay Patil

Hi Team,

Could someone please help me with this error?

Regards,
Vinay Patil

Hi Vinay, I’m a developer evangelist with Imply and I wanted you to know that I’ve seen your question and am working to get you an answer. Thanks, Matt

Hi Vinay,

Looking at the log statement seems like a suspend or terminate is called on the supervisor and the supervisor is in turn asking the tasks to be paused. If that’s not the case, the only reason I could think off is that the task went unresponsive. Couple of things to check:

One of those should help to address the issue.

Let me know if I can be of further assistance,
Matt