I have been seeing failures with Kafka Ingestion. The tasks are in ‘Failed’
state. The supervisor is in ‘UNHEALTHY’ state. The ingestion is not complete and none of the new tasks are successful.
I have my doubts on the consistent logging of ‘Flushed in-memory data for segment …’ but I am not sure what to make out of it. Attached Log for reference.
The configuration is ‘conf/druid/single-server/micro-quickstart’ . The machine has 8GB ram. There is enough space on HDD to assimilate data. Historical usage in only 0.5% at the moment.
Please help to debug this. Thanks for your time.
(Attachment index_kafka_tbt_data2_690d6435b564613_cihaeipo.log is missing)