Detect new data arrival from kafka into druid cluster

Hello!

I would like to know if there is a way to detect when new data is ingested in the Druid cluster without the need to be continuously doing queries. This data comes from Kafka, and I would like to run a query every time new data arrives, but I don’t know how to detect this event in an automatic way without doing any query to count the number of rows.

If more details are needed, don’t hesitate to tell me and I’ll get to it.

Thank you very much for your time

Hmmm I wonder if you could monitor the metrics on events processed instead of doing a query?

(Confession that I’ve not set up and tested this)

I think this solution could work for us. I will try it as soon as possible.

Thank you very much for your time,
Fernando.