I have a druid setup with version 0.18.1.
I wanted to know how Druid handles duplicate messages?
for example -
We just started posting events data to Kafka topic from 1st Sep and having old data in tsv file that also have data till 13th Sep.
Can you please help me in understanding that how can I create a datasource which ingest real time data from Kafka along with all old data from tsv file and store only one copy of event data from 1st Sep to 13th Sep.
Thanks & Regards