[druid-user] How to delete duplicate data

We have a situation where it seems impossible to avoid ingesting duplicate data into druid.

How can I delete duplicate data in druid?

Is enabling rollup during re-indexing something to look into? Or compaction? Looked into a couple options on the website but wanted to see if anyone had suggestions for where to look first.

Thank you.

Is this the post you are referring to?

because that might be an option on initial ingestion…