I’m ingesting CSV files using a single middle manager with Peons.
If I submit two index tasks for the same datasource and the same interval e.g. two files with data for 1997-01-01. Does the second task ‘overwrite’ the first? I can see many instances in my datasource where I’m sure data has been ingested, but a select query for that day only shows some of the data, all from the second file?
Is there another way to do this? Perhaps I should be using the append task?