I am collecting data from different devices, all of which send exact same dimmenssions. The data is collected from RabbitMQ and pushed to druid through tranqulity.
The question I have is should i have individual index per device or should i put the data for all of the devices in one single index with device id as identifier for filtering.
Having individual indices for each device will enable me to delete the a specific index when corrosponding device is no longer relevent.
It will also make it easy to configure segment granularity and window period. In case of a single index the number of devices can change at anytime making it difficult to configure segment granularity properly.
But having individual index for each device will also create a job for each index, will this have an adverse effect on performance ?
Are there any guidelines / best practices to follow in this type of scenario ?