Removing insert-segment-to-db

Hi all,

I recently raised a proposal for consolidated segment metadata management (https://github.com/apache/incubator-druid/issues/6849). Druid currently stores segment metadata in two places, i.e., metadata store and deep storage. In metadata store, it’s stored in druid_segments table. In deep storage, it’s stored in descriptor.json file.

This can make metadata management complex. First of all, it’s not easy to keep them synched always. Another known issue is that this makes deep storage migration more complicated.

https://github.com/apache/incubator-druid/issues/6849 is to store segment metadata information in only deep storage. As a result, insert-segment-to-db would be also removed if the proposal is accepted because it depends on descriptor.json file.

Please take a look at the proposal and tell us if you have any issue with this.

Best,

Jihoon