Drop support for insert-segment-to-db tool: What is the alternative?

Hi folks,

Currently, I sometime use insert-segment-to-db to migrate several segments to another Druid cluster.

It can save the time and resources needed to reindex.

It seems that It’s no way to migrate segment If I upgrade my cluster to 0.15.

It’s only way to reproduce segment is batch-indexing with raw text(csv or else) file? It’s needed to maintain whole raw file and reindex when I needed?

Is there any other way to migrate segment?

Thanks,

Dongkyu

To migrate segments, the steps are:

  1. copy segments from the old deep storage location to the new one

  2. export the druid_segments table from your old cluster

  3. rewrite the LoadSpec fields in the segments to point to the new deep storage location

  4. reimport the rewritten druid_segments table to the new cluster

https://github.com/apache/incubator-druid/blob/master/docs/content/operations/metadata-migration.md and https://github.com/apache/incubator-druid/blob/master/services/src/main/java/org/apache/druid/cli/ExportMetadata.java can give you an idea of what’s involved.