As the subject says, when I migrate HDFS segments data from one cluster to another cluster, I use insert-segment-db tool, but the loading process is too slow!
As in coordinator UI snapshot, I have almost 4000 segments with almost two versions. The duration has almost 2 days!
I see the coordinator log, it seems like that the insert-segment-db tool inserts all segments’ metadata to mysql with every versions, maybe it slows down the processing time.
Does anyone have some benchmark or any time result on insert-segment-db tool?
My druid cluster has three historical node with 24 cores and 128G memory.