Deep storage migration to a new GCS bucket

Apache Druid Q&A Google Groups
#1

Hi all,

We are using GCS as a deep-storage, using the google extension and would like to migrate to a new GCS bucket.

We updated the configuration and also rewritten the metadata in the druid_segments table along with the migration of the bucket. We followed the recommendations from here:

However, Druid still continues to save the new data to old bucket and continues using the old bucket instead of a new one. Is there anything else that needs changing/updating?

Thanks,
Radek

#2

Hi Radek,

Have you changed the configs in common.runtime.properties to reflect updated bucket, https://druid.apache.org/docs/latest/development/extensions-core/google.html
Did you restart the processes ?

#3

Hi,

Thanks for your help. In the end it turned out to be an issue with our auto-scalable middle managers, which used the previous config while all other servers were on a new config.

Cheers,
Radek