[druid-user] historical not loading segments from backup

TROUBLESHOOTING Google Groups
1

Hi All,

I used s3 as deep storage for storing segments and rds for metadata storage and configured the common runtime properties accordingly(including region).When I try to ingest data into druid,could see segments in s3 bucket but historical is not loading the segments(0% availability for querying).

Here are few logs:

Caused by: com.amazonaws.services.s3.model.AmazonS3Exception: The bucket is in this region: us-east-1. Please use this region to retry the request (Service: Amazon S3; Status Code: 301; Error Code: 301 Moved Permanently; Request ID: M4TXNWAQWYAF4ZET; S3 Extended Request ID: 3nNHXzSngdXQdzh2B7Xj4S0qMsoQh+ALU7BzFYeWdQuxlrwYf3kkGggAWtGyvJpqmY+gNL/HfT1gdlk+5cXHyw==; Proxy: null)

org.apache.druid.segment.loading.SegmentLocalCacheManager - Failed to load segment in current location [/opt/apache-druid-24.0.0/var/druid/segment-cache], try next location if any: {class=org.apache.druid.segment.loading.SegmentLocalCacheManager, exceptionType=class org.apache.druid.segment.loading.SegmentLoadingException, exceptionMessage=S3 fail!

Any idea about this?

2

Is the cluster itself running on a different region? If so you might need multi region access: Multi Region Access Points – Amazon S3 Features – Amazon Web Services.