How to specify fetchTimeout for static-s3 ingestion?


My static-s3 ingestion is timing out. I tried specifying the fetchTimeout but it is being neglected/removed when I submit the task.

Here is my configuration when I submit the task

“ioConfig” : {

“type” : “index”,

“firehose” : {

“type” : “static-s3”,

“uris”: [“S3_FILE_PATH”],

“fetchTimeout” : “111111”


“appendToExisting” : true,

“fetchTimeout” : “222222”


But when I see the payload after the task is submitted, druid removed the fetchTimeout.

“ioConfig”: {

“type”: “index”,

“firehose”: {

“type”: “static-s3”,

“uris”: [



“prefixes”: [



“appendToExisting”: true


“tuningConfig”: {

“type”: “index”,

“targetPartitionSize”: 5000000,

“maxRowsInMemory”: 75000,

“numShards”: null,

“indexSpec”: {

“bitmap”: {

“type”: “concise”


“dimensionCompression”: “lz4”,

“metricCompression”: “lz4”,

“longEncoding”: “longs”


“maxPendingPersists”: 0,

“buildV9Directly”: true,

“forceExtendableShardSpecs”: false,

“reportParseExceptions”: false,

“publishTimeout”: 0



I am getting timeout during the ingestion of s3 files…

java.lang.RuntimeException: java.util.concurrent.TimeoutException
	at$1.openObjectFromLocal( ~[druid-api-0.10.1.jar:0.10.1]
	at$ ~[druid-api-0.10.1.jar:0.10.1]
	at$ ~[druid-api-0.10.1.jar:0.10.1]
	at ~[druid-api-0.10.1.jar:0.10.1]
	at ~[druid-api-0.10.1.jar:0.10.1]
	at io.druid.indexing.common.task.IndexTask.determineShardSpecs( ~[druid-indexing-service-0.10.1.jar:0.10.1]
	at ~[druid-indexing-service-0.10.1.jar:0.10.1]
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ [druid-indexing-service-0.10.1.jar:0.10.1]
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ [druid-indexing-service-0.10.1.jar:0.10.1]
	at [?:1.8.0_151]
	at java.util.concurrent.ThreadPoolExecutor.runWorker( [?:1.8.0_151]
	at java.util.concurrent.ThreadPoolExecutor$ [?:1.8.0_151]
	at [?:1.8.0_151]
Caused by: java.util.concurrent.TimeoutException
	... 13 more

How do I specify fetchTimeout for static-s3 ingestion?



Any suggestion on this?

Can someone share a sample to specify fetchTimeout…It would be really helpful. None of my attempts have been successful so far with the timeouts…

Thanks in advance…