Reindex issue

Hi,

I am trying to reindex druid datasource to another existing datasource with transformation but I am getting following exceptions -

Druid Version: 0.19.0

{
“ingestionState”: “BUILD_SEGMENTS”,
“unparseableEvents”: {},
“rowStats”: {
“determinePartitions”: {
“processed”: 15211959,
“processedWithError”: 0,
“thrownAway”: 0,
“unparseable”: 0
},
“buildSegments”: {
“processed”: 15211959,
“processedWithError”: 0,
“thrownAway”: 0,
“unparseable”: 0
}
},
“errorMsg”: “java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.druid.java.util.common.ISE: Failed to publish segments because of [Invalid task locks. Maybe they are revoked by a higher priority task. Please check the overlord log for details.]\n\tat org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:983)\n\tat org.apache.druid.indexing.common.task.IndexTask.runTask(IndexTask.java:520)\n\tat org.apache.druid.indexing.common.task.AbstractBatchIndexTask.run(AbstractBatchIndexTask.java:124)\n\tat org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask.runSequential(ParallelIndexSupervisorTask.java:826)\n\tat org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask.runTask(ParallelIndexSupervisorTask.java:454)\n\tat org.apache.druid.indexing.common.task.AbstractBatchIndexTask.run(AbstractBatchIndexTask.java:124)\n\tat org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:421)\n\tat org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:393)\n\tat java.util.concurrent.FutureTask.run(Unknown Source)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)\n\tat java.lang.Thread.run(Unknown Source)\nCaused by: java.util.concurrent.ExecutionException: org.apache.druid.java.util.common.ISE: Failed to publish segments because of [Invalid task locks. Maybe they are revoked by a higher priority task. Please check the overlord log for details.]\n\tat java.util.concurrent.FutureTask.report(Unknown Source)\n\tat java.util.concurrent.FutureTask.get(Unknown Source)\n\tat org.apache.druid.indexing.common.task.IndexTask.awaitPublish(IndexTask.java:1004)\n\tat org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:955)\n\t… 11 more\nCaused by: org.apache.druid.java.util.common.ISE: Failed to publish segments because of [Invalid task locks. Maybe they are revoked by a higher priority task. Please check the overlord log for details.]\n\tat org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver.lambda$publishInBackground$8(BaseAppenderatorDriver.java:650)\n\t… 4 more\n”
}

Regards
Amit Srivastava

Hi Amit,

As the error message says to look into the overlord log for more details, Did you get a chance to look into the overlord log grepping the task_id? and find any more details?

Thanks and Regards,
Vaibhav