Some Exception for specific segments

Hi Guys,

Exception is coming on coordinator while segment is loading.

This exception is for very rare segment but it is not loading segment by historical node and results are incorrect.

2015-04-17 18:34:55,523 ERROR [Master-PeonExec–0] io.druid.server.coordinator.LoadQueuePeon - Server[/druid/loadQueue/xxx:80], throwable caught when submitting [SegmentChangeRequestLoad{segment=DataSegment{size=10928904, shardSpec=LinearShardSpec{partitionNum=64}, metrics=[numz, ], dimensions=[wer,sdg,dfh,asd,fgh zid], version=‘2015-04-17T10:00:00.000Z’, loadSpec={type=rs_zip, fileContainer=realtime_bucket, filePath=test_analytics/2015-04-17T10:00:00.000Z_2015-04-17T12:00:00.000Z/2015-04-17T10:00:00.000Z/64/index.zip}, interval=2015-04-17T10:00:00.000Z/2015-04-17T12:00:00.000Z, dataSource=‘test_analytics’, binaryVersion=‘9’}}].

org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /druid/loadQueue/104.130.220.223:80/test_analytics_2015-04-17T10:00:00.000Z_2015-04-17T12:00:00.000Z_2015-04-17T10:00:00.000Z_64

at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)

at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)

at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)

at org.apache.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:676)

at org.apache.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:660)

at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)

at org.apache.curator.framework.imps.CreateBuilderImpl.pathInForeground(CreateBuilderImpl.java:656)

at org.apache.curator.framework.imps.CreateBuilderImpl.protectedPathInForeground(CreateBuilderImpl.java:441)

at org.apache.curator.framework.imps.CreateBuilderImpl.forPath(CreateBuilderImpl.java:431)

at org.apache.curator.framework.imps.CreateBuilderImpl.forPath(CreateBuilderImpl.java:44)

at io.druid.server.coordinator.LoadQueuePeon$4.run(LoadQueuePeon.java:248)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)

at java.util.concurrent.FutureTask.run(FutureTask.java:262)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:744)

Thanks,

Jitesh Mogre

Hi Jitesh, which version of Druid is this?
In older versions that was a more known issue and fixed in the latest stable.

Got it.

I delete entry from /druid/loadQueue/xxx:80/test_analytics_2015-04-03T16:00:00.000Z_2015-04-03T18:00:00.000Z_2015-04-03T16:00:00.000Z_64 from zookeeper and it works.

What is the main reason behind it?

Thanks

Hi Jitesh,

I think you are hitting:

But depending on your Druid version, it may be another error.

What version of Druid are you running?