Warning on Historical Node

Hi,

I am getting an warning on my Historical node as below.

2019-03-21T10:26:28,811 WARN [qtp1977493952-19-acceptor-0@2f54ebd5-ServerConnector@348137e8{HTTP/1.1,[http/1.1]}{0.0.0.0:8083}] org.eclipse.jetty.server.AbstractConnector -

java.nio.channels.ClosedSelectorException

at sun.nio.ch.SelectorImpl.keys(SelectorImpl.java:68) ~[?:1.8.0_152]

at org.eclipse.jetty.io.ManagedSelector.size(ManagedSelector.java:104) ~[jetty-io-9.3.16.v20170120.jar:9.3.16.v20170120]

at org.eclipse.jetty.io.SelectorManager.chooseSelector(SelectorManager.java:190) ~[jetty-io-9.3.16.v20170120.jar:9.3.16.v20170120]

at org.eclipse.jetty.io.SelectorManager.accept(SelectorManager.java:232) ~[jetty-io-9.3.16.v20170120.jar:9.3.16.v20170120]

at org.eclipse.jetty.io.SelectorManager.accept(SelectorManager.java:217) ~[jetty-io-9.3.16.v20170120.jar:9.3.16.v20170120]

at org.eclipse.jetty.server.ServerConnector.accepted(ServerConnector.java:383) ~[jetty-server-9.3.16.v20170120.jar:9.3.16.v20170120]

at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:374) ~[jetty-server-9.3.16.v20170120.jar:9.3.16.v20170120]

at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) [jetty-server-9.3.16.v20170120.jar:9.3.16.v20170120]

at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) [jetty-util-9.3.16.v20170120.jar:9.3.16.v20170120]

at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) [jetty-util-9.3.16.v20170120.jar:9.3.16.v20170120]

at java.lang.Thread.run(Thread.java:748) [?:1.8.0_152]

After getting this warning i am seeing my broker service is not receiving any response from historical node and giving error after which i do not receive any response in my REST layer which is calling my druid broker.

o.druid.java.util.common.RE: Failure getting results from[http://x.x.x.x:8083/druid/v2/] because of [org.jboss.netty.handler.timeout.ReadTimeoutException]

at io.druid.client.DirectDruidClient$JsonParserIterator.init(DirectDruidClient.java:489) ~[druid-server-0.10.0.jar:0.10.0]

at io.druid.client.DirectDruidClient$JsonParserIterator.hasNext(DirectDruidClient.java:439) ~[druid-server-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.BaseSequence.makeYielder(BaseSequence.java:88) ~[java-util-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.BaseSequence.toYielder(BaseSequence.java:68) ~[java-util-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.MappedSequence.toYielder(MappedSequence.java:49) ~[java-util-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.MergeSequence$2.accumulate(MergeSequence.java:70) ~[java-util-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.MergeSequence$2.accumulate(MergeSequence.java:66) ~[java-util-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.BaseSequence.accumulate(BaseSequence.java:46) ~[java-util-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.MergeSequence.toYielder(MergeSequence.java:63) ~[java-util-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.LazySequence.toYielder(LazySequence.java:46) ~[java-util-0.10.0.jar:0.10.0]

at io.druid.query.RetryQueryRunner$1.toYielder(RetryQueryRunner.java:108) ~[druid-processing-0.10.0.jar:0.10.0]

at io.druid.java.util.common.guava.YieldingSequenceBase.accumulate(YieldingSequenceBase.java:32) ~[java-util-0.10.0.jar:0.10.0]

I am making multiple request on druid broker in a loop with a small threshold for getting a huge set of data. Currently i am using 50000 as my threshold.

Any help is appreciated.

regards,

Akhilesh