[druid-user] Overlord Working very slow

Based on this part of the thread dump:

“qtp1194710757-198” #198 daemon prio=5 os_prio=0 tid=0x00007ff733b0b800 nid=0x60ba runnable [0x00007ff3393d0000]

java.lang.Thread.State: RUNNABLE

at java.lang.Class.getDeclaredConstructors0(Native Method)

at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)

at java.lang.Class.getConstructors(Class.java:1651)

at org.mozilla.javascript.optimizer.Codegen.createFunctionObject(Codegen.java:105)

at org.mozilla.javascript.Context.compileImpl(Context.java:2392)

at org.mozilla.javascript.Context.compileFunction(Context.java:1376)

at org.mozilla.javascript.Context.compileFunction(Context.java:1365)

at io.druid.query.aggregation.JavaScriptAggregatorFactory.compileScript(JavaScriptAggregatorFactory.java:327)

at io.druid.query.aggregation.JavaScriptAggregatorFactory.(JavaScriptAggregatorFactory.java:88)

it looks like you’re seeing the issue fixed in PR https://github.com/apache/incubator-druid/pull/4871, which was added in 0.12.0.

I would recommend upgrading to 0.13.0-incubating instead, or at least 0.12.3.

Using the above fix we were able to solve the javascript initialisation error but after upgrading to druid 0.11.0 we have been facing issues with tranquility

During the start of new tasks message were being dropped

To fix that issue we used below conf

druidBeam.firehoseQuietPeriod Wait this long for a task to appear before complaining that it cannot be found. PT1M
druidBeam.firehoseRetryPeriod Retry for this long before complaining that events could not be pushed PT1M
druidBeam.indexRetryPeriod If an indexing service overlord call fails for some apparently-transient reason, retry for this long before giving up.

and set it to PT5M

still either messages are dropped or we are getting duplicates messages (using tranquility 0.8.1)

can you guys recommend any config changes needed to be done on overlord or tranquility to avoid this message loss or duplication

(This things are happening only at the start or the end of the hour).