Upgrading from 0.9.2 to 0.10.0 memory issues

Apache Druid Q&A Google Groups
#1

Hey guys,

When I upgraded my druid version from 0.9.2 to 0.10.0 I could no longer have the druid running with -XX:MaxDirectMemorySize=4096m in both the broker and historical nodes.

Please adjust -XX:MaxDirectMemorySize, druid.processing.buffer.sizeBytes, druid.processing.numThreads, or druid.processing.numMergeBuffers: maxDirectMemory[4,294,967,296], memoryNeeded[5,368,709,120]

I had to change the -XX:MaxDirectMemorySize to 5120m in both nodes.

Do you guys have any idea why?

Thank you for your help!

#2

Hi Rafael,
Druid 0.10.0 defaults to the “v2” engine for groupBy rather than the legacy “v1” engine which needs additional buffers for merging.

Refer to Deployment and Configuration Changes section in the release notes -

https://github.com/druid-io/druid/releases/tag/druid-0.10.0