Could someone explain who the memory is managed in Broker, JVM [Heap, Off Heap] ?
No detailed information in docs as compared to historicals.
We are running into Broker being crashed on more query load , we are suspecting its because of the memory configurations, so we want to understand how the memory is distributed and what all attributes govern memory for broker node.
Following is our configuration :
-Xmx22g -Xms22g -XX:NewSize=7g -XX:MaxNewSize=7g -XX:MaxDirectMemorySize=20g
druid.processing.buffer.sizeBytes=1073741823 (1 GB)
#setting following value to 2GB -1, as setting the value to 2GB is causing a runtime exception
total used free shared buff/cache available
Mem: 29G 12G 15G 1.5G 1.8G 15G
Swap: 0B 0B 0B
What is wrong here ?
NOTE : If reduce the druid.processing.buffer.sizeBytes to hundred MB, same set of queries seems to be working.