I managed druid cluster, and one datasource have 20G per minute.
How to calculate the number of tranquility and task.partitions in tranquility spec.
Now I just write task.partitions=12 and run 6 tranquility.
Could I know how to calculate this config and to decide the number of tranquility??
I usually use the (very scientific) method of picking something that seems reasonable and then adjusting it up or down based on how well it works. You need to adjust it up if your ingestion can’t keep up, and you could adjust it down if all your tranquility processes have very low CPU usage.
Thank you for replying.
I also adjust the number of tranquility and partition depending on the resources like memory, cpu usage.
I think there is formula about how many tranquility is needed, and how many partition is needed.
What do you think about my opinion?
2018년 3월 1일 목요일 오후 3시 13분 49초 UTC+9, Gian Merlino 님의 말:
There might be a nice formula, but if there is then I have not figured it out yet!