[druid-user] Compaction - maxNumConcurrentSubTasks

Apache Druid Q&A Google Groups
#1

Hello Every Body,

I’m trying to compact a Datasource (67 GB) with many small segments (17k) by using 3 EC2 Machines - Data Nodes (r5d. 2xlarge) and make parallel job using all the slots (9 slots (3x3)) with this parameter (maxNumConcurrentSubTasks: 9) but it is not doing the job only 2 slots are used.

Any one have a idea about my issue ?

Thank you in advance .

imply.PNG
imply.PNG1915×325 31.4 KB

#2

Hi! Please check out the following - especially the part on compaction slot ratio :slight_smile: