How can I resolve this issue

ingDimensionMergerV9 - Completed dim[DOT_ID_RA] conversions with cardinality[8] in 0 millis.
2019-06-14T11:46:25,455 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[IATA_CRA] conversions with cardinality[8] in 0 millis.
2019-06-14T11:46:26,369 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[Tail_Number] conversions with cardinality[1,240] in 914 millis.
2019-06-14T11:46:29,953 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[Fnra] conversions with cardinality[3,872] in 3,584 millis.
2019-06-14T11:46:30,843 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[Origin] conversions with cardinality[228] in 890 millis.
2019-06-14T11:46:30,845 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[OriginCityName] conversions with cardinality[228] in 2 millis.
2019-06-14T11:46:31,731 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[OriginState] conversions with cardinality[210] in 886 millis.
2019-06-14T11:46:31,733 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[OriginStateFips] conversions with cardinality[228] in 2 millis.
2019-06-14T11:46:31,735 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[OriginStateName] conversions with cardinality[224] in 2 millis.
2019-06-14T11:46:31,735 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[OriginWac] conversions with cardinality[52] in 0 millis.
2019-06-14T11:46:31,736 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DestAirportID] conversions with cardinality[52] in 1 millis.
2019-06-14T11:46:31,736 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DestAirportSeqID] conversions with cardinality[52] in 0 millis.
2019-06-14T11:46:31,737 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DestCityMarketID] conversions with cardinality[52] in 1 millis.
2019-06-14T11:46:32,625 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[Dest] conversions with cardinality[230] in 888 millis.
2019-06-14T11:46:32,627 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DestCityName] conversions with cardinality[230] in 2 millis.
2019-06-14T11:46:33,520 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DestState] conversions with cardinality[212] in 893 millis.
2019-06-14T11:46:33,522 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DestStateFips] conversions with cardinality[230] in 2 millis.
2019-06-14T11:46:34,414 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DestStateName] conversions with cardinality[226] in 892 millis.
2019-06-14T11:46:34,414 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DestWac] conversions with cardinality[52] in 0 millis.
2019-06-14T11:46:34,415 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[CRSDepTime] conversions with cardinality[52] in 1 millis.
2019-06-14T11:46:34,415 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DepTime] conversions with cardinality[52] in 0 millis.
2019-06-14T11:46:34,416 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DepDelay] conversions with cardinality[52] in 0 millis.
2019-06-14T11:46:36,200 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DepDelayMinutes] conversions with cardinality[904] in 1,784 millis.
2019-06-14T11:46:38,849 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DepDel15] conversions with cardinality[1,045] in 2,649 millis.
2019-06-14T11:46:38,850 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DepartureDelayGroups] conversions with cardinality[158] in 1 millis.
2019-06-14T11:46:39,752 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[DepTimeBlk] conversions with cardinality[134] in 1 millis.
2019-06-14T11:46:39,753 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[TaxiOut] conversions with cardinality[3] in 0 millis.
2019-06-14T11:46:39,753 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[WheelsOff] conversions with cardinality[16] in 0 millis.
2019-06-14T11:46:39,754 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[WheelsOn] conversions with cardinality[19] in 1 millis.
2019-06-14T11:46:39,755 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[TaxiIn] conversions with cardinality[69] in 1 millis.
2019-06-14T11:46:43,295 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[CRSArrTime] conversions with cardinality[1,071] in 3,540 millis.
2019-06-14T11:46:46,842 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[ArrTime] conversions with cardinality[1,099] in 3,547 millis.
2019-06-14T11:46:46,843 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[ArrDelay] conversions with cardinality[47] in 1 millis.
2019-06-14T11:46:50,385 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[ArrDelayMinutes] conversions with cardinality[1,064] in 3,542 millis.
Terminating due to java.lang.OutOfMemoryError: GC overhead limit exceeded
2019-06-14T11:46:54,697 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[ArrDel15] conversions with cardinality[1,085] in 4,310 millis.
2019-06-14T11:46:54,698 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[ArrivalDelayGroups] conversions with cardinality[195] in 1 millis.
2019-06-14T11:46:54,700 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[ArrTimeBlk] conversions with cardinality[136] in 1 millis.
2019-06-14T11:46:54,700 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[Cancelled] conversions with cardinality[3] in 0 millis.
2019-06-14T11:46:54,700 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[CancellationCode] conversions with cardinality[16] in 0 millis.
2019-06-14T11:46:54,701 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[CRSElapsedTime] conversions with cardinality[19] in 1 millis.
2019-06-14T11:46:54,701 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[ActualElapsedTime] conversions with cardinality[2] in 0 millis.
2019-06-14T11:46:54,701 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[AirTime] conversions with cardinality[4] in 0 millis.
2019-06-14T11:46:54,702 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[Flights] conversions with cardinality[2] in 0 millis.
2019-06-14T11:46:54,705 INFO [flight-incremental-persist] org.apache.druid.segment.StringDimensionMergerV9 - Completed dim[Distance] conversions with cardinality[339] in 3 millis.
2019-06-14T11:46:54,705 INFO [flight-incremental-persist] org.apache.druid.segment.IndexMergerV9 - Completed dim conversions in 30,156 millis.

Umar,

I didn’t see in the pasted log the errors or exception. What was the issue?

Rommel Garcia

Terminating due to java.lang.OutOfMemoryError: GC overhead limit exceeded

While loading 16GB of data into druid after 20 to 30 minutes this error occur

You might want to increase your heap for MiddleManager. What’s your current setting?

Rommel Garcia
Director, Field Engineering
rommel.garcia@imply.io
404.502.9672

-server
-Xms1024m
-Xmx1024m
-XX:+ExitOnOutOfMemoryError
-Duser.timezone=UTC
-Dfile.encoding=UTF-8
-Djava.io.tmpdir=var/tmp
-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager

This is jvm.config of
 middlemanager.

Try using 10GB.

Rommel Garcia

Director, Field Engineering

To add to what Rommel said, you’ll want to adjust the Java heap settings in druid.indexer.runner.javaOpts in your middle manager runtime properties, this property controls the JVM settings of the task processes spawned by the middle manager

I have 8gb ram in my druid cluster. so how can I use 10gb?

If you’re not able to increase your hardware, then you would want to shrink the size of your task (e.g., ingest fewer rows in a single task for batch tasks)