1.0 GB of 1 GB physical memory used; 1.6 GB

when i use hadoopindex run in hadoop

the datasite is 200M, I can’t change hadoop config,

for logs

Dump of the process-tree for container_1441868672695_9071_01_000006 :

  • PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
  • 44110 21550 44110 44110 (bash) 2 5 108646400 304 /bin/bash -c /usr/java/jdk1.7.0_67-cloudera/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Djava.net.preferIPv4Stack=true -Xmx825955249 -Djava.io.tmpdir=/data/yarn/nm/usercache/root/appcache/application_1441868672695_9071/container_1441868672695_9071_01_000006/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/var/log/hadoop-yarn/container/application_1441868672695_9071/container_1441868672695_9071_01_000006 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 10.200.8.85 48147 attempt_1441868672695_9071_r_000000_2 6 1>/var/log/hadoop-yarn/container/application_1441868672695_9071/container_1441868672695_9071_01_000006/stdout 2>/var/log/hadoop-yarn/container/application_1441868672695_9071/container_1441868672695_9071_01_000006/stderr
  • 44351 44110 44110 44110 (java) 24636 878 1652879360 266731 /usr/java/jdk1.7.0_67-cloudera/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Djava.net.preferIPv4Stack=true -Xmx825955249 -Djava.io.tmpdir=/data/yarn/nm/usercache/root/appcache/application_1441868672695_9071/container_1441868672695_9071_01_000006/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/var/log/hadoop-yarn/container/application_1441868672695_9071/container_1441868672695_9071_01_000006 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA org.apache.hadoop.mapred.YarnChild 10.200.8.85 48147 attempt_1441868672695_9071_r_000000_2 6

Container killed on request. Exit code is 143

Container exited with a non-zero exit code 143

2015-11-27T09:10:46,441 INFO [main] org.apache.hadoop.mapreduce.Job - map 100% reduce 0%

2015-11-27T09:10:59,642 INFO [main] org.apache.hadoop.mapreduce.Job - map 100% reduce 67%

2015-11-27T09:11:06,279 INFO [main] org.apache.hadoop.mapreduce.Job - map 100% reduce 68%

2015-11-27T09:11:11,778 INFO [main] org.apache.hadoop.mapreduce.Job - map 100% reduce 69%

2015-11-27T09:11:18,479 INFO [main] org.apache.hadoop.mapreduce.Job - map 100% reduce 70%

2015-11-27T09:12:14,644 INFO [main] org.apache.hadoop.mapreduce.Job - map 100% reduce 100%

2015-11-27T09:12:15,961 INFO [main] org.apache.hadoop.mapreduce.Job - Job job_1441868672695_9071 failed with state FAILED due to: Task failed task_1441868672695_9071_r_000000

Job failed as tasks failed. failedMaps:0 failedReduces:1

2015-11-27T09:12:16,030 INFO [main] org.apache.hadoop.mapreduce.Job - Counters: 37

File System Counters

FILE: Number of bytes read=181634821

FILE: Number of bytes written=367230288

FILE: Number of read operations=0

FILE: Number of large read operations=0

FILE: Number of write operations=0

HDFS: Number of bytes read=227985961

HDFS: Number of bytes written=0

HDFS: Number of read operations=6

HDFS: Number of large read operations=0

HDFS: Number of write operations=0

Job Counters

Failed reduce tasks=4

Launched map tasks=2

Launched reduce tasks=4

Data-local map tasks=2

Total time spent by all maps in occupied slots (ms)=102859

Total time spent by all reduces in occupied slots (ms)=303891

Total time spent by all map tasks (ms)=102859

Total time spent by all reduce tasks (ms)=303891

Total vcore-seconds taken by all map tasks=102859

Total vcore-seconds taken by all reduce tasks=303891

Total megabyte-seconds taken by all map tasks=105327616

Total megabyte-seconds taken by all reduce tasks=151945500

Map-Reduce Framework

Map input records=969540

Map output records=969540

Map output bytes=564465565

Map output materialized bytes=185203083

Input split bytes=582

Combine input records=0

Spilled Records=1939080

Failed Shuffles=0

Merged Map outputs=0

GC time elapsed (ms)=1440

CPU time spent (ms)=126360

Physical memory (bytes) snapshot=1416597504

Virtual memory (bytes) snapshot=3146600448

Total committed heap usage (bytes)=1648885760

File Input Format Counters

Bytes Read=0

2015-11-27T09:12:16,108 INFO [main] io.druid.indexer.JobHelper - Deleting path[/data/druid_hadoop/playrawdata_hadoop/2015-11-27T085950.334+0800]

2015-11-27T09:12:16,215 ERROR [main] io.druid.cli.CliHadoopIndexer - failure!!!

java.lang.reflect.InvocationTargetException

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_79]

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_79]

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_79]

at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_79]

at io.druid.cli.CliHadoopIndexer.run(CliHadoopIndexer.java:120) [druid-services-0.8.1.jar:0.8.1]

at io.druid.cli.Main.main(Main.java:91) [druid-services-0.8.1.jar:0.8.1]

Caused by: com.metamx.common.ISE: Job[class io.druid.indexer.LegacyIndexGeneratorJob] failed!

at io.druid.indexer.JobHelper.runJobs(JobHelper.java:202) ~[druid-indexing-hadoop-0.8.1.jar:0.8.1]

at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:96) ~[druid-indexing-hadoop-0.8.1.jar:0.8.1]

at io.druid.indexer.JobHelper.runJobs(JobHelper.java:182) ~[druid-indexing-hadoop-0.8.1.jar:0.8.1]

at io.druid.cli.CliInternalHadoopIndexer.run(CliInternalHadoopIndexer.java:132) ~[druid-services-0.8.1.jar:0.8.1]

at io.druid.cli.Main.main(Main.java:91) ~[druid-services-0.8.1.jar:0.8.1]

… 6 more