File /tmp/druid-indexing/logdata_format/xxxx/segmentDescriptorInfo does not exist

Hi,
When I run druid by indexing service with index hadoop type,I got some errors:

[druid-indexing-service-0.8.0.jar:0.8.0]

	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [?:1.7.0_04]
	at java.util.concurrent.FutureTask.run(FutureTask.java:166) [?:1.7.0_04]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [?:1.7.0_04]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [?:1.7.0_04]
	at java.lang.Thread.run(Thread.java:722) [?:1.7.0_04]
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_04]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_04]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_04]
	at java.lang.reflect.Method.invoke(Method.java:601) ~[?:1.7.0_04]
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:129) ~[druid-indexing-service-0.8.0.jar:0.8.0]
	... 8 more
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: File /tmp/druid-indexing/logdata_format/2015-07-23T185255.855+0800/segmentDescriptorInfo does not exist.
	at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?]
	at io.druid.indexer.IndexGeneratorJob.getPublishedSegments(IndexGeneratorJob.java:101) ~[druid-indexing-hadoop-0.8.0.jar:0.8.0]
	at io.druid.indexer.HadoopDruidIndexerJob$1.run(HadoopDruidIndexerJob.java:89) ~[druid-indexing-hadoop-0.8.0.jar:0.8.0]
	at io.druid.indexer.JobHelper.runJobs(JobHelper.java:179) ~[druid-indexing-hadoop-0.8.0.jar:0.8.0]
	at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:96) ~[druid-indexing-hadoop-0.8.0.jar:0.8.0]
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopIndexGeneratorInnerProcessing.runTask(HadoopIndexTask.java:241) ~[druid-indexing-service-0.8.0.jar:0.8.0]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_04]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_04]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_04]
	at java.lang.reflect.Method.invoke(Method.java:601) ~[?:1.7.0_04]
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:129) ~[druid-indexing-service-0.8.0.jar:0.8.0]
	... 8 more
Caused by: java.io.FileNotFoundException: File /tmp/druid-indexing/logdata_format/2015-07-23T185255.855+0800/segmentDescriptorInfo does not exist.
	at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:697) ~[hadoop-hdfs-2.6.0-cdh5.4.0.jar:?]
	at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:105) ~[hadoop-hdfs-2.6.0-cdh5.4.0.jar:?]
	at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:755) ~[hadoop-hdfs-2.6.0-cdh5.4.0.jar:?]
	at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:751) ~[hadoop-hdfs-2.6.0-cdh5.4.0.jar:?]
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) ~[hadoop-common-2.6.0-cdh5.4.0.jar:?]
	at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:751) ~[hadoop-hdfs-2.6.0-cdh5.4.0.jar:?]
	at io.druid.indexer.IndexGeneratorJob.getPublishedSegments(IndexGeneratorJob.java:94) ~[druid-indexing-hadoop-0.8.0.jar:0.8.0]
	at io.druid.indexer.HadoopDruidIndexerJob$1.run(HadoopDruidIndexerJob.java:89) ~[druid-indexing-hadoop-0.8.0.jar:0.8.0]
	at io.druid.indexer.JobHelper.runJobs(JobHelper.java:179) ~[druid-indexing-hadoop-0.8.0.jar:0.8.0]
	at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:96) ~[druid-indexing-hadoop-0.8.0.jar:0.8.0]
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopIndexGeneratorInnerProcessing.runTask(HadoopIndexTask.java:241) ~[druid-indexing-service-0.8.0.jar:0.8.0]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_04]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_04]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_04]
	at java.lang.reflect.Method.invoke(Method.java:601) ~[?:1.7.0_04]
	at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:129) ~[druid-indexing-service-0.8.0.jar:0.8.0]
	... 8 more
2015-07-23T18:57:32,109 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
  "id" : "index_hadoop_logdata_format_2015-07-23T18:52:36.382+08:00",
  "status" : "FAILED",
  "duration" : 266600
}


     what's your advice here?thanks.

Hi,

Can you post your full task log here? It usually means, no segment got created because either there was no input data or all the records from input were discarded due to parsing (or some other) errors.

– Himanshu

Hi,Himanshu,thank you very much.I find some columns parse errors and now it works well.

在 2015年7月23日星期四 UTC+8下午7:09:37,wangm…@gmail.com写道: