Druid 0.12.3 and Hadoop client 2.7.3 batch ingestion reducer fails and retires

Hi

Running hadoop batch ingestion to reindex data on druid 0.12.3

I am using hadoop client 2.7.3

All the mappers runs successfully, whereas while while indexing few of the reducers fails with

[main] org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.NoSuchMethodError: com.google.common.io.Files.asByteSink(Ljava/io/File;[Lcom/google/common/io/FileWriteMode;)Lcom/google/common/io/ByteSink;
	at io.druid.segment.IndexMergerV9.makeIndexFiles(IndexMergerV9.java:161)
	at io.druid.segment.IndexMergerV9.merge(IndexMergerV9.java:837)
	at io.druid.segment.IndexMergerV9.persist(IndexMergerV9.java:657)
	at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.persist(IndexGeneratorJob.java:528)
	at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.reduce(IndexGeneratorJob.java:704)
	at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.reduce(IndexGeneratorJob.java:500)
	at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)
	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:635)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:390)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)


and the reducer again retries after this failures , which consumes lot of time and makes the process slower
On surfing figured out to be a guava version mismatch error,tried upgrading and downgrading the jars but still the same

Thanks

Hi,

You could try setting mapreduce.job.classloader = true or mapreduce.job.user.classpath.first = true, this page has more information: http://druid.io/docs/latest/operations/other-hadoop.html

Thanks