Unable to load any local file

Dear all,
I’m trying to follow the tutorial for native batch ingestion (using both quickstart data and custom). Everytime I perform ingestion, I get this kind of error:

2020-02-27T11:28:03,534 ERROR [TaskMonitorCache-0] org.apache.druid.indexing.worker.WorkerTaskManager - Error while trying to persist assigned task[index_parallel_new-data-source_dgiimcio_2020-02-27T11:28:02.950Z]

java.nio.file.FileSystemException: var/druid/task/workerTaskManagerTmp/.index_parallel_new-data-source_dgiimcio_2020-02-27T11:28:02.950Z.8ad62d18-115a-40de-81d5-15375b426a88: Invalid argument

at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:1.8.0_201]

at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_201]

at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:1.8.0_201]

at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:177) ~[?:1.8.0_201]

at java.nio.channels.FileChannel.open(FileChannel.java:287) ~[?:1.8.0_201]

at java.nio.channels.FileChannel.open(FileChannel.java:335) ~[?:1.8.0_201]

at org.apache.druid.java.util.common.FileUtils.writeAtomically(FileUtils.java:217) ~[druid-core-0.17.0.jar:0.17.0]

at org.apache.druid.indexing.worker.WorkerTaskManager.assignTask(WorkerTaskManager.java:273) [druid-indexing-service-0.17.0.jar:0.17.0]

at org.apache.druid.indexing.worker.WorkerTaskMonitor$1.childEvent(WorkerTaskMonitor.java:170) [druid-indexing-service-0.17.0.jar:0.17.0]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:538) [curator-recipes-4.1.0.jar:4.1.0]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:532) [curator-recipes-4.1.0.jar:4.1.0]

at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:93) [curator-framework-4.1.0.jar:4.1.0]

at org.apache.curator.shaded.com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:435) [curator-client-4.1.0.jar:?]

at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:85) [curator-framework-4.1.0.jar:4.1.0]

at org.apache.curator.framework.recipes.cache.PathChildrenCache.callListeners(PathChildrenCache.java:530) [curator-recipes-4.1.0.jar:4.1.0]

at org.apache.curator.framework.recipes.cache.EventOperation.invoke(EventOperation.java:35) [curator-recipes-4.1.0.jar:4.1.0]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$9.run(PathChildrenCache.java:808) [curator-recipes-4.1.0.jar:4.1.0]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_201]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_201]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_201]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_201]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_201]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_201]

at java.lang.Thread.run(Thread.java:748) [?:1.8.0_201]

2020-02-27T11:28:03,538 ERROR [TaskMonitorCache-0] org.apache.curator.framework.recipes.cache.PathChildrenCache -

org.apache.druid.java.util.common.ISE: Assign Task[index_parallel_new-data-source_dgiimcio_2020-02-27T11:28:02.950Z] Request failed because [var/druid/task/workerTaskManagerTmp/.index_parallel_new-data-source_dgiimcio_2020-02-27T11:28:02.950Z.8ad62d18-115a-40de-81d5-15375b426a88: Invalid argument].

at org.apache.druid.indexing.worker.WorkerTaskManager.assignTask(WorkerTaskManager.java:285) ~[druid-indexing-service-0.17.0.jar:0.17.0]

at org.apache.druid.indexing.worker.WorkerTaskMonitor$1.childEvent(WorkerTaskMonitor.java:170) ~[druid-indexing-service-0.17.0.jar:0.17.0]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:538) [curator-recipes-4.1.0.jar:4.1.0]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:532) [curator-recipes-4.1.0.jar:4.1.0]

at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:93) [curator-framework-4.1.0.jar:4.1.0]

at org.apache.curator.shaded.com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:435) [curator-client-4.1.0.jar:?]

at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:85) [curator-framework-4.1.0.jar:4.1.0]

at org.apache.curator.framework.recipes.cache.PathChildrenCache.callListeners(PathChildrenCache.java:530) [curator-recipes-4.1.0.jar:4.1.0]

at org.apache.curator.framework.recipes.cache.EventOperation.invoke(EventOperation.java:35) [curator-recipes-4.1.0.jar:4.1.0]

at org.apache.curator.framework.recipes.cache.PathChildrenCache$9.run(PathChildrenCache.java:808) [curator-recipes-4.1.0.jar:4.1.0]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_201]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_201]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_201]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_201]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_201]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_201]

at java.lang.Thread.run(Thread.java:748) [?:1.8.0_201]

I’m using apache druid 0.17.0 with this jvm:

java version “1.8.0_201”

Java™ SE Runtime Environment (build 1.8.0_201-b09)

Java HotSpot™ 64-Bit Server VM (build 25.201-b09, mixed mode)

Have you any suggestion or tip?

Thanks in advance,

Domenico Delle Side

To complete the information, I’m using the default configuration of the micro-quickstart for single server (except for log level set to debug) on Ubuntu 19.10.

The tutorial I was writing of is that one: https://druid.apache.org/docs/latest/tutorials/tutorial-batch.html

All the best,

Domenico Delle Side

I was able to solve the issue enforcing use of openjdk 8. Furthermore, there is an issue with the “verify-java” script. In the default ubuntu 19.10 install on google cloud platform, /bin/sh points to /usr/bin/java, that has no “source” command.
The script then exit on line 70, i.e.:

my $java_bin_dir = source $cwd/java-util && get_java_bin_dir 2>&1;

I think there is no particular reason to have this script written in perl, it may be a normal shell script, running on top of /bin/bash

All the best,

Domenico Delle Side