I am trying to get Druid 0.8.0 in combination with Tranquility (Finagle service) to work, but I am stuck at the following, well known (see ,, , ) error:
Unable to push events to task: index_realtime_dadsaas_2015-08-02T19:52:00.000+02:00_0_0 (status = TaskNotFound)
Caused by: com.twitter.finagle.NoBrokersAvailableException: No hosts are available for druid:firehose:wikipedia-52-0000-0000
I think the deeper problem behind this is that the overlord does throw a warning at start (also already seen here, see):
INFORMATION: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope “Undefined”
Aug 02, 2015 6:33:56 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNUNG: The following warnings have been detected with resource and/or provider classes:
WARNING: Parameter 1 of type io.druid.indexing.common.actions.TaskActionHolder from public javax.ws.rs.core.Response io.druid.indexing.overlord.http.OverlordResource.doAction(io.druid.indexing.common.actions.TaskActionHolder) is not resolvable to a concrete type
My general idea was to use the wikipedia example and ingest data with my own java program via Tranquility (Finagle) into druid. I tried to make a “basic” setup for testing ingestion via Tranquility/Java, all the examples in the Druid wiki worked (they are without overlord nodes!).
I tried a lot of different configurations to get it running on Debian Jessie 7.1, but I am always stuck at these problems. My ingestion tasks are never completed but the tasks itself do not throw any error (I can see the logs on overlord page) and run forever (listed as “Running” on overlord page). Some users reported that it works when you repeated the task, but that did not help. Adding a warmuptime did also not help. Different naming of the overlord, especially “druid:overlord” and “overlord”, did not provide any help.
So I am stuck here with no idea how to get this thing running, I also tried versions down to Druid 0.7.0, same problem.
Is it something in Debian Jessie? Except java (openjdk7) there is no debian package used.
The only thought I came up with was that maybe I have not configured the firehose in a correct way. Which firehose type is needed for Tranquility?
I also know that I need the following nodes for this: Coordinator, Broker, Historical, Overlord.
Is a MiddleManager node needed? Or can it be completely replaced with the indexing task mentioned on  “Batch Ingestion Using the Indexing Service”.? (I tried it several times with both of them, none of them worked.)
I hope you can help me to get Druid+Tranquility up and running
I am trying to provide as much information as possible:
Logfiles -> Logs.tar.gz
Configfiles -> Configs.tar.gz
My Java Testcode -> TranqulityTest.java
dpkg -l -> Dpkg.txt
libraries in classpath for TranquilityTest.java -> Libs.txt
Linux vagrant-debian 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1 (2015-05-24) x86_64 GNU/Linux
Logs.tar.gz (22.3 KB)
Config.tar.gz (6.9 KB)
Dpkg.txt (76.6 KB)
Libs.txt (3.82 KB)
TranquilityTest.java (4.46 KB)