not able to get tranquility working

Hi,

I have recently started working with druid. i had explored few things in druid and were able to work with the basic querying and load batch data into druid.

I wanted to load realtime data into druid and hence i started exploring tranquility with druid.

I went through the git hub link and used the same spec file given in the website for tranquility server, but I find this exception:

NoBrokersAvailableException: No hosts are available for disco!firehose:druid:overlord:foo-06-0000-0000,

I have been stuck with this exception for like 1 week pls help me.

the following is the spec file:

{

“dataSources” : [

{

“spec” : {

“dataSchema” : {

“dataSource” : “foo”,

“metricsSpec” : [

{

“type” : “count”,

“name” : “count”

},

{

“fieldName” : “x”,

“type” : “doubleSum”,

“name” : “x”

}

],

“granularitySpec” : {

“segmentGranularity” : “hour”,

“queryGranularity” : “none”,

“type” : “uniform”

},

“parser” : {

“type” : “string”,

“parseSpec” : {

“format” : “json”,

“timestampSpec” : {

“column” : “timestamp”,

“format” : “auto”

},

“dimensionsSpec” : {

“dimensions” : [

“dim1”,

“dim2”,

“dim3”

]

}

}

}

},

“tuningConfig” : {

“type” : “realtime”,

“windowPeriod” : “PT10M”,

“intermediatePersistPeriod” : “PT10M”,

“maxRowsInMemory” : 75000

}

},

“properties” : {

“task.partitions” : “1”,

“task.replicants” : “1”

}

}

],

“properties” : {

“zookeeper.connect” : “localhost”,

“http.port” : “8200”,

“http.threads” : “40”

}

}

and this is the stack trace

2016-03-22 06:34:28,602 [main-EventThread] INFO o.a.c.f.state.ConnectionStateManager - State change: CONNECTED

2016-03-22 06:34:28,602 [main] INFO org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112

2016-03-22 06:34:28,655 [main] INFO o.e.jetty.server.ServerConnector - Started ServerConnector@412a8a44{HTTP/1.1}{0.0.0.0:8200}

2016-03-22 06:34:28,655 [main] INFO org.eclipse.jetty.server.Server - Started @3851ms

2016-03-22 06:34:49,753 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.tranquility.beam.ClusteredBeam - Merged beam already created for identifier[druid:overlord/foo] timestamp[2016-03-22T06:00:00.000Z], with sufficient partitions (target = 1, actual = 1)

2016-03-22 06:34:49,766 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.tranquility.beam.ClusteredBeam - Adding beams for identifier[druid:overlord/foo] timestamp[2016-03-22T06:00:00.000Z]: List(Map(interval -> 2016-03-22T06:00:00.000Z/2016-03-22T07:00:00.000Z, partition -> 0, tasks -> List(Map(id -> index_realtime_foo_2016-03-22T06:00:00.000Z_0_0, firehoseId -> foo-06-0000-0000)), timestamp -> 2016-03-22T06:00:00.000Z))

Mar 22, 2016 6:34:49 AM com.twitter.finagle.Init$$anonfun$1 apply$mcV$sp

INFO: Finagle version 6.31.0 (rev=50d3bb0eea5ad3ed332111d707184c80fed6a506) built at 20151203-164135

2016-03-22 06:34:50,010 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.c.s.net.finagle.DiscoResolver - Updating instances for service[firehose:druid:overlord:foo-06-0000-0000] to Set()

2016-03-22 06:34:50,078 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.t.finagle.FinagleRegistry - Created client for service: disco!firehose:druid:overlord:foo-06-0000-0000

2016-03-22 06:34:50,325 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.c.s.net.finagle.DiscoResolver - Updating instances for service[druid:overlord] to Set(ServiceInstance{name=‘druid:overlord’, id=‘2715e495-a118-469f-8288-be0a1723d3ad’, address=‘manoj-virtual-machine’, port=8090, sslPort=null, payload=null, registrationTimeUTC=1458625397894, serviceType=DYNAMIC, uriSpec=null})

2016-03-22 06:34:50,346 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.t.finagle.FinagleRegistry - Created client for service: disco!druid:overlord

2016-03-22 06:34:50,511 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.tranquility.beam.ClusteredBeam - Merged beam already created for identifier[druid:overlord/foo] timestamp[2016-03-22T06:00:00.000Z], with sufficient partitions (target = 1, actual = 1)

2016-03-22 06:34:50,532 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.tranquility.beam.ClusteredBeam - Merged beam already created for identifier[druid:overlord/foo] timestamp[2016-03-22T06:00:00.000Z], with sufficient partitions (target = 1, actual = 1)

2016-03-22 06:34:50,564 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.tranquility.beam.ClusteredBeam - Merged beam already created for identifier[druid:overlord/foo] timestamp[2016-03-22T06:00:00.000Z], with sufficient partitions (target = 1, actual = 1)

2016-03-22 06:34:50,601 [ClusteredBeam-ZkFuturePool-74ab8c7a-0962-4327-8e2b-3266c4153c6a] INFO c.m.tranquility.beam.ClusteredBeam - Merged beam already created for identifier[druid:overlord/foo] timestamp[2016-03-22T06:00:00.000Z], with sufficient partitions (target = 1, actual = 1)

2016-03-22 06:35:54,537 [Hashed wheel timer #1] WARN c.m.tranquility.beam.ClusteredBeam - Emitting alert: [anomaly] Failed to propagate events: druid:overlord/foo

{

“eventCount” : 1,

“timestamp” : “2016-03-22T06:00:00.000Z”,

“beams” : “MergingPartitioningBeam(DruidBeam(interval = 2016-03-22T06:00:00.000Z/2016-03-22T07:00:00.000Z, partition = 0, tasks = [index_realtime_foo_2016-03-22T06:00:00.000Z_0_0/foo-06-0000-0000]))”

}

com.twitter.finagle.NoBrokersAvailableException: No hosts are available for disco!firehose:druid:overlord:foo-06-0000-0000, Dtab.base=, Dtab.local=

at com.twitter.finagle.NoStacktrace(Unknown Source) ~[na:na]

2016-03-22 06:35:54,553 [Hashed wheel timer #1] INFO c.metamx.emitter.core.LoggingEmitter - Event [{“feed”:“alerts”,“timestamp”:“2016-03-22T06:35:54.545Z”,“service”:“tranquility”,“host”:“localhost”,“severity”:“anomaly”,“description”:“Failed to propagate events: druid:overlord/foo”,“data”:{“exceptionType”:“com.twitter.finagle.NoBrokersAvailableException”,“exceptionStackTrace”:“com.twitter.finagle.NoBrokersAvailableException: No hosts are available for disco!firehose:druid:overlord:foo-06-0000-0000, Dtab.base=, Dtab.local=\n\tat com.twitter.finagle.NoStacktrace(Unknown Source)\n”,“timestamp”:“2016-03-22T06:00:00.000Z”,“beams”:“MergingPartitioningBeam(DruidBeam(interval = 2016-03-22T06:00:00.000Z/2016-03-22T07:00:00.000Z, partition = 0, tasks = [index_realtime_foo_2016-03-22T06:00:00.000Z_0_0/foo-06-0000-0000]))”,“eventCount”:1,“exceptionMessage”:“No hosts are available for disco!firehose:druid:overlord:foo-06-0000-0000, Dtab.base=, Dtab.local=”}}]

2016-03-22 06:35:57,593 [Hashed wheel timer #1] WARN c.m.tranquility.beam.ClusteredBeam - Emitting alert: [anomaly] Failed to propagate events: druid:overlord/foo

{

“eventCount” : 1,

“timestamp” : “2016-03-22T06:00:00.000Z”,

“beams” : “MergingPartitioningBeam(DruidBeam(interval = 2016-03-22T06:00:00.000Z/2016-03-22T07:00:00.000Z, partition = 0, tasks = [index_realtime_foo_2016-03-22T06:00:00.000Z_0_0/foo-06-0000-0000]))”

}

com.twitter.finagle.NoBrokersAvailableException: No hosts are available for disco!firehose:druid:overlord:foo-06-0000-0000, Dtab.base=, Dtab.local=

at com.twitter.finagle.NoStacktrace(Unknown Source) ~[na:na]

Thanks

Hey Manoj,

This error generally means that indexing tasks cannot be started or cannot be located. Some common reasons for this are not having an indexing service set up (overlord + middle managers) or having one set up, but out of capacity.

The new 0.9.0 quickstart, and the Imply quickstart that it is based on, have some configs that work out of the box for this. You could use those configs as a starting point.

http://druid.io/docs/0.9.0-rc3/tutorials/quickstart.html (based on the not yet released druid 0.9.0)

http://imply.io/docs/latest/quickstart (currently based on the stable druid 0.8.3)

Hey Gian

Thanks for the configs. Now I face a different issue. it was all ok and was working for a couple of days but now there is this exception coming up whenever I try to run an indexer task.

It says :

com.metamx.tranquility.beam.DefunctBeamException: Tasks are all gone: index_realtime_metrics_2016-03-29T04:00:00.000Z_0_0

and the tasks fail.

When I find the log for the tasks, it has a single line stating : Error: Could not find or load main class ­server

Is it a problem with my overlord node or is it anything else.

Thanks

-Manoj