No hosts are available for disco!firehose:druid:overlord:a-realtime-kafka-20-0000-0000

Hi,

I try to setup the realtime ingestion to druid using tranquility, but got the error:

No hosts are available for disco!firehose:druid:overlord:a-realtime-kafka-20-0000-0000

when i run

bin/tranquility kafka -configFile /usr/local/imply/dist/druid/conf/tranquility/kafka.json

below is our conf files, can anyone help how shall i debug this?

this is the common.runtime.perperties:

#hadoop dependencies

druid.extensions.hadoopDependenciesDir=dist/druid/hadoop-dependencies

#enabling cache

Zookeeper

druid.zk.paths.base=/druid

druid.zk.service.host=druiddata-1.com,druiddata-2.com

druid.zk.service.sessionTimeoutMs=30000

druid.curator.compress=true

druid.discovery.curator.path=/druid/discovery

Request Logging

druid.request.logging.type=noop

Enabling Metrics

druid.monitoring.emissionPeriod=PT1m

#druid.monitoring.monitors=[""]

druid.monitoring.monitors=[“com.metamx.metrics.JvmMonitor”]

Emitting Metrics

druid.emitter=graphite

druid.emitter.graphite.hostname=

druid.emitter.graphite.port=2004

druid.emitter.graphite.eventConverter={“type”:“whiteList”,“namespacePrefix”:“druid.prod”,“ignoreHostname”:false, “mapPath”:"/usr/local/imply/conf/druid/metrics_whitelist.json"}

Metadata Storage

druid.metadata.storage.type=mysql

druid.metadata.storage.connector.connectURI=jdbc:mysql://druiddata-1.com:3306/druid

druid.metadata.storage.connector.user=

druid.metadata.storage.connector.password=

Deep Storage

druid.storage.type=hdfs

druid.storage.storageDirectory=hdfs://hdpstg:8020/group/dp/druid/prod/segments/

druid.indexer.logs.type=hdfs

druid.indexer.logs.directory=hdfs://hdpstg:8020/group/dp/druid/prod/indexing-logs

Caching

druid.cache.type=memcached

druid.cache.expiration=2592000

druid.cache.timeout=500

druid.cache.hosts:11112=druiddata-1.com,druiddata-1.com

druid.cache.maxObjectSize=52428800

Indexing Service Discovery

druid.selectors.indexing.serviceName=druid/overlord

druid.selectors.coordinator.serviceName=druid/coordinator

Announcing Segments

druid.announcer.type=batch

druid.announcer.segmentsPerNode=50

druid.announcer.maxBytesPerNode=524288

``

this is the coordinator runtime.properties

druid.port=8081

druid.service=druid/coordinator

druid.coordinator.period=PT60S

druid.coordinator.startDelay=PT300S

``

this is the overlord runtime.properties

druid.port=8090

druid.service=druid/overlord

druid.indexer.runner.type=remote

druid.indexer.storage.type=metadata

druid.indexer.queue.startDelay=PT1M

druid.indexer.queue.restartDelay=PT30S

``

also the log print for tranquility:
com.twitter.finagle.NoBrokersAvailableException: No hosts are available for disco!firehose:druid:overlord:a-realtime-kafka-20-0000-0000, Dtab.base=, Dtab.local=

at com.twitter.finagle.NoStacktrace(Unknown Source) ~[na:na]

2016-06-12 20:14:27,513 [Hashed wheel timer #1] INFO c.metamx.emitter.core.LoggingEmitter - Event [{“feed”:“alerts”,“timestamp”:“2016-06-12T20:14:27.513Z”,“service”:“tranquility”,“host”:“localhost”,“severity”:“anomaly”,“description”:“Failed to propagate events: druid:overlord/a-realtime-kafka”,“data”:{“exceptionType”:“com.twitter.finagle.NoBrokersAvailableException”,“exceptionStackTrace”:“com.twitter.finagle.NoBrokersAvailableException: No hosts are available for disco!firehose:druid:overlord:a-realtime-kafka-20-0000-0000, Dtab.base=, Dtab.local=\n\tat com.twitter.finagle.NoStacktrace(Unknown Source)\n”,“timestamp”:“2016-06-12T20:00:00.000Z”,“beams”:“MergingPartitioningBeam(DruidBeam(interval = 2016-06-12T20:00:00.000Z/2016-06-12T21:00:00.000Z, partition = 0, tasks = [index_realtime_a-realtime-kafka_2016-06-12T20:00:00.000Z_0_0/a-realtime-kafka-20-0000-0000]))”,“eventCount”:1,“exceptionMessage”:“No hosts are available for disco!firehose:druid:overlord:a-realtime-kafka-20-0000-0000, Dtab.base=, Dtab.local=”}}]

2016-06-12 20:14:27,521 [KafkaConsumer-CommitThread] INFO c.m.tranquility.kafka.KafkaConsumer - Flushed {a.mz.normalizedmkt={receivedCount=2006, sentCount=0, failedCount=2006}} pending messages in 97298ms and committed offsets in 8ms.

``

Did you set up middlemanagers?