Integration of Kafka > DRUID > Grafana for real-time monitoring

Hi all
First of all many thanks for all your work! But unfortunately I din’t found a solution for for my case

  • I have many sensors which send JSON formated strings via Kafka. Like this one:
    {“host”: “sensor-1”, “unix_time”: 1542893980.8259132, “utc_time”: “2018-11-22T14:39:40.825915”, “value”: 366}
  • In Druid I started a Supervisor
    curl -XPOST -H’Content-Type: application/json’ -d @supervisor/IoT-kafka-supervisor.json http://xxx.xxx.xxx.xxx:8090/druid/indexer/v1/supervisor

supervisor spec - IoT-kafka-supervisor.json

{

“type”: “kafka”,

“dataSchema”: {

"dataSource": "sensor_md",
"parser": {
  "type": "string",
  "parseSpec": {
    "format": "json",
    "timestampSpec": {
      "column": "utc_time",
      "format": "auto"
    },
    "dimensionsSpec": {
      "dimensions": [],
      "dimensionExclusions": [
        "host",
        "unix_time",
        "value"
      ]
    }
  }
},
"metricsSpec": [
],
"granularitySpec": {
  "type": "uniform",
  "segmentGranularity": "HOUR",
  "queryGranularity": "NONE"
}

},

“tuningConfig”: {

"type": "kafka",
"maxRowsPerSegment": 5000000

},

“ioConfig”: {

"topic": "sensor_md",
"consumerProperties": {
  "bootstrap.servers": "xxx.xxx.xxx.xxx:6667"
},
"taskCount": 1,
"replicas": 1,
"taskDuration": "PT1H"

}

}

  • The Datasource ‘sensor_md’ is created (link: xxx.xxx.xxx.xxx:8081/#/datasources/sensor_md)

  • I have downloaded the latest Grafana pkg. & druid datasource plugin
    Issue:

  • What are the connection properties for the Grafana-plugin?
    thnx

btw: Druid v0.12.1 / Kafka v1.1.1 / Grafana v5.3.4 / Grafana Druid-plugin v0.0.5