Empty dimensions on new datasource

Hi all,

I’ve got a strange issue with creating new datasource. I created new one config for realtime node. Time column and metrics are as expected but all dimensions are missing.

I tried to copy working datasource to new one and got the same issue. Did anyone experience such behaviour ?

Here is my realtime.spec config:

[

{

“dataSchema”: {

“dataSource”: “adfeedtest”,

“parser”: {

“type”: “string”,

“parseSpec”: {

“format”: “json”,

“timestampSpec”: {

“column”: “time”,

“format”: “posix”

},

“dimensionsSpec”: {

“dimensions”: [

“ad”,

“adgroup”,

“advertiser”,

“aid”,

“label”,

“said”

],

“dimensionExclusions”: ,

“spatialDimensions”:

}

}

},

“metricsSpec”: [

{

“type”: “longSum”,

“name”: “click_accepted”,

“fieldName”: “click_accepted”

}

],

“granularitySpec”: {

“type”: “uniform”,

“segmentGranularity”: “HOUR”,

“queryGranularity”: “NONE”

}

},

“ioConfig”: {

“type”: “realtime”,

“firehose”: {

“type”: “kafka-0.8”,

“consumerProps”: {

“zookeeper.connect”: “zk1.int:2181”,

“zookeeper.connection.timeout.ms” : “15000”,

“zookeeper.session.timeout.ms” : “15000”,

“zookeeper.sync.time.ms” : “5000”,

“group.id”: “d-group”,

“fetch.message.max.bytes” : “1048586”,

“auto.offset.reset”: “largest”,

“auto.commit.enable”: “false”

},

“feed”: “adfeed”

},

“plumber”: {

“type”: “realtime”

}

},

“tuningConfig”: {

“type”: “realtime”,

“maxRowsInMemory”: 500000,

“intermediatePersistPeriod”: “PT3m”,

“windowPeriod”: “PT10m”,

“basePersistDirectory”: “/tmp/realtime/basePersist”,

“rejectionPolicy”: {

“type”: “serverTime”

}

}

}

]

``

Reply from my broker:

{"dimensions":[],"metrics":["click_accepted"]}

``

Known issue. Because of schemaless dimensions in Druid, dimensions only show up after handoff. You can use segment metadata instead to get this info.