How to config 2 datasources in one tranquility file using one topic

Exception in thread “main” java.lang.IllegalArgumentException: requirement failed: Property ‘kafka.group.id’ cannot be per-dataSource (found in[hmetric5]).

at scala.Predef$.require(Predef.scala:219)

at com.metamx.tranquility.config.TranquilityConfig$$anonfun$4$$anonfun$apply$3.apply(TranquilityConfig.scala:74)

at com.metamx.tranquility.config.TranquilityConfig$$anonfun$4$$anonfun$apply$3.apply(TranquilityConfig.scala:73)

at scala.collection.immutable.Set$Set4.foreach(Set.scala:181)

my tranquility config:

{

“dataSources”: [

{

“spec”: {

“dataSchema”: {

“dataSource”: “hm5”,

“parser”: {

“type”: “string”,

“parseSpec”: {

“format”: “json”,

“timestampSpec”: {

“column”: “timestamp”,

“format”: “auto”,

“timeZone”: “UTC+8”

},

“dimensionsSpec”: {

“dimensions”: [

“server”,

“page”,

“method”,

“httpCode”

]

}

}

},

“metricsSpec”: [

{

“type”: “count”,

“name”: “count”

}

],

“granularitySpec”: {

“type”: “uniform”,

“segmentGranularity”: “hour”,

“queryGranularity”: “minute”

}

},

“ioConfig”: {

“type”: “realtime”

},

“tuningConfig”: {

“type”: “realtime”,

“maxRowsInMemory”: “75000”,

“intermediatePersistPeriod”: “PT10M”,

“windowPeriod”: “PT10M”

}

},

“properties”: {

“task.partitions”: “1”,

“task.replicants”: “1”,

“topicPattern”: “http-metric”,

“useTopicAsDataSource”: false,

“kafka.group.id”: “tranquility-kafka-hm5”

}

},

{

“spec”: {

“dataSchema”: {

“dataSource”: “hm6”,

“parser”: {

“type”: “string”,

“parseSpec”: {

“format”: “json”,

“timestampSpec”: {

“column”: “timestamp”,

“format”: “auto”,

“timeZone”: “UTC+8”

},

“dimensionsSpec”: {

“dimensions”: [

“server”,

“page”,

“method”,

“httpCode”

]

}

}

},

“metricsSpec”: [

{

“type”: “count”,

“name”: “count”

}

],

“granularitySpec”: {

“type”: “uniform”,

“segmentGranularity”: “hour”,

“queryGranularity”: “minute”

}

},

“ioConfig”: {

“type”: “realtime”

},

“tuningConfig”: {

“type”: “realtime”,

“maxRowsInMemory”: “75000”,

“intermediatePersistPeriod”: “PT10M”,

“windowPeriod”: “PT10M”

}

},

“properties”: {

“task.partitions”: “1”,

“task.replicants”: “1”,

“topicPattern”: “http-metric”,

“kafka.group.id”: “tranquility-kafka-hm6”

}

}

],

“properties”: {

“zookeeper.connect”: “ipxxxx:2181”,

“druid.discovery.curator.path”: “/druid/discovery”,

“druid.selectors.indexing.serviceName”: “druid/overlord”,

“consumer.numThreads”: “2”,

“kafka.zookeeper.connect”: “ipxxxx:2181/kafka”,

“kafka.group.id”: “tranquility-kafka”,

“druidBeam.taskLocator”: “overlord”

}

}

I review the tranquility source code, it’s not work

在 2018年8月20日星期一 UTC+8上午12:28:05,jiandong zhao写道: