Error with tranquility pulling from kafka

I have been attempting to use the tranquility kafka input and am having one error that I cannot seem to get past. Tranquility appears to die because of this error: java.lang.IllegalArgumentException: Instantiation of [simple type, class io.druid.data.input.impl.StringInputRowParser] value failed: json can not be null or empty

I cannot seem to find the source of this error as there is plenty of data in my kafka topic (CallStats-clean). One note about the data I am ingesting, not all fields listed in dimensions or metrics are present in every record I am trying to ingest.

Tranquility is version 0.9.0-SNAPSHOT, Kafka version is 0.10.1.

Output from /status on coordinator:

{“version”:“0.9.2.2.6.2.0-205”,“modules”:[{“name”:“io.druid.query.aggregation.datasketches.theta.SketchModule”,“artifact”:“druid-datasketches”,“version”:“0.9.2.2.6.2.0-205”},{“name”:“io.druid.storage.hdfs.HdfsStorageDruidModule”,“artifact”:“druid-hdfs-storage”,“version”:“0.9.2.2.6.2.0-205”},{“name”:“io.druid.emitter.ambari.metrics.AmbariMetricsEmitterModule”,“artifact”:“ambari-metrics-emitter”,“version”:“0.9.2.2.6.2.0-205”},{“name”:“io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule”,“artifact”:“druid-datasketches”,“version”:“0.9.2.2.6.2.0-205”},{“name”:“io.druid.metadata.storage.mysql.MySQLMetadataStorageModule”,“artifact”:“mysql-metadata-storage”,“version”:“0.9.2.2.6.2.0-205”},{“name”:“io.druid.indexing.kafka.KafkaIndexTaskModule”,“artifact”:“druid-kafka-indexing-service”,“version”:“0.9.2.2.6.2.0-205”}],“memory”:{“maxMemory”:523763712,“totalMemory”:523763712,“freeMemory”:381483432,“usedMemory”:142280280}}

Can anyone make some suggestions as to where I should look?

Full config and tranquility output below:

{

“dataSources”: [

{

“spec”: {

“dataSchema”: {

“parser”: {

“type”: “string”,

“parseSpec”: {

“timestampSpec”: {

“format”: “auto”,

“column”: “iso_ts”

},

“dimensionsSpec”: {

“spatialDimensions”: [

{

“dims”: [

“lat”,

“lon”

],

“dimName”: “geo”

}

],

“dimensions”: [

“geoiptimezone”,

“geoipip”,

“geoipcontinentcode”,

“geoipcityname”,

“geoipcountryname”,

“geoipcountrycode2”,

“geoipdmacode”,

“geoipcountrycode3”,

“geoipregionname”,

“geoippostalcode”,

“geoipregioncode”,

“txcodec”,

“rxcodec”,

“hwrev”,

“mac”,

“callid”,

“bld”,

“key”,

“ver”,

“hwname”,

“hwpn”,

{

“type”: “long”,

“name”: “txframerate”

},

{

“type”: “long”,

“name”: “rxframerate”

},

{

“type”: “long”,

“name”: “rxheight”

},

{

“type”: “long”,

“name”: “rxwidth”

},

{

“type”: “long”,

“name”: “txactratekbps”

},

{

“type”: “long”,

“name”: “txactratekpbs”

}

],

“dimensionExclusions”: [

@version”,

@timestamp”,

“kafka_type”,

“reflexiveip”,

“geoiplongitude”,

“geoiplatitude”

]

},

“flattenSpec”: {

“useFieldDiscovery”: true,

“fields”: [

{

“type”: “path”,

“name”: “avgjitter”,

“expr”: “$.avgJitter”

},

{

“type”: “path”,

“name”: “txlost”,

“expr”: “$.txLost”

},

{

“type”: “path”,

“name”: “txfastupdatecnt”,

“expr”: “$.txFastUpdateCnt”

},

{

“type”: “path”,

“name”: “rxfastupdatecnt”,

“expr”: “$.rxFastUpdateCnt”

},

{

“type”: “path”,

“name”: “geoiplatitude”,

“expr”: “$.geoip.latitude”

},

{

“type”: “path”,

“name”: “geoiplongitude”,

“expr”: “$.geoip.longitude”

},

{

“type”: “path”,

“name”: “reflexiveip”,

“expr”: “$.reflexiveIP”

},

{

“type”: “path”,

“name”: “txcodec”,

“expr”: “$.txCodec”

},

{

“type”: “path”,

“name”: “rxcodec”,

“expr”: “$.rxCodec”

},

{

“type”: “path”,

“name”: “txframerate”,

“expr”: “$.txFrameRate”

},

{

“type”: “path”,

“name”: “rxheight”,

“expr”: “$.rxHeight”

},

{

“type”: “path”,

“name”: “rxwidth”,

“expr”: “$.rxWidth”

},

{

“type”: “path”,

“name”: “txactratekbps”,

“path”: “$.txActRateKbps”

},

{

“type”: “path”,

“name”: “rxframerate”,

“expr”: “$.rxFrameRate”

},

{

“type”: “path”,

“name”: “rxactratekbps”,

“expr”: “$.rxActRateKbps”

},

{

“type”: “path”,

“name”: “geoiptimezone”,

“expr”: “$.geoip.timezone”

},

{

“type”: “path”,

“name”: “geoipip”,

“expr”: “$.geoip.ip”

},

{

“type”: “path”,

“name”: “geoipcontinentcode”,

“expr”: “$.geoip.continent_code”

},

{

“type”: “path”,

“name”: “geoipcityname”,

“expr”: “$.geoip.city_name”

},

{

“type”: “path”,

“name”: “geoipcountryname”,

“expr”: “$.geoip.country_name”

},

{

“type”: “path”,

“name”: “geoipcountrycode2”,

“expr”: “$.geoip.country_code2”

},

{

“type”: “path”,

“name”: “geoipdmacode”,

“expr”: “$.geoip.dma_code”

},

{

“type”: “path”,

“name”: “geoipcountrycode3”,

“expr”: “$.geoip.country_code3”

},

{

“type”: “path”,

“name”: “geoipregionname”,

“expr”: “$.geoip.region_name”

},

{

“type”: “path”,

“name”: “geoippostalcode”,

“expr”: “$.geoip.postal_code”

},

{

“type”: “path”,

“name”: “geoipregioncode”,

“expr”: “$.geoip.region_code”

},

{

“type”: “path”,

“name”: “lon”,

“expr”: “$.geoip.location.lon”

},

{

“type”: “path”,

“name”: “lat”,

“expr”: “$.geoip.location.lat”

}

]

},

“format”: “json”

}

},

“dataSource”: “callstats”,

“granularitySpec”: {

“segmentGranularity”: “minute”,

“type”: “uniform”,

“queryGranularity”: “minute”

},

“metricsSpec”: [

{

“type”: “longSum”,

“name”: “drop”,

“fieldName”: “drop”

},

{

“fieldName”: “avgjitter”,

“type”: “longSum”,

“name”: “avgjitter”

},

{

“name”: “txlost”,

“type”: “longSum”,

“fieldName”: “txlost”

},

{

“fieldName”: “tx”,

“type”: “longSum”,

“name”: “tx”

},

{

“name”: “txfastupdatecnt”,

“type”: “longSum”,

“fieldName”: “txfastupdatecnt”

},

{

“name”: “rx”,

“type”: “longSum”,

“fieldName”: “rx”

},

{

“name”: “rxfastupdatecnt”,

“type”: “longSum”,

“fieldName”: “rxfastupdatecnt”

},

{

“name”: “jitter”,

“type”: “longSum”,

“fieldName”: “jitter”

}

]

},

“tuningConfig”: {

“maxRowsInMemory”: “100000”,

“type”: “realtime”,

“windowPeriod”: “PT10M”,

“intermediatePersistPeriod”: “PT10M”

}

},

“properties”: {

“topicPattern.priority”: “1”,

“topicPattern”: “CallStats-clean”

}

}

],

“properties”: {

“zookeeper.connect”: “hanalytics-ambari-master-scus-1:2181”,

“zookeeper.timeout”: “PT20S”,

“druid.selectors.indexing.serviceName”: “druid/overlord”,

“druid.discovery.curator.path”: “/druid/discovery”,

“kafka.zookeeper.connect”: “hanalytics-ambari-master-scus-1:2181”,

“kafka.group.id”: “tranquility-kafka-calls-1”,

“consumer.numThreads”: “2”,

“commit.periodMillis”: “15000”,

“reportDropsAsExceptions”: “false”,

“kafka.consumer.id”: “kafka-tranquility-scus-1”

}

}

bin/tranquility kafka -configFile conf/tranquility-kafka.json

2017-10-30 00:13:23,201 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [tranquility-kafka-calls-1] for [kafka.group.id] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getKafkaGroupId()]

2017-10-30 00:13:23,208 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [hanalytics-ambari-master-scus-1:2181] for [kafka.zookeeper.connect] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getKafkaZookeeperConnect()]

2017-10-30 00:13:23,208 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [false] for [useTopicAsDataSource] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#useTopicAsDataSource()]

2017-10-30 00:13:23,209 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [1] for [topicPattern.priority] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getTopicPatternPriority()]

2017-10-30 00:13:23,209 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [15000] for [commit.periodMillis] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getCommitPeriodMillis()]

2017-10-30 00:13:23,209 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [2] for [consumer.numThreads] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getConsumerNumThreads()]

2017-10-30 00:13:23,209 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [(?!)] for [topicPattern] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getTopicPattern()]

2017-10-30 00:13:23,209 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [false] for [reportDropsAsExceptions] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#reportDropsAsExceptions()]

2017-10-30 00:13:23,210 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [false] for [reportParseExceptions] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#reportParseExceptions()]

2017-10-30 00:13:23,210 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [PT20S] for [zookeeper.timeout] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperTimeout()]

2017-10-30 00:13:23,249 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [druid/overlord] for [druid.selectors.indexing.serviceName] on [com.metamx.tranquility.config.PropertiesBasedConfig#druidIndexingServiceName()]

2017-10-30 00:13:23,249 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.partitions] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskPartitions()]

2017-10-30 00:13:23,250 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.replicants] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskReplicants()]

2017-10-30 00:13:23,250 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.warmingPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskWarmingPeriod()]

2017-10-30 00:13:23,250 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [serialization.format] on [com.metamx.tranquility.config.PropertiesBasedConfig#serializationFormat()]

2017-10-30 00:13:23,253 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [hanalytics-ambari-master-scus-1:2181] for [zookeeper.connect] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperConnect()]

2017-10-30 00:13:23,253 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [zookeeper.path] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperPath()]

2017-10-30 00:13:23,253 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.maxBatchSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityMaxBatchSize()]

2017-10-30 00:13:23,253 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.maxPendingBatches] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityMaxPendingBatches()]

2017-10-30 00:13:23,254 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.lingerMillis] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityLingerMillis()]

2017-10-30 00:13:23,254 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [/druid/discovery] for [druid.discovery.curator.path] on [com.metamx.tranquility.config.PropertiesBasedConfig#discoPath()]

2017-10-30 00:13:23,254 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseGracePeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseGracePeriod()]

2017-10-30 00:13:23,254 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseQuietPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseQuietPeriod()]

2017-10-30 00:13:23,254 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseRetryPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseRetryPeriod()]

2017-10-30 00:13:23,254 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseChunkSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseChunkSize()]

2017-10-30 00:13:23,254 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.randomizeTaskId] on [com.metamx.tranquility.config.PropertiesBasedConfig#randomizeTaskId()]

2017-10-30 00:13:23,255 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.indexRetryPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#indexRetryPeriod()]

2017-10-30 00:13:23,255 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseBufferSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseBufferSize()]

2017-10-30 00:13:23,255 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.overlordLocator] on [com.metamx.tranquility.config.PropertiesBasedConfig#overlordLocator()]

2017-10-30 00:13:23,255 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.taskLocator] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskLocator()]

2017-10-30 00:13:23,255 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.overlordPollPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#overlordPollPeriod()]

2017-10-30 00:13:23,351 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [tranquility-kafka-calls-1] for [kafka.group.id] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getKafkaGroupId()]

2017-10-30 00:13:23,351 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [hanalytics-ambari-master-scus-1:2181] for [kafka.zookeeper.connect] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getKafkaZookeeperConnect()]

2017-10-30 00:13:23,352 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [false] for [useTopicAsDataSource] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#useTopicAsDataSource()]

2017-10-30 00:13:23,352 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [1] for [topicPattern.priority] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getTopicPatternPriority()]

2017-10-30 00:13:23,352 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [15000] for [commit.periodMillis] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getCommitPeriodMillis()]

2017-10-30 00:13:23,352 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [2] for [consumer.numThreads] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getConsumerNumThreads()]

2017-10-30 00:13:23,352 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [CallStats-clean] for [topicPattern] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getTopicPattern()]

2017-10-30 00:13:23,352 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [false] for [reportDropsAsExceptions] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#reportDropsAsExceptions()]

2017-10-30 00:13:23,352 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [false] for [reportParseExceptions] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#reportParseExceptions()]

2017-10-30 00:13:23,352 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [PT20S] for [zookeeper.timeout] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperTimeout()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [druid/overlord] for [druid.selectors.indexing.serviceName] on [com.metamx.tranquility.config.PropertiesBasedConfig#druidIndexingServiceName()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.partitions] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskPartitions()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.replicants] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskReplicants()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.warmingPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskWarmingPeriod()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [serialization.format] on [com.metamx.tranquility.config.PropertiesBasedConfig#serializationFormat()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [hanalytics-ambari-master-scus-1:2181] for [zookeeper.connect] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperConnect()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [zookeeper.path] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperPath()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.maxBatchSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityMaxBatchSize()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.maxPendingBatches] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityMaxPendingBatches()]

2017-10-30 00:13:23,353 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.lingerMillis] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityLingerMillis()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [/druid/discovery] for [druid.discovery.curator.path] on [com.metamx.tranquility.config.PropertiesBasedConfig#discoPath()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseGracePeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseGracePeriod()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseQuietPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseQuietPeriod()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseRetryPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseRetryPeriod()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseChunkSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseChunkSize()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.randomizeTaskId] on [com.metamx.tranquility.config.PropertiesBasedConfig#randomizeTaskId()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.indexRetryPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#indexRetryPeriod()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseBufferSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseBufferSize()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.overlordLocator] on [com.metamx.tranquility.config.PropertiesBasedConfig#overlordLocator()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.taskLocator] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskLocator()]

2017-10-30 00:13:23,354 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.overlordPollPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#overlordPollPeriod()]

2017-10-30 00:13:23,366 [main] WARN o.a.c.retry.ExponentialBackoffRetry - maxRetries too large (500). Pinning to 29

2017-10-30 00:13:23,367 [main] INFO c.m.t.kafka.writer.WriterController - Ready: [topicPattern] -> dataSource mappings:

2017-10-30 00:13:23,368 [main] INFO c.m.t.kafka.writer.WriterController - [CallStats-clean] -> CallStats (priority: 1)

2017-10-30 00:13:23,445 [main] INFO kafka.utils.VerifiableProperties - Verifying properties

2017-10-30 00:13:23,450 [main] INFO kafka.utils.VerifiableProperties - Property auto.commit.enable is overridden to false

2017-10-30 00:13:23,450 [main] INFO kafka.utils.VerifiableProperties - Property consumer.id is overridden to kafka-tranquility-scus-1

2017-10-30 00:13:23,450 [main] INFO kafka.utils.VerifiableProperties - Property group.id is overridden to tranquility-kafka-calls-1

2017-10-30 00:13:23,450 [main] INFO kafka.utils.VerifiableProperties - Property zookeeper.connect is overridden to hanalytics-ambari-master-scus-1:2181

2017-10-30 00:13:23,450 [main] INFO kafka.utils.VerifiableProperties - Property zookeeper.session.timeout.ms is overridden to 20000

2017-10-30 00:13:23,496 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], Connecting to zookeeper instance at hanalytics-ambari-master-scus-1:2181

2017-10-30 00:13:23,512 [ZkClient-EventThread-12-hanalytics-ambari-master-scus-1:2181] INFO org.I0Itec.zkclient.ZkEventThread - Starting ZkClient event thread.

2017-10-30 00:13:23,513 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT

2017-10-30 00:13:23,513 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=hanalytics-ambari-slave-scus-1.analytics.azure.local

2017-10-30 00:13:23,513 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_144

2017-10-30 00:13:23,513 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation

2017-10-30 00:13:23,513 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.144-0.b01.el7_4.x86_64/jre

2017-10-30 00:13:23,513 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.tranquility-distribution-0.9.0-SNAPSHOT.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.tranquility-core-0.9.0-SNAPSHOT.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.tranquility-server-0.9.0-SNAPSHOT.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.scala-lang.scala-library-2.11.8.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.metamx.scala-util_2.11-1.13.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.metamx.java-util-0.28.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.slf4j.slf4j-api-1.7.25.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.skife.config.config-magic-0.17.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.google.guava.guava-16.0.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.core.jackson-annotations-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.core.jackson-core-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/net.sf.opencsv.opencsv-2.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/joda-time.joda-time-2.9.7.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.mozilla.rhino-1.7R5.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.jayway.jsonpath.json-path-2.1.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.metamx.http-client-1.1.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-3.10.5.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.metamx.emitter-0.4.5.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/javax.validation.validation-api-1.1.0.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.metamx.server-metrics-0.4.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.gridkit.lab.jvm-attach-api-1.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.joda.joda-convert-1.8.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.yaml.snakeyaml-1.11.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.github.nscala-time.nscala-time_2.11-2.16.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.dataformat.jackson-dataformat-smile-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.datatype.jackson-datatype-joda-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.module.jackson-module-scala_2.11-2.4.5.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.scala-lang.scala-reflect-2.11.8.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.thoughtworks.paranamer.paranamer-2.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.jdbi.jdbi-2.70.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.h2database.h2-1.3.158.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/c3p0.c3p0-0.9.1.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.zookeeper.zookeeper-3.4.10.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/jline.jline-0.9.94.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.curator.curator-framework-2.12.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.curator.curator-client-2.12.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.curator.curator-recipes-2.12.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.curator.curator-x-discovery-2.12.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.codehaus.jackson.jackson-mapper-asl-1.9.13.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.codehaus.jackson.jackson-core-asl-1.9.13.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-core_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-function_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.scala-lang.modules.scala-parser-combinators_2.11-1.0.4.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.finagle-core_2.11-6.43.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.finagle-toggle_2.11-6.43.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-app_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-registry_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-logging_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-stats_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-lint_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.github.ben-manes.caffeine.caffeine-2.3.4.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-cache_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-codec_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-hashing_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-jvm_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-security_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-tunable_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.finagle-http_2.11-6.43.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.finagle-base-http_2.11-6.43.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.util-collection_2.11-6.42.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/commons-lang.commons-lang-2.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.finagle-netty4-http_2.11-6.43.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.finagle-netty4_2.11-6.43.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-handler-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-buffer-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-common-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-transport-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-resolver-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-codec-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-transport-native-epoll-4.1.8.Final-linux-x86_64.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-handler-proxy-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-codec-socks-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-codec-http-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.twitter.finagle-http2_2.11-6.43.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.netty.netty-codec-http2-4.1.8.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.slf4j.jul-to-slf4j-1.7.25.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.httpcomponents.httpclient-4.3.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.httpcomponents.httpcore-4.3.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/commons-logging.commons-logging-1.1.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.druid-server-0.9.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.druid-processing-0.9.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.druid-common-0.9.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.druid-api-0.9.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.google.inject.guice-4.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/javax.inject.javax.inject-1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/aopalliance.aopalliance-1.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.google.inject.extensions.guice-multibindings-4.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.airlift.airline-0.7.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.google.code.findbugs.annotations-2.0.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.hibernate.hibernate-validator-5.1.3.Final.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.jboss.logging.jboss-logging-3.1.3.GA.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.classmate-1.0.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/commons-io.commons-io-2.4.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/commons-codec.commons-codec-1.7.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.commons.commons-dbcp2-2.0.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.commons.commons-pool2-2.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/commons-pool.commons-pool-1.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/javax.el.javax.el-api-3.0.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.datatype.jackson-datatype-guava-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.logging.log4j.log4j-jul-2.5.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/net.java.dev.jets3t.jets3t-0.9.4.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/javax.activation.activation-1.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.bouncycastle.bcprov-jdk15on-1.52.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.jamesmurty.utils.java-xmlbuilder-1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/net.iharder.base64-2.3.8.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.antlr.antlr4-runtime-4.5.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.metamx.bytebuffer-collections-0.2.5.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.metamx.extendedset-1.3.10.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.roaringbitmap.RoaringBitmap-0.5.18.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.ning.compress-lzf-1.0.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.google.protobuf.protobuf-java-2.5.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.ibm.icu.icu4j-4.8.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/net.jpountz.lz4.lz4-1.3.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.mapdb.mapdb-1.0.8.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.druid-aws-common-0.9.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-support-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-core-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-simpledb-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-simpleworkflow-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-storagegateway-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-route53-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-s3-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-kms-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-importexport-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-sts-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-sqs-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-rds-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-redshift-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-elasticbeanstalk-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-glacier-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-sns-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-iam-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-datapipeline-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-elasticloadbalancing-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-emr-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-elasticache-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-elastictranscoder-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-ec2-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-dynamodb-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cloudtrail-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cloudwatch-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-logs-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cognitoidentity-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cognitosync-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-directconnect-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cloudformation-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cloudfront-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-kinesis-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-opsworks-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-ses-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-autoscaling-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cloudsearch-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cloudwatchmetrics-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-swf-libraries-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-codedeploy-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-codepipeline-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-config-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-lambda-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-ecs-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-cloudhsm-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-ssm-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-workspaces-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-machinelearning-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-directory-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-efs-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-codecommit-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.amazonaws.aws-java-sdk-devicefarm-1.10.21.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.druid.druid-console-0.0.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/commons-cli.commons-cli-1.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.glassfish.javax.el-3.0.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.jaxrs.jackson-jaxrs-json-provider-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.jaxrs.jackson-jaxrs-base-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.module.jackson-module-jaxb-annotations-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.fasterxml.jackson.jaxrs.jackson-jaxrs-smile-provider-2.4.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.sun.jersey.jersey-server-1.19.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.sun.jersey.jersey-core-1.19.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/javax.ws.rs.jsr311-api-1.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.google.inject.extensions.guice-servlet-4.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.sun.jersey.contribs.jersey-guice-1.19.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-server-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/javax.servlet.javax.servlet-api-3.1.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-http-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-util-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-io-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-proxy-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-client-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.tesla.aether.tesla-aether-0.0.5.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.aether.aether-api-0.9.0.M2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.aether.aether-spi-0.9.0.M2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.aether.aether-util-0.9.0.M2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.aether.aether-impl-0.9.0.M2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.aether.aether-connector-file-0.9.0.M2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/io.tesla.aether.aether-connector-okhttp-0.0.9.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.squareup.okhttp.okhttp-1.0.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.maven.wagon.wagon-provider-api-2.4.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.maven.maven-aether-provider-3.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.maven.maven-model-3.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.codehaus.plexus.plexus-utils-3.0.15.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.maven.maven-model-builder-3.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.codehaus.plexus.plexus-interpolation-1.19.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.maven.maven-repository-metadata-3.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.maven.maven-settings-builder-3.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.maven.maven-settings-3.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/net.spy.spymemcached-2.11.7.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-servlet-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-security-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-servlets-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.eclipse.jetty.jetty-continuation-9.2.5.v20141112.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.ircclouds.irc.irc-api-1.0-0014.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.maxmind.geoip2.geoip2-0.4.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.maxmind.maxminddb.maxminddb-0.2.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.google.http-client.google-http-client-jackson2-1.15.0-rc.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.derby.derby-10.11.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.derby.derbynet-10.11.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.derby.derbyclient-10.11.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.commons.commons-math3-3.6.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.kafka.kafka_2.11-0.10.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.kafka.kafka-clients-0.10.1.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.xerial.snappy.snappy-java-1.1.2.6.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/net.sf.jopt-simple.jopt-simple-4.9.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.yammer.metrics.metrics-core-2.2.0.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.101tec.zkclient-0.9.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/ch.qos.logback.logback-core-1.1.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/ch.qos.logback.logback-classic-1.1.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.logging.log4j.log4j-to-slf4j-2.4.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.apache.logging.log4j.log4j-api-2.4.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.slf4j.log4j-over-slf4j-1.7.12.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.scalatra.scalatra_2.11-2.3.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.scalatra.scalatra-common_2.11-2.3.1.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.clapper.grizzled-slf4j_2.11-1.0.2.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.scalatra.rl.rl_2.11-0.4.10.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/com.googlecode.juniversalchardet.juniversalchardet-1.0.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/eu.medsea.mimeutil.mime-util-2.1.3.jar:/opt/tranquility-distribution-0.9.0-SNAPSHOT/lib/org.scala-lang.modules.scala-xml_2.11-1.0.3.jar

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.10.0-514.26.2.el7.x86_64

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=druidadmin

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/druidadmin

2017-10-30 00:13:23,514 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/opt/tranquility-distribution-0.9.0-SNAPSHOT

2017-10-30 00:13:23,515 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=hanalytics-ambari-master-scus-1:2181 sessionTimeout=20000 watcher=org.I0Itec.zkclient.ZkClient@7b420819

2017-10-30 00:13:23,526 [main] INFO org.I0Itec.zkclient.ZkClient - Waiting for keeper state SyncConnected

2017-10-30 00:13:23,529 [main-SendThread(hanalytics-ambari-master-scus-1.analytics.azure.local:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server hanalytics-ambari-master-scus-1.analytics.azure.local/192.168.60.7:2181. Will not attempt to authenticate using SASL (unknown error)

2017-10-30 00:13:23,588 [main-SendThread(hanalytics-ambari-master-scus-1.analytics.azure.local:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to hanalytics-ambari-master-scus-1.analytics.azure.local/192.168.60.7:2181, initiating session

2017-10-30 00:13:23,612 [main-SendThread(hanalytics-ambari-master-scus-1.analytics.azure.local:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server hanalytics-ambari-master-scus-1.analytics.azure.local/192.168.60.7:2181, sessionid = 0x15f3b78afe40061, negotiated timeout = 20000

2017-10-30 00:13:23,614 [main-EventThread] INFO org.I0Itec.zkclient.ZkClient - zookeeper state changed (SyncConnected)

2017-10-30 00:13:23,628 [main] INFO c.m.tranquility.kafka.KafkaConsumer - Kafka topic filter [(CallStats-clean)]

2017-10-30 00:13:23,652 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], begin registering consumer tranquility-kafka-calls-1_kafka-tranquility-scus-1 in ZK

2017-10-30 00:13:23,677 [main] INFO kafka.utils.ZKCheckedEphemeral - Creating /consumers/tranquility-kafka-calls-1/ids/tranquility-kafka-calls-1_kafka-tranquility-scus-1 (is it secure? false)

2017-10-30 00:13:23,691 [main] INFO kafka.utils.ZKCheckedEphemeral - Result of znode creation is: OK

2017-10-30 00:13:23,692 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], end registering consumer tranquility-kafka-calls-1_kafka-tranquility-scus-1 in ZK

2017-10-30 00:13:23,697 [tranquility-kafka-calls-1_kafka-tranquility-scus-1_watcher_executor] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], starting watcher executor thread for consumer tranquility-kafka-calls-1_kafka-tranquility-scus-1

2017-10-30 00:13:23,720 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], begin rebalancing consumer tranquility-kafka-calls-1_kafka-tranquility-scus-1 try #0

2017-10-30 00:13:23,871 [main] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1509322403623] Stopping leader finder thread

2017-10-30 00:13:23,872 [main] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1509322403623] Stopping all fetchers

2017-10-30 00:13:23,873 [main] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1509322403623] All connections stopped

2017-10-30 00:13:23,874 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], Cleared all relevant queues for this fetcher

2017-10-30 00:13:23,876 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], Cleared the data chunks in all the consumer message iterators

2017-10-30 00:13:23,876 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], Releasing partition ownership

2017-10-30 00:13:23,922 [main] INFO kafka.consumer.RangeAssignor - Consumer tranquility-kafka-calls-1_kafka-tranquility-scus-1 rebalancing the following partitions: ArrayBuffer(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11) for topic CallStats-clean with consumers: List(tranquility-kafka-calls-1_kafka-tranquility-scus-1-0, tranquility-kafka-calls-1_kafka-tranquility-scus-1-1)

2017-10-30 00:13:23,924 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 attempting to claim partition 0

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 attempting to claim partition 1

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 attempting to claim partition 2

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 attempting to claim partition 3

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 attempting to claim partition 4

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 attempting to claim partition 5

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 attempting to claim partition 6

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 attempting to claim partition 7

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 attempting to claim partition 8

2017-10-30 00:13:23,925 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 attempting to claim partition 9

2017-10-30 00:13:23,926 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 attempting to claim partition 10

2017-10-30 00:13:23,926 [main] INFO kafka.consumer.RangeAssignor - tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 attempting to claim partition 11

2017-10-30 00:13:23,977 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 successfully owned partition 11 for topic CallStats-clean

2017-10-30 00:13:23,985 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 successfully owned partition 1 for topic CallStats-clean

2017-10-30 00:13:23,992 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 successfully owned partition 8 for topic CallStats-clean

2017-10-30 00:13:24,001 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 successfully owned partition 5 for topic CallStats-clean

2017-10-30 00:13:24,009 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 successfully owned partition 6 for topic CallStats-clean

2017-10-30 00:13:24,029 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 successfully owned partition 9 for topic CallStats-clean

2017-10-30 00:13:24,036 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 successfully owned partition 7 for topic CallStats-clean

2017-10-30 00:13:24,046 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 successfully owned partition 4 for topic CallStats-clean

2017-10-30 00:13:24,054 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 successfully owned partition 3 for topic CallStats-clean

2017-10-30 00:13:24,061 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-1 successfully owned partition 10 for topic CallStats-clean

2017-10-30 00:13:24,068 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 successfully owned partition 0 for topic CallStats-clean

2017-10-30 00:13:24,076 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], tranquility-kafka-calls-1_kafka-tranquility-scus-1-0 successfully owned partition 2 for topic CallStats-clean

2017-10-30 00:13:24,090 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], Consumer tranquility-kafka-calls-1_kafka-tranquility-scus-1 selected partitions : CallStats-clean:0: fetched offset = 1997527: consumed offset = 1997527,CallStats-clean:1: fetched offset = 1997527: consumed offset = 1997527,CallStats-clean:2: fetched offset = 1997528: consumed offset = 1997528,CallStats-clean:3: fetched offset = 1997607: consumed offset = 1997607,CallStats-clean:4: fetched offset = 1997422: consumed offset = 1997422,CallStats-clean:5: fetched offset = 1997505: consumed offset = 1997505,CallStats-clean:6: fetched offset = 1997424: consumed offset = 1997424,CallStats-clean:7: fetched offset = 1997565: consumed offset = 1997565,CallStats-clean:8: fetched offset = 1997490: consumed offset = 1997490,CallStats-clean:9: fetched offset = 1997563: consumed offset = 1997563,CallStats-clean:10: fetched offset = 1997419: consumed offset = 1997419,CallStats-clean:11: fetched offset = 1997465: consumed offset = 1997465

2017-10-30 00:13:24,093 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO k.c.ConsumerFetcherManager$LeaderFinderThread - [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread], Starting

2017-10-30 00:13:24,095 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], end rebalancing consumer tranquility-kafka-calls-1_kafka-tranquility-scus-1 try #0

2017-10-30 00:13:24,097 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], Creating topic event watcher for topics (CallStats-clean)

2017-10-30 00:13:24,105 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], Topics to consume = List(CallStats-clean)

2017-10-30 00:13:24,165 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Verifying properties

2017-10-30 00:13:24,165 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property client.id is overridden to tranquility-kafka-calls-1

2017-10-30 00:13:24,165 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property metadata.broker.list is overridden to hanalytics-ambari-master-scus-1.analytics.azure.local:6667,hanalytics-ambari-master-scus-2.analytics.azure.local:6667,hanalytics-ambari-master-scus-3.analytics.azure.local:6667

2017-10-30 00:13:24,165 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property request.timeout.ms is overridden to 30000

2017-10-30 00:13:24,177 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO kafka.client.ClientUtils$ - Fetching metadata from broker BrokerEndPoint(1003,hanalytics-ambari-master-scus-3.analytics.azure.local,6667) with correlation id 0 for 1 topic(s) Set(CallStats-clean)

2017-10-30 00:13:24,181 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO kafka.producer.SyncProducer - Connected to hanalytics-ambari-master-scus-3.analytics.azure.local:6667 for producing

2017-10-30 00:13:24,196 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO kafka.producer.SyncProducer - Disconnecting from hanalytics-ambari-master-scus-3.analytics.azure.local:6667

2017-10-30 00:13:24,211 [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1003] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1003], Starting

2017-10-30 00:13:24,219 [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1002] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1002], Starting

2017-10-30 00:13:24,220 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1509322403623] Added fetcher for partitions ArrayBuffer([CallStats-clean-2, initOffset 1997528 to broker BrokerEndPoint(1002,hanalytics-ambari-master-scus-2.analytics.azure.local,6667)] , [CallStats-clean-5, initOffset 1997505 to broker BrokerEndPoint(1002,hanalytics-ambari-master-scus-2.analytics.azure.local,6667)] , [CallStats-clean-10, initOffset 1997419 to broker BrokerEndPoint(1001,hanalytics-ambari-master-scus-1.analytics.azure.local,6667)] , [CallStats-clean-7, initOffset 1997565 to broker BrokerEndPoint(1001,hanalytics-ambari-master-scus-1.analytics.azure.local,6667)] , [CallStats-clean-4, initOffset 1997422 to broker BrokerEndPoint(1001,hanalytics-ambari-master-scus-1.analytics.azure.local,6667)] , [CallStats-clean-1, initOffset 1997527 to broker BrokerEndPoint(1001,hanalytics-ambari-master-scus-1.analytics.azure.local,6667)] , [CallStats-clean-6, initOffset 1997424 to broker BrokerEndPoint(1003,hanalytics-ambari-master-scus-3.analytics.azure.local,6667)] , [CallStats-clean-9, initOffset 1997563 to broker BrokerEndPoint(1003,hanalytics-ambari-master-scus-3.analytics.azure.local,6667)] , [CallStats-clean-3, initOffset 1997607 to broker BrokerEndPoint(1003,hanalytics-ambari-master-scus-3.analytics.azure.local,6667)] , [CallStats-clean-11, initOffset 1997465 to broker BrokerEndPoint(1002,hanalytics-ambari-master-scus-2.analytics.azure.local,6667)] , [CallStats-clean-0, initOffset 1997527 to broker BrokerEndPoint(1003,hanalytics-ambari-master-scus-3.analytics.azure.local,6667)] , [CallStats-clean-8, initOffset 1997490 to broker BrokerEndPoint(1002,hanalytics-ambari-master-scus-2.analytics.azure.local,6667)] )

2017-10-30 00:13:24,221 [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1001] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1001], Starting

2017-10-30 00:13:24,379 [KafkaConsumer-0] INFO c.m.t.kafka.writer.WriterController - Creating EventWriter for topic [CallStats-clean] using dataSource [CallStats]

2017-10-30 00:13:24,476 [KafkaConsumer-0] INFO o.a.c.f.imps.CuratorFrameworkImpl - Starting

2017-10-30 00:13:24,478 [KafkaConsumer-0] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=hanalytics-ambari-master-scus-1:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@70f50517

2017-10-30 00:13:24,482 [KafkaConsumer-0-SendThread(hanalytics-ambari-master-scus-1.analytics.azure.local:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server hanalytics-ambari-master-scus-1.analytics.azure.local/192.168.60.7:2181. Will not attempt to authenticate using SASL (unknown error)

2017-10-30 00:13:24,490 [KafkaConsumer-0-SendThread(hanalytics-ambari-master-scus-1.analytics.azure.local:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to hanalytics-ambari-master-scus-1.analytics.azure.local/192.168.60.7:2181, initiating session

2017-10-30 00:13:24,497 [KafkaConsumer-0-SendThread(hanalytics-ambari-master-scus-1.analytics.azure.local:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server hanalytics-ambari-master-scus-1.analytics.azure.local/192.168.60.7:2181, sessionid = 0x15f3b78afe40062, negotiated timeout = 60000

2017-10-30 00:13:24,500 [KafkaConsumer-0-EventThread] INFO o.a.c.f.state.ConnectionStateManager - State change: CONNECTED

2017-10-30 00:13:24,611 [KafkaConsumer-0] INFO c.m.t.finagle.FinagleRegistry - Adding resolver for scheme[disco].

2017-10-30 00:13:25,913 [KafkaConsumer-0] INFO o.h.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final

2017-10-30 00:13:26,197 [KafkaConsumer-0] INFO io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory=‘extensions’, hadoopDependenciesDir=‘hadoop-dependencies’, hadoopContainerDruidClasspath=‘null’, loadList=null}]

2017-10-30 00:13:26,457 [KafkaConsumer-1] INFO c.m.t.kafka.writer.WriterController - Creating EventWriter for topic [CallStats-clean] using dataSource [callstats]

2017-10-30 00:13:26,461 [KafkaConsumer-0] ERROR c.m.tranquility.kafka.KafkaConsumer - Exception:

java.lang.IllegalArgumentException: Instantiation of [simple type, class io.druid.data.input.impl.StringInputRowParser] value failed: json can not be null or empty

at com.fasterxml.jackson.databind.ObjectMapper._convert(ObjectMapper.java:2774) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.ObjectMapper.convertValue(ObjectMapper.java:2700) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at io.druid.segment.indexing.DataSchema.getParser(DataSchema.java:101) ~[io.druid.druid-server-0.9.2.jar:0.9.2]

at com.metamx.tranquility.druid.DruidBeams$.fromConfigInternal(DruidBeams.scala:294) ~[io.druid.tranquility-core-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.druid.DruidBeams$.fromConfig(DruidBeams.scala:197) ~[io.druid.tranquility-core-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.KafkaBeamUtils$.createTranquilizer(KafkaBeamUtils.scala:40) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.KafkaBeamUtils.createTranquilizer(KafkaBeamUtils.scala) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.writer.TranquilityEventWriter.(TranquilityEventWriter.java:64) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.writer.WriterController.createWriter(WriterController.java:171) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.writer.WriterController.getWriter(WriterController.java:98) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.KafkaConsumer$2.run(KafkaConsumer.java:231) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_144]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_144]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_144]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_144]

at java.lang.Thread.run(Thread.java:748) [na:1.8.0_144]

Caused by: com.fasterxml.jackson.databind.JsonMappingException: Instantiation of [simple type, class io.druid.data.input.impl.StringInputRowParser] value failed: json can not be null or empty

at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.wrapException(StdValueInstantiator.java:405) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:234) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:167) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:398) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1064) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:264) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:156) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.ObjectMapper._convert(ObjectMapper.java:2769) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

… 15 common frames omitted

Caused by: java.lang.IllegalArgumentException: json can not be null or empty

at com.jayway.jsonpath.internal.Utils.notEmpty(Utils.java:383) ~[com.jayway.jsonpath.json-path-2.1.0.jar:2.1.0]

at com.jayway.jsonpath.JsonPath.compile(JsonPath.java:465) ~[com.jayway.jsonpath.json-path-2.1.0.jar:2.1.0]

at com.metamx.common.parsers.JSONPathParser.generateFieldPaths(JSONPathParser.java:137) ~[com.metamx.java-util-0.28.2.jar:na]

at com.metamx.common.parsers.JSONPathParser.(JSONPathParser.java:62) ~[com.metamx.java-util-0.28.2.jar:na]

at io.druid.data.input.impl.JSONParseSpec.makeParser(JSONParseSpec.java:74) ~[io.druid.druid-api-0.9.2.jar:0.9.2]

at io.druid.data.input.impl.StringInputRowParser.(StringInputRowParser.java:56) ~[io.druid.druid-api-0.9.2.jar:0.9.2]

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_144]

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_144]

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_144]

at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_144]

at com.fasterxml.jackson.databind.introspect.AnnotatedConstructor.call(AnnotatedConstructor.java:125) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:230) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

… 26 common frames omitted

2017-10-30 00:13:26,466 [KafkaConsumer-1] ERROR c.m.tranquility.kafka.KafkaConsumer - Exception:

java.lang.IllegalArgumentException: Instantiation of [simple type, class io.druid.data.input.impl.StringInputRowParser] value failed: json can not be null or empty

at com.fasterxml.jackson.databind.ObjectMapper._convert(ObjectMapper.java:2774) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.ObjectMapper.convertValue(ObjectMapper.java:2700) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at io.druid.segment.indexing.DataSchema.getParser(DataSchema.java:101) ~[io.druid.druid-server-0.9.2.jar:0.9.2]

at com.metamx.tranquility.druid.DruidBeams$.fromConfigInternal(DruidBeams.scala:294) ~[io.druid.tranquility-core-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.druid.DruidBeams$.fromConfig(DruidBeams.scala:197) ~[io.druid.tranquility-core-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.KafkaBeamUtils$.createTranquilizer(KafkaBeamUtils.scala:40) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.KafkaBeamUtils.createTranquilizer(KafkaBeamUtils.scala) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.writer.TranquilityEventWriter.(TranquilityEventWriter.java:64) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.writer.WriterController.createWriter(WriterController.java:171) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.writer.WriterController.getWriter(WriterController.java:98) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at com.metamx.tranquility.kafka.KafkaConsumer$2.run(KafkaConsumer.java:231) ~[io.druid.tranquility-kafka-0.9.0-SNAPSHOT.jar:0.9.0-SNAPSHOT]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_144]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_144]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_144]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_144]

at java.lang.Thread.run(Thread.java:748) [na:1.8.0_144]

Caused by: com.fasterxml.jackson.databind.JsonMappingException: Instantiation of [simple type, class io.druid.data.input.impl.StringInputRowParser] value failed: json can not be null or empty

at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.wrapException(StdValueInstantiator.java:405) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:234) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:167) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:398) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1064) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:264) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:156) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.ObjectMapper._convert(ObjectMapper.java:2769) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

… 15 common frames omitted

Caused by: java.lang.IllegalArgumentException: json can not be null or empty

at com.jayway.jsonpath.internal.Utils.notEmpty(Utils.java:383) ~[com.jayway.jsonpath.json-path-2.1.0.jar:2.1.0]

at com.jayway.jsonpath.JsonPath.compile(JsonPath.java:465) ~[com.jayway.jsonpath.json-path-2.1.0.jar:2.1.0]

at com.metamx.common.parsers.JSONPathParser.generateFieldPaths(JSONPathParser.java:137) ~[com.metamx.java-util-0.28.2.jar:na]

at com.metamx.common.parsers.JSONPathParser.(JSONPathParser.java:62) ~[com.metamx.java-util-0.28.2.jar:na]

at io.druid.data.input.impl.JSONParseSpec.makeParser(JSONParseSpec.java:74) ~[io.druid.druid-api-0.9.2.jar:0.9.2]

at io.druid.data.input.impl.StringInputRowParser.(StringInputRowParser.java:56) ~[io.druid.druid-api-0.9.2.jar:0.9.2]

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_144]

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_144]

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_144]

at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_144]

at com.fasterxml.jackson.databind.introspect.AnnotatedConstructor.call(AnnotatedConstructor.java:125) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:230) ~[com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:2.4.6]

… 26 common frames omitted

2017-10-30 00:13:26,468 [KafkaConsumer-0] INFO c.m.tranquility.kafka.KafkaConsumer - Shutting down - attempting to flush buffers and commit final offsets

2017-10-30 00:13:26,470 [Curator-Framework-0] INFO o.a.c.f.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting

2017-10-30 00:13:26,479 [KafkaConsumer-0] INFO org.apache.zookeeper.ZooKeeper - Session: 0x15f3b78afe40062 closed

2017-10-30 00:13:26,479 [KafkaConsumer-0-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x15f3b78afe40062

2017-10-30 00:13:26,496 [KafkaConsumer-0] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], ZKConsumerConnector shutting down

2017-10-30 00:13:26,507 [KafkaConsumer-0] INFO k.c.ZookeeperTopicEventWatcher - Shutting down topic event watcher.

2017-10-30 00:13:26,507 [KafkaConsumer-0] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1509322403623] Stopping leader finder thread

2017-10-30 00:13:26,507 [KafkaConsumer-0] INFO k.c.ConsumerFetcherManager$LeaderFinderThread - [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread], Shutting down

2017-10-30 00:13:26,508 [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread] INFO k.c.ConsumerFetcherManager$LeaderFinderThread - [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread], Stopped

2017-10-30 00:13:26,508 [KafkaConsumer-0] INFO k.c.ConsumerFetcherManager$LeaderFinderThread - [tranquility-kafka-calls-1_kafka-tranquility-scus-1-leader-finder-thread], Shutdown completed

2017-10-30 00:13:26,509 [KafkaConsumer-0] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1509322403623] Stopping all fetchers

2017-10-30 00:13:26,509 [KafkaConsumer-0] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1003], Shutting down

2017-10-30 00:13:26,509 [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1003] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1003], Stopped

2017-10-30 00:13:26,510 [KafkaConsumer-0] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1003], Shutdown completed

2017-10-30 00:13:26,520 [KafkaConsumer-0] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1002], Shutting down

2017-10-30 00:13:26,520 [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1002] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1002], Stopped

2017-10-30 00:13:26,521 [KafkaConsumer-0] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1002], Shutdown completed

2017-10-30 00:13:26,522 [KafkaConsumer-0] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1001], Shutting down

2017-10-30 00:13:26,525 [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1001] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1001], Stopped

2017-10-30 00:13:26,525 [KafkaConsumer-0] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka-calls-1_kafka-tranquility-scus-1-0-1001], Shutdown completed

2017-10-30 00:13:26,527 [KafkaConsumer-0] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1509322403623] All connections stopped

2017-10-30 00:13:26,528 [ZkClient-EventThread-12-hanalytics-ambari-master-scus-1:2181] INFO org.I0Itec.zkclient.ZkEventThread - Terminate ZkClient event thread.

2017-10-30 00:13:26,537 [KafkaConsumer-0] INFO org.apache.zookeeper.ZooKeeper - Session: 0x15f3b78afe40061 closed

2017-10-30 00:13:26,538 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x15f3b78afe40061

2017-10-30 00:13:26,538 [KafkaConsumer-0] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], ZKConsumerConnector shutdown completed in 41 ms

2017-10-30 00:13:26,538 [KafkaConsumer-0] INFO c.m.tranquility.kafka.KafkaConsumer - Finished clean shutdown.

2017-10-30 00:13:26,538 [KafkaConsumer-CommitThread] INFO c.m.tranquility.kafka.KafkaConsumer - Commit thread interrupted.

2017-10-30 00:13:26,700 [tranquility-kafka-calls-1_kafka-tranquility-scus-1_watcher_executor] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka-calls-1_kafka-tranquility-scus-1], stopping watcher executor thread for consumer tranquility-kafka-calls-1_kafka-tranquility-scus-1

2017-10-30 00:13:26,702 [Thread-4] INFO c.metamx.tranquility.kafka.KafkaMain - Initiating shutdown…

misconfiguration, missing expr here:

“type”: “path”,

“name”: “txactratekbps”,

“path”: “$.txActRateKbps”

path should be expr

Kyle

I feel so stupid for missing that. That was indeed my problem - thank you!.

Once fixed things started running correctly - my only issue now is that I’m showing dropped messages, and nothing ending up in druid. What causes messages to be dropped? Do I need to look in druid index/middlemanager/historical node logs? I see no errors from tranquility now.

2017-10-30 19:24:39,052 [KafkaConsumer-CommitThread] INFO c.m.tranquility.kafka.KafkaConsumer - Flushed {CallStats-clean={receivedCount=8960, sentCount=0, droppedCount=8960, unparseableCount=0}} pending messages in 3ms and committed offsets in 126ms.

2017-10-30 19:24:54,150 [KafkaConsumer-CommitThread] INFO c.m.tranquility.kafka.KafkaConsumer - Flushed {CallStats-clean={receivedCount=26029, sentCount=0, droppedCount=26029, unparseableCount=0}} pending messages in 0ms and committed offsets in 97ms.

2017-10-30 19:25:09,249 [KafkaConsumer-CommitThread] INFO c.m.tranquility.kafka.KafkaConsumer - Flushed {CallStats-clean={receivedCount=36959, sentCount=0, droppedCount=36959, unparseableCount=0}} pending messages in 0ms and committed offsets in 98ms.

Messages will be dropped if the timestamp falls outside of the realtime segment period & threshold (windowPeriod)
there is some similar discussion here:

https://groups.google.com/forum/#!searchin/druid-user/dropped|sort:date/druid-user/6Ux_OTjZaiE/wJRJc_UpBQAJ

see faq:

Oh I get it - I hand-built this type of period in my logstash setups - except I was a bit more wide with my policy - I gave it a day.

Would it be unusual to temporarily set the window period to something like 10 days to allow loading of some older data to catch up to “now” then set the window back to 10 minutes (or something appropriate)?

Thanks for the help - it is greatly appreciated.

Yes it would be unusual. You’ll need to investigate batch ingest for your large historical data sets (see http://druid.io/docs/0.10.1/ingestion/batch-ingestion.html and http://druid.io/docs/0.10.1/ingestion/tasks.html). Tranquility & its real time segments are not meant to store that wide of a range of aggregation. Alternatively you could replace tranquility with KIS (Kafka Indexing Service - http://druid.io/docs/0.10.1/development/extensions-core/kafka-ingestion.html) as KIS is not subject to the realtime window constraints.