druid 0.11.0 kafka indexing service query slow when handoff segments

slowdown query metrics:

broker.log

2018-06-19 17:09:30,904 INFO [qtp1869400026-155] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.904Z","service":"druid/broker","host":"172.16.10.84:8082","version":"0.11.0","metric":"query/time","value":20624,"context":"{\"defaultTimeout\":300000,\"maxScatterGatherBytes\":9223372036854775807,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":300000}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT61750.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T16:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.1.165","success":"true","threshold":"1","type":"topN"}]

historical.log:


2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_8","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_8","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_8","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [qtp2133359512-89] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/cpu/time","value":1163,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [qtp2133359512-89] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/time","value":1,"context":"{\"bySegment\":true,\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"populateCache\":false,\"priority\":0,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279385}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [qtp2133359512-89] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-others-002:8083","version":"0.11.0","metric":"query/bytes","value":654,"context":"{\"bySegment\":true,\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"populateCache\":false,\"priority\":0,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279385}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

historical-2.log


2018-06-19 17:09:30,894 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.894Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_6","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_6","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_6","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T05:00:00.000Z_2018-06-19T06:00:00.000Z_2018-06-19T05:00:01.491Z_18","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T05:00:00.000Z_2018-06-19T06:00:00.000Z_2018-06-19T05:00:01.491Z_18","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T05:00:00.000Z_2018-06-19T06:00:00.000Z_2018-06-19T05:00:01.491Z_18","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_2","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_2","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_2","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [qtp2138849804-89] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/cpu/time","value":2278,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [qtp2138849804-89] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/time","value":1,"context":"{\"bySegment\":true,\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"populateCache\":false,\"priority\":0,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279386}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [qtp2138849804-89] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-001:8083","version":"0.11.0","metric":"query/bytes","value":887,"context":"{\"bySegment\":true,\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"populateCache\":false,\"priority\":0,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279386}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T05:00:00.000Z/2018-06-19T06:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

historical-3.log


2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-18T20:00:00.000Z_2018-06-18T21:00:00.000Z_2018-06-18T20:00:02.637Z_10","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-18T20:00:00.000Z_2018-06-18T21:00:00.000Z_2018-06-18T20:00:02.637Z_10","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,895 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.895Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-18T20:00:00.000Z_2018-06-18T21:00:00.000Z_2018-06-18T20:00:02.637Z_10","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_9","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_9","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_9","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_3","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_4","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_4","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_7","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_3","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_7","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_3","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_4","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_1","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_7","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_1","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,896 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.896Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_1","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_5","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_5","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_5","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,897 INFO [qtp500096147-94] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/cpu/time","value":9694,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,897 INFO [qtp500096147-94] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/time","value":2,"context":"{\"bySegment\":true,\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"populateCache\":false,\"priority\":0,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279385}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

2018-06-19 17:09:30,897 INFO [qtp500096147-94] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/historical","host":"druid-historical-002:8083","version":"0.11.0","metric":"query/bytes","value":2051,"context":"{\"bySegment\":true,\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"populateCache\":false,\"priority\":0,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279385}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT7200S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-18T20:00:00.000Z/2018-06-18T21:00:00.000Z","2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

peon index logs 1:


2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_16","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_16","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_16","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_15","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_15","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_19","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_17","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_15","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_19","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_17","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_19","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_18","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_18","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_17","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_18","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,900 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.900Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_2","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,900 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.900Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_2","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,900 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.900Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_2","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.900Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_8","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.900Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_9","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_8","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_9","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_8","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_9","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_4","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_6","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_4","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_6","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_4","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,901 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_6","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,902 INFO [qtp427615079-106] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.901Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/cpu/time","value":14019,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT4150.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,902 INFO [qtp427615079-106] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.902Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/time","value":5,"context":"{\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279385}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT4150.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,902 INFO [qtp427615079-106] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.902Z","service":"druid/middleManager","host":"druid-others-002:8103","version":"0.11.0","metric":"query/bytes","value":165,"context":"{\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279385}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT4150.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

peon index logs 2:


2018-06-19T09:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_1","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_1","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_11","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_1","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_10","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_10","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,897 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.897Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_11","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_10","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_11","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_12","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_12","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_12","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_13","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_13","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_13","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_14","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_14","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_7","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT3600S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:00:00.000Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T08:00:00.000Z_2018-06-19T09:00:00.000Z_2018-06-19T08:00:02.655Z_14","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,898 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.898Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_7","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_7","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":0,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_5","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_5","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_5","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segment/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_3","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/wait/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_3","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,899 INFO [topN_transaction_crm_merchant_keeper_ds_[2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z]] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.899Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/segmentAndCache/time","value":1,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT550.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T09:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","segment":"transaction_crm_merchant_keeper_ds_2018-06-19T09:00:00.000Z_2018-06-19T10:00:00.000Z_2018-06-19T09:00:02.759Z_3","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,900 INFO [qtp61138212-99] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.900Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/cpu/time","value":11574,"dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT4150.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,900 INFO [qtp61138212-99] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.900Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/time","value":5,"context":"{\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279385}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT4150.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

2018-06-19T09:09:30,900 INFO [qtp61138212-99] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2018-06-19T09:09:30.900Z","service":"druid/middleManager","host":"druid-others-001:8102","version":"0.11.0","metric":"query/bytes","value":174,"context":"{\"defaultTimeout\":300000,\"finalize\":false,\"maxScatterGatherBytes\":9223372036854775807,\"queryId\":\"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb\",\"timeout\":279385}","dataSource":"transaction_crm_merchant_keeper_ds","dimension":"keeper_id","duration":"PT4150.278S","hasFilters":"true","id":"e9b654cb-739e-4a40-b2d2-c2f2db9e04cb","interval":["2018-06-19T08:00:00.000Z/2018-06-19T09:09:10.278Z"],"numComplexMetrics":"1","numMetrics":"3","remoteAddress":"172.16.10.84","success":"true","threshold":"1000","type":"topN"}]

By the metrics ‘query/time’, historical and peon log shows that it’s quite fast query, but broker shows it’s really slow. It’s weird.