Filtered Dimension Spec on Lookup Dimension

{

“queryType”: “topN”,

“dataSource”: “cxt_url_reporting”,

“intervals”: [

“1970-01-01T00:00:00.000Z/3000-01-01T00:00:00.000Z”

],

“granularity”: {

“type”: “all”

},

“dimension”: {

“type”: “listFiltered”,

“delegate”: {

“name”: “segment_id_lookup”,

“type”: “lookup”,

“dimension”: “sgmt”,

“outputName”: “Segment Name”

},

“values”: [“Cancer”]

},

“metric”: “count”,

“threshold”: 5,

“aggregations”: [{

“type”: “count”,

“name”: “count”

}]

}

Getting this excpetion :

{

“error”: “Unknown exception”,

“errorMessage”: “1”,

“errorClass”: “java.lang.ArrayIndexOutOfBoundsException”,

“host”: “c8-cm-druid-historical-prod-1.srv.media.net:8083

}

Is there any workaround to use listfiltered in lookup dimension

Hi Sonesh,

Can you post the entire stack trace from the historical log file?

Regards,

Muthu Lalapet.

You are not using listFiltered correctly. You need to use filtered with an in filter

Woos, I misread… you are using listFiltered correctly (technically) but I do not think it is what you want. You probably want to filter on that dimension using a normal filer (with the lookup applied).

Hi,

2019-10-23T09:02:35,243 ERROR [qtp1799310296-153[topN_[cxt_url_reporting]_d7224a84-c2f5-415f-9a07-3682f93d6834]] org.apache.druid.server.QueryResource - Exception handling request: {class=org.apache.druid.server.QueryResource, exceptionType=class java.lang.ArrayIndexOutOfBoundsException, exceptionMessage=null, exception=java.lang.ArrayIndexOutOfBoundsException, query=TopNQuery{dataSource=‘cxt_url_reporting’, dimensionSpec=ListFilteredDimensionSpec{values=[Cancer], isWhitelist=true}, topNMetricSpec=NumericTopNMetricSpec{metric=‘count’}, threshold=1000, querySegmentSpec=MultipleSpecificSegmentSpec{descriptors=[SegmentDescriptor{interval=2019-09-10T19:00:00.000Z/2019-09-10T20:00:00.000Z, version=‘2019-09-10T19:00:02.843Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-12T22:00:00.000Z/2019-09-12T23:00:00.000Z, version=‘2019-09-12T22:00:00.880Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-13T13:00:00.000Z/2019-09-13T14:00:00.000Z, version=‘2019-09-13T13:00:02.502Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-14T10:00:00.000Z/2019-09-14T11:00:00.000Z, version=‘2019-09-14T10:00:01.342Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-09-14T16:00:00.000Z/2019-09-14T17:00:00.000Z, version=‘2019-09-14T16:00:03.154Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-09-15T03:00:00.000Z/2019-09-15T04:00:00.000Z, version=‘2019-09-15T03:00:01.631Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-15T06:00:00.000Z/2019-09-15T07:00:00.000Z, version=‘2019-09-15T06:00:05.783Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-16T05:00:00.000Z/2019-09-16T06:00:00.000Z, version=‘2019-09-16T05:00:02.437Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-17T19:00:00.000Z/2019-09-17T20:00:00.000Z, version=‘2019-09-17T19:00:00.953Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-18T13:00:00.000Z/2019-09-18T14:00:00.000Z, version=‘2019-09-18T13:00:01.223Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-09-18T19:00:00.000Z/2019-09-18T20:00:00.000Z, version=‘2019-09-18T19:00:01.527Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-09-19T22:00:00.000Z/2019-09-19T23:00:00.000Z, version=‘2019-09-19T22:00:05.028Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-09-19T23:00:00.000Z/2019-09-20T00:00:00.000Z, version=‘2019-09-19T23:00:04.376Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-20T13:00:00.000Z/2019-09-20T14:00:00.000Z, version=‘2019-09-20T13:00:03.365Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-21T16:00:00.000Z/2019-09-21T17:00:00.000Z, version=‘2019-09-21T16:00:02.890Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-09-22T09:00:00.000Z/2019-09-22T10:00:00.000Z, version=‘2019-09-22T09:00:03.129Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-24T23:00:00.000Z/2019-09-25T00:00:00.000Z, version=‘2019-09-24T23:00:01.269Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-28T03:00:00.000Z/2019-09-28T04:00:00.000Z, version=‘2019-09-28T03:00:03.435Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-29T01:00:00.000Z/2019-09-29T02:00:00.000Z, version=‘2019-09-29T01:00:03.622Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-09-29T21:00:00.000Z/2019-09-29T22:00:00.000Z, version=‘2019-09-29T21:00:04.395Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-09-30T06:00:00.000Z/2019-09-30T07:00:00.000Z, version=‘2019-09-30T06:00:03.698Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-01T17:00:00.000Z/2019-10-01T18:00:00.000Z, version=‘2019-10-01T17:00:02.802Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-02T13:00:00.000Z/2019-10-02T14:00:00.000Z, version=‘2019-10-02T13:00:03.260Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-04T01:00:00.000Z/2019-10-04T02:00:00.000Z, version=‘2019-10-04T01:00:07.097Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-05T13:00:00.000Z/2019-10-05T14:00:00.000Z, version=‘2019-10-05T13:00:01.163Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-10-06T16:00:00.000Z/2019-10-06T17:00:00.000Z, version=‘2019-10-06T16:00:01.807Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-07T09:00:00.000Z/2019-10-07T10:00:00.000Z, version=‘2019-10-07T09:00:05.729Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-10T01:00:00.000Z/2019-10-10T02:00:00.000Z, version=‘2019-10-10T01:00:03.941Z’, partitionNumber=2}, SegmentDescriptor{interval=2019-10-10T03:00:00.000Z/2019-10-10T04:00:00.000Z, version=‘2019-10-10T03:00:02.042Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-10T17:00:00.000Z/2019-10-10T18:00:00.000Z, version=‘2019-10-10T17:00:03.331Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-12T03:00:00.000Z/2019-10-12T04:00:00.000Z, version=‘2019-10-12T03:00:02.340Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-10-12T23:00:00.000Z/2019-10-13T00:00:00.000Z, version=‘2019-10-12T23:00:02.631Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-14T21:00:00.000Z/2019-10-14T22:00:00.000Z, version=‘2019-10-14T21:00:02.688Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-10-15T23:00:00.000Z/2019-10-16T00:00:00.000Z, version=‘2019-10-15T23:00:02.175Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-18T01:00:00.000Z/2019-10-18T02:00:00.000Z, version=‘2019-10-18T01:00:04.408Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-18T07:00:00.000Z/2019-10-18T08:00:00.000Z, version=‘2019-10-18T07:00:06.156Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-20T02:00:00.000Z/2019-10-20T03:00:00.000Z, version=‘2019-10-20T02:00:03.174Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-21T02:00:00.000Z/2019-10-21T03:00:00.000Z, version=‘2019-10-21T02:00:01.798Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-22T19:00:00.000Z/2019-10-22T20:00:00.000Z, version=‘2019-10-22T19:00:03.000Z’, partitionNumber=1}, SegmentDescriptor{interval=2019-10-23T02:00:00.000Z/2019-10-23T03:00:00.000Z, version=‘2019-10-23T02:00:01.468Z’, partitionNumber=0}, SegmentDescriptor{interval=2019-10-23T03:00:00.000Z/2019-10-23T04:00:00.000Z, version=‘2019-10-23T03:00:03.306Z’, partitionNumber=0}]}, virtualColumns=, dimFilter=null, granularity=‘AllGranularity’, aggregatorSpecs=[CountAggregatorFactory{name=‘count’}], postAggregatorSpecs=}, peer=172.16.201.137}
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,243 ERROR [processing-13] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,244 ERROR [processing-13] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,244 ERROR [processing-0] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,244 ERROR [processing-13] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,244 ERROR [processing-14] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,244 ERROR [processing-0] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,244 ERROR [processing-13] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,245 ERROR [processing-0] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,245 ERROR [processing-13] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,245 ERROR [processing-14] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,245 ERROR [processing-0] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,245 ERROR [processing-14] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,245 ERROR [processing-0] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,245 ERROR [processing-14] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,245 ERROR [processing-0] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,246 ERROR [processing-0] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,246 ERROR [processing-2] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,246 ERROR [processing-14] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,246 ERROR [processing-13] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,246 ERROR [processing-2] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,247 ERROR [processing-14] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,247 ERROR [processing-0] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,247 ERROR [processing-13] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,247 ERROR [processing-2] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,247 ERROR [processing-14] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,247 ERROR [processing-14] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException
2019-10-23T09:02:35,247 ERROR [processing-13] org.apache.druid.query.ChainedExecutionQueryRunner - Exception with one of the sequences!
java.lang.ArrayIndexOutOfBoundsException

Hi Somesh,

Can you do the filter without the lookup like Vadim mentioned. Just to role that out.

Regards,

Muthu Lalapet.