Missing dimensions

Dear all,

I do a batch ingestion successfully and in Druid Console UI, it shows all my dimensions defined in the ingestion spec.

But if I use API /druid/v2/datasources/{datasource}/dimensions , it doesn’t show all my dimensions.

I use lib druid-sql 0.12.3 to query all fields in the data source, it also doesn’t show all my dimensions too.

If I try to select the missing dimension, it throw exception:

Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Column ‘src_uid’ not found in any table

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:463)

at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:572)

Anyone know why?

Thanks,

Kien

Dear all,

I do a batch ingestion successfully and in Druid Console UI, it shows all my dimensions defined in the ingestion spec.

But if I use API /druid/v2/datasources/{datasource}/dimensions , it also shows all my dimensions.

I use lib druid-sql 0.12.3 to query all fields in the data source, it also doesn’t show all my dimensions too.

If I try to select the missing dimension, it throw exception:

Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Column ‘src_uid’ not found in any table

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:463)

at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:572)

Anyone know why?

Thanks,

Kien

Is it possible that there was no data loaded for this dimension? If so, it would have been skipped during ingestion, and wouldn’t be accessible at query time.