Datasource not fully queryable

Hi,

Data source on Coordinator UI is not getting fully available even after task got completed more than 8 hours earlier.

Can someone please explain why the segment is not still available for querying.

Thanks in advance…

-Amit

Hi Amit,

If the datasource/segments are loded, you may be able to see similar entries in Historical logs:

Historical Log:

2019-09-18T07:36:56,420 INFO [ZKCoordinator–1] org.apache.druid.server.coordination.SegmentLoadDropHandler - Loading segment test1_2016-06-27T00:00:00.000Z_2016-06-28T00:00:00.000Z_2019-09-18T07:36:26.553Z
2019-09-18T07:36:57,237 INFO [ZKCoordinator–1] org.apache.druid.segment.loading.LocalDataSegmentPuller - Unzipped 5451654 bytes from [/Users/vaibhav/.Trash/imply-3.0.14/imply-3.0.14/var/druid/segments/test1/2016-06-27T00:00:00.000Z_2016-06-28T00:00:00.000Z/2019-09-18T07:36:26.553Z/0/index.zip] to [/Users/vaibhav/.Trash/imply-3.0.14/imply-3.0.14/var/druid/segment-cache/test1/2016-06-27T00:00:00.000Z_2016-06-28T00:00:00.000Z/2019-09-18T07:36:26.553Z/0]
2019-09-18T07:36:57,307 INFO [ZKCoordinator–1] org.apache.druid.server.coordination.BatchDataSegmentAnnouncer - Announcing segment[test1_2016-06-27T00:00:00.000Z_2016-06-28T00:00:00.000Z_2019-09-18T07:36:26.553Z] at existing path[/druid/segments/localhost:8083/localhost:8083_historical__default_tier_2019-09-16T09:55:45.304Z_099f80890d2047be98a2c438e17600611]
2019-09-18T07:36:57,334 INFO [ZKCoordinator–1] org.apache.druid.server.coordination.ZkCoordinator - Completed request [LOAD: test1_2016-06-27T00:00:00.000Z_2016-06-28T00:00:00.000Z_2019-09-18T07:36:26.553Z]

You can see based on LoadRule coordinator will be instructing Historical to load the segments :

Coordinator Log:

2019-09-18T07:36:56,267 INFO [Coordinator-Exec–0] org.apache.druid.server.coordinator.rules.LoadRule - Assigning ‘primary’ for segment [test1_2016-06-27T00:00:00.000Z_2016-06-28T00:00:00.000Z_2019-09-18T07:36:26.553Z] to server [localhost:8083] in tier [_default_tier]

Are the segments are created for the data source? If yes could you check Coordinator and Historical logs if there is any issue/Error while loading the segments?

Thanks and Regards,

Vaibhav