I am right now working on dropping the data older than 1 hour from the cluster. I have set the rule as below:
According to this rule, only past 1 hour data should be taken into consideration for any druid query. The problem is I can see that, through this rule ‘used’ field in segments table is set to 0 but I can still query the old data.
Can you tell me the possible causes for this kind of behavior? I also disabled the cache and tried with time series, select queries but it is still returning old data too.
Your quick reply would be a great help.