[druid-user] Retention rules - not applying as per expectation

TROUBLESHOOTING Google Groups
#1

Hi All,

When I apply druid retention rules loadByInterval, the historicals load additional data which is out of this time range

For example, I have added a retention rule to load data only from 16th July 10am to 11am . However , the data outside that interval is also loaded in the historicals.
I also added drop by interval rule , but still it didnt help fully

I want the historicals to load data only specified in that loadByInterval property.
Is there a way to add such retntion rule? .

I have attached the screenshot of the current retention rules that I have been using

loadByInterval.JPG
loadByInterval.JPG724×340 23.1 KB

Regards,
Chaitanya

#2

In the drop rules, try dropForever.
Your current setting (dropByPeriod = P10D) goes back 10 days from today, so it may not delete data until 7/16.

Regards
Senthil