We are working on a system for which we are feeding data into druid 0.6.146 via kafka 8 in minute granularity. But we need the data in minute granularity for a few hours only. After that we would prefer to keep them in hourly (or bigger) granularity. Is there some option to do that?
I understand that the schema options allow for a specific granularity only. After the few hours have passed we don’t mind if the data for the whole hour is stored aggregated as a minute. What I mean is suppose we have the following
6:01 AM = 5
6:02 AM = 2
and so on till
7:00 AM = 1
After the X hours have passed we don’t mind if the data is changed to
6:01 AM = Sum of 6:01 to 7:00 AM.
and all others are deleted.