I need help with a rollup use case during ingestion. I am using kafka indexer for ingestion. I am ingesting metrics in minute level granularity(time dimension has minute level timestamp) and intend to roll it up to 60 minutes. All the metric columns defined in druid are either long, double or float. As per https://staging-www.druidforum.org/docs/querying/aggregations.html we can define sum, min, max and count aggregators on metric column during ingestion.
We cannot use "First / Last aggregator” during ingestion. But we have use case where for a specific metric column we need to get the last value based on the highest timestamp during rollup.
Input minute level data:
Expected 60 minute rolled up data during ingestion:
Thanks & Regards,