I use tranquility 0.8.0 to ingest events and create real-time task, but sometimes tranquility creates task too late, almost delayed 30 minutes ~ 1 hour.
In my situation, I have some high cardinality dimensions, and the number of events is not small, so I set segment granularity 15 minute, and partition is 3, such that one shard is about 100mb ~ 200mb.
As the delayed task, there are many messages be dropped as the windowPeriod is set 40 minutes.
And I surely confirm that there are many available workers.
So What I’m curious is that What reasons will trigger tranquility to create task late ?
Thanks for any reply.