Today we have an event collection system that collects data in great detail across all our applications and systems across all products (we have quite a few products).
And we have an old system which
allows for aggregation and charting the metrics from these events. As you can
imagine due to very heavy volumes, our retention on this MySQL based system is
very low. And we have very basic alerting system also based on these logs.
Hence the need to built a new scalable system, which will allow us to keep
metrics for several months and allow flexible alerting based on them.
Apart from aggregation and query capabilities, does Druid have any road-map outlined for continuous querying so we can generate alerts on them? Also, we were exploring Pivot for visualization but it doesn’t support some of the basic features like - auth, dashboards etc. Are there any plans to integrate with more mature visualization tools like Grafana?