I am trying to ingest data from Kafka into Druid. I am currently using Kafka Firehose API.
I also read that Tranquility “handles partitioning, replication, service discovery, and schema rollover for you, seamlessly and without downtime”.
- What is the best way to ingest Realtime ( I am finding things schema change hard to manage using Firehose API)?
On the page https://github.com/druid-io/tranquility, it is assumed that there is Samza, Storm etc. built on top of data.
- Can Tranquility be used directly on top of Kafka and is it advisable to do so?