I’m running 3 servers with the next config for each of them:
- Historical + MiddleManager + Tranquility + Kafka
Brokers, Coordinators and Overlords run in other servers.
I have one topic with 3 partitions, one for each Kafka broker. I’m sending data to the three brokers, and so far everything works just fine.
The problem is that I run the 3 Tranquility instances and always only one of them receives the data and put it into druid. I copied exactly the same json for the task in the 3 servers, and I set these properties:
“task.partitions” : “1”**“task.replicants” : “1”,
I already tried to change them to 3 in every possible combination. What I see in the tranquility logs, is that the one that is receiving the data outputs this:
[ConsumerFetcherManager-1469704934225] Added fetcher for partitions ArrayBuffer([[pageviews,1], initOffset 25687 to broker id:2,host:host2,port:9092] , [[pageviews,0], initOffset 25685 to broker id:1,host:host1,port:9092] , [[pageviews,2], initOffset 25686 to broker id:3,host:host3,port:9092]
It handles all the partitions…
Is there anything that I’m missing? Should I change something in Kafka?