Not able to route queries to multiple brokers

Hello,

We have deployed druid on Kubernetes and everything runs perfectly fine till we have set our broker replica count to 1. When we try to increase replica count to 2 for high availability our queries fail with the following error Remote driver error: ISE: Connection[7a51a247-7c4f-4ef1-a36e-f2947d1d2ee6] already open. We expose broker to services and our BI tool using Application load balancer.

Can someone please help me out here? Thank you.

To be more clear, we expose it the following way.
pods -> svc -> traefik -> ALB