[druid-user] Druid Data Ingestion using kafka

Hi Team,

Facing

  1. cause0: “org.apache.druid.indexing.seekablestream.common.StreamException: org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata”
  2. org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata

(Attachment docker-compose.yml is missing)

Not able to connect to kafka running on localhost:9092 from druid localhost:9999.
error: org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata
PFA of Docker compose of druid and kafka.

(Attachment environment.env is missing)

Kafka docker compose file

(Attachment docker-compose.yml is missing)

Hey! Hm that looks like it’s solvable with correct network config – I’ve asked a colleague who knows A LOT more about this than me to come back to you :slight_smile:

Hi.
Like Peter says, if you are using two separate docker-compose operations, you will end up with two separate isolated virtual networks. You should be able to merge both docker-compose files into a single file and then containers will be created within the same logical network.

Let us know how it goes,

Sergio

1 Like