Connect Druid With Secure Kafka

TROUBLESHOOTING Google Groups
#1

I am trying to load data from secure kafka, i have username and password, i created a python script to check the consumer properties, and it worked fine and was able to consume it.

But i can’t consume it from druid, these are the configuration that i am using.

{
“bootstrap.servers”: “xxxx”,
“sasl_mechanism”: “PLAIN”,
“security_protocol”: “SASL_PLAINTEXT”,
“sasl_plain_username”: “username”,
“sasl_plain_password”: “password”
}

What am i missing? i would appreciate your help

#2

I figured out the issues.

  1. The properties names should be separated by dots not dashes.
  2. To specify username and password, you should use the properties
    sasl.jaas.config: org.apache.kafka.common.security.plain.PlainLoginModule required username="<>" password="<>";
    The complete configuration looks like this

“consumerProperties”: {

“bootstrap.servers”: “xxxxx”,

“sasl.mechanism”: “PLAIN”,

“security.protocol”: “SASL_PLAINTEXT”,

“sasl.jaas.config”: “org.apache.kafka.common.security.plain.PlainLoginModule required username=”<>" password="<>";"

}