I’m having trouble ingesting data on Amazon MSK with SSL.
First, I did a test locally with a Kafka client that could retrieve data from Kafka over SSL.
I created a client.properties file as such:
Then I tested the connectivity and received data:
kafka-console-consumer --bootstrap-server --consumer.config client.propertie --topic my-kafka-topic --from-beginning
However, when I pass along these properties to my
“bootstrap.servers”: “bootstrap servers with port”,“security.protocol”: “SSL”
in my druid ingestion spec, well, it fails to ingest data.
Please note that $JDK_HOME is an actual path to my JDK
Also, I use the root signed JDK cacerts file because it contains the AWS certificate.
Also, I tested my configuration with Kafka running in Docker with no SSL and it all worked fine. However, my deployment environment requires SSL.
Any help would be deeply appreciated.