Kafka Indexing Service with Multi Line Messages


I am trying to consuming Multi-Line kafka messages using the Kafka Indexing Service, but so far I only get a single line indexed into druid.

I am using the CSV line format, where each CSV line is interleaved with a new line character.

So the message looks like,


Does Kafka Indexing Service support multiple lines within the same kafka message?



Hey Ankush,

No, currently a Kafka message is only expected to contain a single row of data.

If this is something important to your use case, please file a feature request as an issue so that we can look into adding it to a future release!

Hi David,

Thanks for the reply.

I will write up a feature request for this.

~ Ankush