Kafka Indexing Service with Multi Line Messages

Hi,

I am trying to consuming Multi-Line kafka messages using the Kafka Indexing Service, but so far I only get a single line indexed into druid.

I am using the CSV line format, where each CSV line is interleaved with a new line character.

So the message looks like,

value1,value2,value3\nvalue4,value5,value6\nvalue7,value8,value9

Does Kafka Indexing Service support multiple lines within the same kafka message?

Thanks,

Ankush

Hey Ankush,

No, currently a Kafka message is only expected to contain a single row of data.

If this is something important to your use case, please file a feature request as an issue so that we can look into adding it to a future release!

Hi David,

Thanks for the reply.

I will write up a feature request for this.

~ Ankush