Ingesting Data using JSON flattenSpec

Hi, I’m trying to ingest Kafka data into Druid using tranquility.

The message i am posting looks like:


Tried to use json flattenSpec. But as the data have same key names(i and p), facing some issues when I try to index them to same variables

Can someone let me know if flattenSpec helps me in indexing this form of data or should I go for some other approach?



Avro_stream does not support JSONFlatten spec right now as I discovered last week. I have updated it locally to support it but not shared it with the community yet as not fully tested and what I have done is probs not the best way to do it. I can share with you what I have done to add support though should you want to try it though.