Ingesting Data using JSON flattenSpec

Apache Druid Q&A Google Groups
#1

Hi, I’m trying to ingest Kafka data into Druid using tranquility.

The message i am posting looks like:

{“metrics”:[{“i”:4.4,“p”:145},{“i”:4.98,“p”:925},{“i”:4.27,“p”:565},{“i”:4.108,“p”:210}],“t”:1502096667903}

Tried to use json flattenSpec. But as the data have same key names(i and p), facing some issues when I try to index them to same variables

Can someone let me know if flattenSpec helps me in indexing this form of data or should I go for some other approach?

Thanks,

Ramya

#2

Avro_stream does not support JSONFlatten spec right now as I discovered last week. I have updated it locally to support it but not shared it with the community yet as not fully tested and what I have done is probs not the best way to do it. I can share with you what I have done to add support though should you want to try it though.