Parquet file format data ingestion with struct datatype

I have parquet file format data which has some fields as structs. Is there any way to ingest individual fields in struct field in Druid. e.g.

Parquet table definition:

sequence_num bigint

session_id struct <low:bigint, high:bigint>

device_info struct <type:String, os:String>

request_type String

I want to ingest device_info.type and device_info.os as a part of ingestion spec. Any pointers?


Hey Yogesh,

It sounds like you want functionality like the “flattenSpec” in the JSON parser. I think the Parquet parser doesn’t support it currently, but a patch to add that support would be welcome.