Can the time dimension be set to the timestamp druid processes the record

I am trying to ingest data with timestamps, but would like to use as the time dimension (__time) the timestamp that druid processes the record (from my kinesis stream, which I think is not relevant here). The timestamps in the data may be several seconds old or worse, so I wanted to use another timestamp instead.

This is purely for testing only.

Hi HappyPanda,

Welcome to the Druid Forum. As far as I know, there is no easy way to do this. I believe that while we do have support for Kafka headers from where you can get the record’s timestamp, I don’t think this is possible with Kinesis but maybe someone in the forum who knows for certain can comment.

You cannot add the system TS during ingest with something like a NOW() either as this is not supported.