Suggestion on new Historical node

Hi,
I’ve a Druid production cluster setup with Broker, Realtime and a couple of Historical nodes; everything is working with default_tier and data are loaded forever as default rule.

I’d like to add a new Historical node that will manage only last three days data.

How should I setup it?

  • Does I need to define a different tier?

  • How should I setup rule, managing only last 3 days?

  • How should I query Broker suggesting to use this specific Historical node?

Thanks

Maurizio

Hi,
See Inline.

Thanks,
it’s working like a charm !

Thanks,

Maurizio

Hi Nishant,
looking at Broker configuration I’ve found two interesting parameters:

druid.broker.select.tier

druid.broker.select.tier.custom.priorities
Supposing I’ve a new Broker and I wanna it manages only Realtime and Historical with tier named hot and priority 100
How should I setup these two parameters accordingly?

Thanks

Maurizio

Here is an example config for a broker that prioritizes lower tier historicals:

druid.broker.select.tier=custom

druid.broker.select.tier.custom.priorities=[0,1]

Where

0 == _default_tier

1 == hot_tier

You can change the setup to prioritize hot historicals.

Thanks!