I want to know is there a way Druid can call back an endpoint I specify after ingestion is done.
We have a spark based etl pipeline at the end of which, we upscale middleManager nodes (our whole infra is on AWS so we have a lambda to set different ASG parameters). I want to downscale after the ingestion is done.
I already have a polling based solution. I wanted to know if there is callback way to avoid polling. Please let me know if there are any ideas around it.