According to the documentation
It is STRONGLY RECOMMENDED to provide list of segments in
dataSourceinputSpec explicitly so that your delta ingestion task is idempotent.
Could you please elaborate a bit on this? What exactly happens if I don’t? I tried it without the segments, and it looks idempotent to me. Was I just lucky?
Or maybe the data I was using had some special properties that make it idempotent anyway, but it won’t work with other data / other ingestion task?
Thanks in advance,