Segment file missing

Sometimes some of kafka indexing tasks fail, and then segment files for one hour data have discontinuous partition. For example, there are segment files with partition number 0, 1, 3, 4 and so on, but partition 2 is missing.
I wonder if it means losing data .

Hi @Ze_yu_Huang. Sorry for the long delay in replying, but many of us have been offsite.

Are you able to share any of these logs?



Is the task getting restarted? Do you know why it failed?
If you have enough worker slots in the middle managers to hold double the tasks you can use task replicas =2 to avoid the hiccup on a failure. The replica of the failed task will continue ingesting. But it is important to figure out why the task failed. Can you share the failed task log?