Dear Korand,
thanks for reporting.
Looks like an issue in the parallelization. We have never encountered this issue in MTP training.
To be able to try and reproduce it and possibly fix it, we would need the script that you have been running and the details of the parallel settings, i.e. how many nodes/cores, ideally also which types of nodes, etc.
Best regards,
Julian