segmentation fault after train a few steps about vits

[elch10]

@zhufeijuanjuan did you solve the problem?
I've encountered the same problem

[zhufeijuanjuan]

@elch10 Not handled yet. Decrease batch size can avoid this issue.

[elch10]

Maybe problem with mp.spawn or pytorch installation
I've created new environment with python3.11, pytorch2, because python3.10 has many sigsegv problems in pytorch repository. Then changed this line with

  children = []
  for i in range(n_gpus):
      subproc = mp.Process(target=run, args=(i, n_gpus, hps))
      children.append(subproc)
      subproc.start()

  for i in range(n_gpus):
      children[i].join()

And now there's no errors

[elch10]

Also found with python -X faulthandler that there is error in cython monotonic_align. I just rewrite that in numba. It's slightly slower, but works without error

[zhufeijuanjuan]

@elch10 Respect!!!
so you mean update python, pytorch and rewrite monotonic_align can solve this issue?

[elch10]

Yeah, of course, no errors