Data partition issue when distributed training about graph-learn

[jackonan]

Thanks for your feedback. This is a known problem currently and we are doing the fix. The iteration cases that multi clients connect to the same server need to be designed carefully, with both correctness and performance guaranteed. For the cases that the number of workers is less servers, we hope your case sharing. It scarely happens through our experience.

[amznero]

Oh, the situation that the number of workers is fewer than servers is just an experiment for understanding your implementation😂.

In general, num_workers is greater than num_servers.

For now, I use num_workers = num_servers setting for training, to avoid the above problem.