Enabling efficient distributed data loading for distributed data parallelism
![HydraGNN_QRcode](https://private-user-images.githubusercontent.com/2488656/279551876-88a3b139-062d-41e8-a8d7-40c1a144d897.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQwMTAwNzIsIm5iZiI6MTcyNDAwOTc3MiwicGF0aCI6Ii8yNDg4NjU2LzI3OTU1MTg3Ni04OGEzYjEzOS0wNjJkLTQxZTgtYThkNy00MGMxYTE0NGQ4OTcucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgxOCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MThUMTkzNjEyWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MWY4YTE4NjczOWY4NzY5Nzk1YjdmZjQ3NGNmOWY4NjhhZGQwZmU0OTJlYTA2N2VlMjUzMDIwYzE1NGM5OTUyMyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.4v2982rO42FQauZbxZoNNVeabc5a8sRwZQlVYbDNCWo)
pip install numpy mpi4py Cython # install pre-requisites
# for use with PYTHONPATH=$PWD:$PYTHONPATH
CC=mpicc CXX=mpicxx python setup.py build_ext --inplace
# or, for installing into your virtual environment using pip
CC=mpicc CXX=mpicxx pip install .
# or, as above but in development mode
CC=mpicc CXX=mpicxx pip install -e .
mpirun -n 4 python -m mpi4py test/demo.py