Gym wrappers to do effective sampling from gym environments.
There is wrapper for Discrete and Box environments which supports sampling of trajectories and rewards, sampling from given states. Parallel code is tested in Linux and working.
There is class GymSimulator in pythonSimulators which possesses all the needed methods. You can check the examples in pythonSimulatorsTests.py .
To launch testing, execute
python pythonSimulatorsTests.py