liwei-cn / evorobotpy

A tool to experiment with adaptive (evolutionary and reinforcement learning) robotics

evorobotpy

A tool for training robots in simulation through evolutionary and reinforcement learning methods

It includes a guide that gently introduce the topic and explain how to use this and other available tools to train robots in simulation.

All the software required is available ready to be used through the docker container prepared by Vladislav Kurenkov that can be pulled, built and run through the following commands:

# Download the container (CPU version)
docker pull vkurenkov/cognitive-robotics:cpu

# Run container (CPU version)
docker run -it \
  -p 6080:6080 \
  -p 8888:8888 \
  --mount source=cognitive-robotics-opt-volume,target=/opt \
  vkurenkov/cognitive-robotics:cpu
  
# Download the container (GPU version)
docker pull vkurenkov/cognitive-robotics:gpu

# Run container (GPU version)
docker run --gpus all -it \
-p 6080:6080 \
-p 8888:8888 \
--mount source=cognitive-robotics-opt-volume,target=/opt \
vkurenkov/cognitive-robotics:gpu

# To login in the container use the following command
docker ps -a                    # to see the running containers and identify the ID of the evorobotpy container
docker exec -it <id> /bin/bash  # to login in the container

# To logout from the container use:
exit

# You can visualize the graphic rendering from your browser by using the following address
localhost:6080

# to stop a container use:
docker stop <id>

The graphic rendering is realized by using NoVNC (desktop access via browser at localhost:6080). Code editing using VSCode (you can attach to the container using VSCode and edit the source code conveniently -- allows to use IntelliSense and more). You can use Jupyter Notebook, just run jupyter notebook --ip=0.0.0.0 --port=8888 inside a container and you can access it in your browser at localhost:8888. The changes made to the source code are persistent (e.g. you can restart the container and your changes won't be lost)

As an alternative to the docker container, you should clone evorobotpy and install:

1. Python 3.5+ and the cython, pyglet and matplotlib packages
2. AI Gym
3. GNU Scientific Library
4. Pybullet
5. Baselines (optional)
6. Spinningup (optional) See the detailed instructions included in the guide