I am trying to use the framework, but unfortunately the provided scripts do not work. I'm not sure if this is an issue on my end, or if it may be because of unspecified dependency versions. I would be really happy for some help.

Expected Behavior

Running the scripts/train_rl.py should work. The error I get is the following.

Possible Solution

Add a requirements.txt file

Steps to Reproduce

As stated in the README.

python scripts/train_rl.py --env_name ACC --pbar true

P.S. it is required to specify the pbar parameter as true/false. The README does not state that.

Context (Environment)

Branch - master
Commit hash - 93d85dd
Environment - macOS

Move the java path into the configuration file, using java as a default. Check that the java version comports with what KeYmaera X expects.

System Information

• Python 3.7.5
• Linux (debian)
• 5.4.0-64-generic

Describe the current behavior
Running python setup.py install in a virtual environment fails to install. This is due to errors about install pyrl and version problems with pillow and chardet. After fixing the aforementioned issues, tests fail because of missing pytest dependency.

Describe the expected behavior
Creating a virtual environment and running python setup.py install should work out of the box with no errors. Tests should also work without getting an issue about missing dependency.

Standalone code to reproduce the issue

virtualenv --clear --python=python3.7 venv
source venv/bin/activate
python setup.py install

Below is my fix for the setup.py

from distutils.core import setup

from setuptools import find_packages

opencv_pkg = ""
if "DISPLAY" not in os.environ.keys():
    opencv_pkg = "opencv-python-headless"
else:
    opencv_pkg = "opencv-python"

setup(
    name="vsrl",
    version="0.0.1",
    description="Visceral: A Framework for Verifiably Safe Reinforcement Learning",
    author="IBM Research",
    author_email="[email protected]",
    url="https://visceral.safelearning.ai",
    packages=find_packages(),
    install_requires=[
        "scipy",
        "numpy",
        "torch",
        "pillow==7.2.0",
        "chardet==3.0.4",
        opencv_pkg,
        "pytorch_lightning",
        "comet_ml",
        "psutil",
        "torchvision",
        "parsimonious",
        "matplotlib",
        "portion",
        "toml",
        "auto-argparse",
        "gym",
        "pytest",
    ],
    extras_require={"dev": ["pytest", "pytest-cov"]},
    dependency_links=["http://github.com/astooke/rlpyt/tarball/master"]
)

Maintain the option to specify a local KeYmaera X installation, but use web.keymaerax.org by default to make installation easier.

We should have tests covering the following:

• All RL libraries that we claim to support
• All of the environments that ship with VSRL
• All of the examples described in the README, and in any additional future documentation.