kenjyoung / minatar Goto Github PK
View Code? Open in Web Editor NEWLicense: GNU General Public License v3.0
License: GNU General Public License v3.0
I've really been enjoying working with MinAtar these couple of weeks and I was wondering, is there any way to figure out what is the maximum score in each of the games?
I'd like to normalize the scores in some of the plots (and average over games) to get more succinct trends. I also checked the paper but they're not mentioned.
I find you updated gym wrapper to match newer API. But I still use the old version of gym API. So where can I download the old version of minatar with old gym API? Thanks!
Nice environment!
Just wonder are there any suggested values for max_episode_length according to the previous runs? Or the environment will eventually terminate due to sticky actions? Thanks!
Hi, I am not sure that the repo is gym-compatible, as I get errors from stable-baselines3:
env = make_atari_env('MinAtar/Breakout-v0', n_envs=1, seed=0)
AttributeError: 'BaseEnv' object has no attribute 'get_action_meanings'
from stable_baselines3.common.env_checker import check_env
check_env(env)
AssertionError: The observation returned by the `reset()` method should be a single value, not a tuple
I find some games' difficulty levels will change periodically. I wonder if it can be recognized from the state representation, like objects' moving speed? Thanks!
Hi, for Atari games, normally running 200M steps will cost 8-10 days. So, for this repo, how long it will take to run 200M steps?
Hi,
Atari has APIs clone_state and restore_state for model-based methods and planning. Does MinAtar support clone_state?
Thanks!
Before I begin, I think a compliment for this repo is that Stanford University is actually using this in its graduate-level CS234 Reinforcement Learning homeworks! ๐ฅณ
Students are being instructed to manually git clone
and pip install
this repo locally. At first, I posed directly adding the GitHub repo to requirements.txt
like so:
git+ssh://[email protected]/kenjyoung/MinAtar.git
I decided to take a look at PyPI, and saw MinAtar is already published there.
The request is: to update the README.md
to instruct to users to install from PyPI, unless they're going to be contributing.
It would be really nice to have a Gym compatible API so that existing code can be applied to MinAtar directly.
hey there,
The tsplot
function and seaborn.timeseries
module have been removed. tsplot
was replaced with lineplot
.
MinAtar/examples/plot_return.py
Line 114 in 8fceb58
Reference here
Hello
Users using the Windows Subsystem for Linux like me (I am using WLS 2), might run into issues using minatar
's GUI.
I kept running into
Cannot load backend 'TkAgg' Which requires the 'tk' interactive framework, as 'headless' is currently running
After quite some efforts, the only working solution for me as been to follow those steps (launch an Xserver from Windows).
Hope that this will save some time to other WLS users!
I was wondering if you can add a requirements.txt
file to this repo. The purpose of this file would be to say which python packages you need to run this project. It also makes it more future proof since pip would know which package versions it needs to install in case of the dependency APIs change.
The easiest way to accomplish this is to run pip freeze > requirements.txt
. It might add dependencies that are not needed, but I think the benefits outweigh the cons.
Thanks!
In the register_envs
function, the name given to the classes does not include "MinAtar/". Because of this, if you call register_envs, it will overwrite the names of the original ALE games. This also means that calling gym.make("MinAtar/Breakout-v0")
or any other game doesn't work since there are no registered envs starting with "MinAtar". The bug is in
Lines 58 to 70 in 2a12fc8
It can be fixed by just modifying "id="{}-v0".format(name)," to "id="MinAtar/{}-v0".format(name)," for both v0 and v1.
I can open a PR for this if you like.
It is possible to install the package directly from GitHub which simplifies a lot using it with a pip install https://github.com/kenjyoung/MinAtar.git
(I'm actually doing it with poetry with a poetry add git+https://github.com/kenjyoung/MinAtar.git
but that's mostly equivalent).
However because of the way the setup.py is written this also installs the dependencies for the examples (especially torch which is a behemoth). Would you consider removing them ?
A way to do it simply would be to create an extra section to group the examples dependencies, something like:
extras_require = {
'examples': ["torch"]
}
I could contribute the change if you think it makes sense.
Hi,
I'd like to ask about how to make minatar environments deterministic for research on MBRL algorithms such as MuZero, which are designed for deterministic environments.
Apart from setting the sticky_action_prob to 0.0, is there anything I still need to change to get deterministic transitions (stochastic initialization is fine)?
It seems that for space_invaders and breakout, there is no stochasticity in the transition. Can you confirm? What would be your advice to make the other environments' transitions deterministic?
Thanks in advance for your answers.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.