Comments (11)
@tsampazk Yes, I will spend some time to look into GoalEnv.
from deepbots.
@tsampazk I agree to put this on hold. 👌
Check this openai/gym#2456 about the robotics environments.
My goal is to make all the environments inside Gym itself good general purpose benchmarks suitable that someone new to the field of reinforcement learning can look at and say "okay, there's are the things everyone uses that I should play with and understand."
from deepbots.
Yeah i skimmed through that issue and discussion and followed a couple of links, but it started to look like a long rabbit hole of links and discussions and just stopped myself. :P
That quote is a really really good summary of gym's mission, but i'm not exactly sure what that means for us, being a framework for a robotic simulator. I guess we'll see in the future.
from deepbots.
@KelvinYang0320 Are you interested in taking look at gym's GoalEnv and what we need to do in order to integrate it with deepbots?
from deepbots.
@KelvinYang0320 Thank you!
from deepbots.
@ManosMagnus @tsampazk
At the end of last year, GoalEnv has been removed from Gym.
I think there are two alternative solutions:
- Deepbots can still inherit GoalEnv by
pip install gym-robotics
, but users will need to installgym-robotics
when installingdeepbots
. - We can copy/modify their GoalEnv and integrate it with deepbots without installing
gym-robotics
.
https://github.com/Farama-Foundation/Gym-Robotics/blob/main/gym_robotics/core.py
What do you think?
from deepbots.
This is quite tricky i think. On the one hand, we very much prefer not to introduce any additional dependencies to the framework. Especially for a library that will be or is used by very specific use cases and not universally. On the other hand, i think that it is not proper and we shouldn't just copy the existing GoalEnv from the gym-robotics library.
@KelvinYang0320 is this actually needed for the panda example? Or any other current example?
Edit: I think i remember that some implementations of RL algorithms require GoalEnv and that's why we started working on it, right?
from deepbots.
@KelvinYang0320 is this actually needed for the panda example? Or any other current example?
I think GoalEnv is quite useful for our robotic tasks as I mentioned here.
I have made a Panda-GoalEnv draft PR to check these features.
- Goal-compatible observation space
- observation, desired_goal, and achieved_goal
- compute_reward(achieved_goal, desired_goal, info)
- Our
get_reward(action)
is actually not that suitable for robotics control task.
- Our
Another example is that Panda-gym v2.0.1 works with gym-robotics.GoalEnv
.
Edit: I think i remember that some implementations of RL algorithms require GoalEnv and that's why we started working on it, right?
Yes, HER requires the environment to inherits from gym.GoalEnv
in SB3.
However, it seems that they are fixing that now.
from deepbots.
Alright thanks for the information!
1. Deepbots can still inherit GoalEnv by `pip install gym-robotics`, but users will need to install `gym-robotics` when installing `deepbots`.
I thought about the additional dependency on gym-robotics. Using this would mean adding additional inheritance to some gym-robotics class that includes GoalEnv. I will need some time to look into this further in detail, so i think we can put this on hold for a while and focus on the fixes regarding deepworlds. Unless you have a clear idea on what we can do specifically, so we can discuss it.
from deepbots.
@tsampazk I think we can move this issue to Pre-release 0.2.1-dev0 or close it. What do you think?
from deepbots.
Yes @KelvinYang0320, it seems to still be an open issue, i think that we can move it to the pre-release.
from deepbots.
Related Issues (20)
- Create documentation site
- Modify Docker
- get_timestep deprecation warning in supervisor_emitter_receiver
- Is it possible to run several simulations in parallel? HOT 1
- RobotEmitterReceiver class should inherit from Webots Robot class
- doubt about the implement of the emitter-receiver scheme HOT 9
- Usage of snake_case
- A bug of robot never moving HOT 1
- CSV handle_emitter data types
- Error in gym setup command: 'extras_require' HOT 5
- Migrating to gymnasium
- Unable to install deepbots HOT 2
- Gym Environment and using stable baselines HOT 2
- Request for Assistance with Sim2Real Transformation Using Emitter Receiver in DeepBots HOT 4
- There seems to be a bug in the step function of the robot_supervisor.py HOT 1
- Extend deepbots to support stable-baselines and implement gym-style default enviroments HOT 3
- Extend deepbots to support Evolutionary Algorithms HOT 14
- Question: how to get kinect camera information HOT 7
- [Tracker] Extension to Evolutionary Algorithms
- How to use ray to train in deepbots environment. HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from deepbots.