MineDojo as a new framework about awesome-llm-robotics

[zsoltkira]

Thanks! I like the idea of adding frameworks enabling the use of such models. I agree it should be in another section though. Are there other frameworks that you think would also fit?

[DrJimFan]

Yes, I think other large-scale simulation frameworks to support big embodied agents could be great to add!

Some examples off the top of my head:

• ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks. https://arxiv.org/abs/1912.01734
• iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenes. https://arxiv.org/abs/2012.02924
• BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments. https://arxiv.org/abs/2108.03332

[zsoltkira]

Thanks! Those are good, and Habitat (esp 2.0) would be a good addition as well.

It's not clear to me how to distinguish simulators/frameworks for large-scale training versus others though. There are lots of simulators/frameworks, and I want to avoid making a laundry list of them here :)

Did you have thoughts on distinguishing characteristics?

[zsoltkira]

Hello. Did you want to try a pull request for this, based on discussion above?

[wangguanzhi]

Hi @zsoltkira! I am a student working with @LinxiFan and I just created a PR according to the discussion above. Thank you!