mahanfathi / ilqg-mujoco

Iterative LQG for a couple of MuJoCo models

iLQG-MuJoCo

Iterative LQG for a couple of MuJoCo models. Find a write-up HERE.

Demo for Inverted Pendulum and Hopper

A few iterations before convergence is shown here. Hopper in particular does some crazy stuff, but it will get there (no wonder why evolution wiped out these guys). This whole process below is considered as a signle MPC run. You can set contact solref[0] to a slightly higher number in the model, for more smooth dynamics and hence better derivative behaviors.

This Repo Contains:

• Iterative LQR algorithm, based on this paper:
  • Improved Regularization
  • Backtrack Linesearch
• Finite difference calculation of derivatives, in parallel
• The Levenberg-Marquardt heuristic
• Hessian approximation from gradients
• MPC mode

Dependencies

• MuJoCo
• Eigen 3
• OpenMP
• OpenGL

Usage

Modify the Makefile by specifying MUJOCO_PATH, make the executables with make, and run with ./bin/base ./res/inverted_pendulum.xml.

TODOs

• Make it faster of course
• Extend to walking robots
• Use proposed cost function from the paper

Acknowledgement

Big thanks to Taylor Apgar, from Dynamic Robotics Laboratory at Oregon State University.

ilqg-mujoco's Issues

return is needed in cost.cpp/get_extra() function in Hopper