![Image Description](https://private-user-images.githubusercontent.com/59015432/270264371-cfe07419-77ac-4b5c-a711-15e4d1eba2cd.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQwMTkzODAsIm5iZiI6MTcyNDAxOTA4MCwicGF0aCI6Ii81OTAxNTQzMi8yNzAyNjQzNzEtY2ZlMDc0MTktNzdhYy00YjVjLWE3MTEtMTVlNGQxZWJhMmNkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE4VDIyMTEyMFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTQxYTdiMmRkMmNhMDFkNzk1YmUwMzBlZTc2MDVjMDVmNjE2MjFhYjBjMjc0ODg4ZjBlZDJkNmQ1NDYyOGUyOTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.6nqQwhDKafCxzZRribIZStvb-wDp_4ANz5fjhjsrN1g)
nmpc_performance.mp4
nmpc_vs_method.mp4
Installation of acados according to the following instructions: https://docs.acados.org/python_interface/index.html
Current (21 August 2023) version on imitation library does not yet support Gymnasium. So we are using our own fork of it with necessary modifications.
After cloning this repo:
git submodule init
git submodule update
cd imitation
pip install -e .
Hyper-parameter | Value |
---|---|
COMMON: Learning Rate | 0.0003 |
COMMON: Number of Expert Demos | 100 |
COMMON: Number of Training Steps | 2,000,000 |
PPO: Net. Arch. | pi:[256, 256] vf:[256, 256] |
PPO: Batch Size | 64 |
SAC: Net. Arch. | pi:[256, 256] qf:[256, 256] |
SAC: Batch Size | 256 |
BC: Net. Arch. | pi:[32, 32] qf:[32, 32] |
BC: Batch Size | 32 |
DAgger: Online Episodes | 500 |
Density: Kernel type | Gaussian |
Density: Kernel bandwidth | 0.5 |
Density: Net. Arch. | pi:[256, 256] qf:[256, 256] |
GAIL: Reward Net Arch. | [32, 32] |
GAIL: Policy Net Arch. | pi:[256, 256] qf:[256, 256] |
GAIL: Policy Replay Buffer Capacity | 512 |
GAIL: Batch Size | 128 |
AIRL: Reward Net Arch. | [32, 32] |
AIRL: Policy Net Arch. | pi:[256, 256] qf:[256, 256] |
AIRL: Batch Size | 128 |
AIRL: Policy Replay Buffer Capacity | 512 |
Parameter | Value |
---|---|
Hessian Approximation | Gauss-Newton |
SQP type | real-time iterations |
|
|
|
|
diag( |
|
diag( |
|
diag( |
|
|
diag( |
|
|
|
Parameter | Value |
---|---|
|
|
diag( |
|
diag( |