Model not improving about super-ml-pets

[andreped]

The main reason for why model failed to improve was lack of ability to tune hyperparameters.

I have added option to set params like batch size, learning rate, and gamma. From increasing batch size from 32 to 512, I have already seen a drastic improvement in convergence, which is to be expected.

gamma is also a hyperparam which is commonly tuned when using MaskablePPO. Hence, this could likely further boost performance/convergence. But I have not done that yet, but at least the end-user will be able to :)

As batch size 512 was found to be working better, I have changed the default batch sizet to 512 here: 0eb25ed

Closing this issue for now.

It is probably better to open a new discussion, if any devs/users are experiencing issues with convergence.