Hello, code is very clear ,but I encountered some problems while running the code.
There are no errors ,but the reward of "CartPole-v0" running with dppo does not rise.
I think there may be bugs in agents/runners/learners/dppo_learner.py.
On line 13( "gradients_ids = ( [agent.run.remote() for agent in actors])
" ),
the agent.brain's gradient has been calculated,but catually it is None.
Therefore, all brain's weights can not be updated.
Besides, On line 14 ( "while len(gradients_ids)
:" ) , whether the length of the gradients_ids
will be a constant, and then lead to wrong results.