GPU vs CPU Performance about rl-baselines-zoo

[araffin]

Duplicate of hill-a/stable-baselines#308

Also related: hill-a/stable-baselines#367

So for short, for small networks, there won't be any difference between of communication delay and also passing data from cpu to gpu back and forth. For bigger architecture and especially CNN, you should see a boost when using GPU.

[Mom0aut]

Ok thank you for your fast response.

I didn´t know that, i will try so test bigger networks.