MARL disconnection from Unreal Engine after a while about mindmaker

[krumiaa]

Thanks for reaching out about this, not sure why the second agent would be auto disconnecting, perhaps a firewall issue. The only thing I could think to try is standard debugging procedure, remove all the superfluous RL code and bring it back to a basic client server setup, see if it sustains the connection, and then start adding things back in. Another place to look would be the SocketIO plugin settings in blueprints, there maybe some auto-disconnect feature that got enabled. Wish I had more idea about this, until I can replicate could be difficult to solve. FYI – planning to launch an upgrade to Stablebaslines 3 shortly(next week or two), that might eliminate your problem altogether.

[oshirokn]

Thanks for your answer. I tried with a very basic setup using the original mindmaker BP and got the same problem. For now I'll stick with a single agent. Maybe a firewall issue? Let's see if Stablebaselines 3 upgrade fixes it.

[oshirokn]

I still have the same problem with a very basic project.
A sphere moves forward/backward if action 0 or 1.

Maybe I am doing something wrong with the setup?

• Duplicated the same Mindmaker blueprint and changed the Socket address. Also changed the address in the socket component. I have now two actors with exactly the same blueprint except the address.
  

• Duplicated mindmaker.py, changed the port address to 3001

• Launched the duplicated mindmaker.py, says "wsgi starting up on http://0.0.0.0:3001"

• Launched the Unreal Editor simulation. Mindmaker.exe is launched.

• After a while, the duplicated agent is disconnected from Unreal

Are these steps correct?

I can send you the project if needed @krumiaa .

[oshirokn]

Fixed by using a more recent example project from 5.1