#001 - Logic to handle child processes (workers) being killed by the OS (for example, due to Out Of Memory (OOM)) about condu

[TheBrunoLopes]

Yup, that's what I meant to say. Multiprocessing lib is awesome to tackle that problem.

[TheBrunoLopes]

This seems like a viable approach.
There are a few caveats to should be taken into consideration. It's preferable to use new processes instead of new threads because of the GIL. This builtin library should be able to handle the tasks you propose.

[artpdr]

Hi @bioslikk long time no see :p.
As the threads will only be used to have a Pipe for the process they create, I think there is no big overhead in context switching between threads.
PS: I'm aware of GIL.
Cheers.

[artpdr]

It seems that I will need to trigger new processes instead of new threads as launching processes from multi-thread processes seems problematic

[artpdr]

Finished this using just processes. There is no multi-threading....
This will be released in Pypi with version 2.0.0b05