Prerender stops rendering after some time under high load about chrome-prerender

[messense]

A lot of Attach to Chrome page xxx timed out, page is likely closed logs, seems like Chrome isn't responding.

[Nyoroon]

It's possible to do something on prerenders side? (like multiple chrome on backend?) Don't wanna do horizontal scaling.

[messense]

We are doing horizontal scaling. Every machine has its own Prerender process and Chrome, we use nginx to do load balancing.

Multiple Chrome backend is possible to implement but I don't think it's better than horizontal scaling. You can't run too many Chrome processes on a single machine so you have to spin up more machines, they might have different spec(CPU cores, memory), Prerender will treat them equally, that might not be what you want for best performance.

[Nyoroon]

One instance of prerender + chrome just don't load my machine to 100% (basically 1st post), but 2-3 instances per machine works fine x_x
Maybe because it's in docker?

[messense]

You can increase CONCURRENCY to a bigger number to spin up more Chrome "tabs"

[messense]

https://github.com/bosondata/chrome-prerender#configuration

[Nyoroon]

In my config it's set to 32.

[Nyoroon]

Tried without docker and on ubuntu - all is prefect.