eclipse-cbi / buildkitd-okd Goto Github PK

Building docker images at the same time using the current buildkit infra using a kubernetes service and ClusterIP often finishes with an OOM, a
error: failed to solve: Canceled: context canceled, or another issue due to lack of memory.

For instance, after multiple executions, kubernetes only once decided to use a different pod because I manually delayed the job execution.
Otherwise kubernetes always choose the same pod. which seems normal, because when jobs start they don't use many resources.

Is there a way to change the service load balancing strategy in OKD? I haven't found anything.
Or maybe create an OKD route by defining a leastconn strategy in haproxy.router.openshift.io/balance annotation, see: https://docs.okd.io/latest/networking/routes/route-configuration.html, but buildkit is TCP, and there is an open issue about exposing buildkit behind HTTP: https://docs.okd.io/latest/networking/routes/route-configuration.html

Any idea to better distribute the load?