Figure out how to ensure fairness between clients about ztunnel

[daixiang0]

Is it about LB?

[stevenctl]

This involves looking at our concurrency model and configuration and also requires an evaluation method.

[howardjohn]

Tokio has some 'budget' concept but it is per-task. We would want some concept of task-groups.

But we also probably want higher level fairness like bytes/s

https://docs.rs/tokio/latest/src/tokio/runtime/coop.rs.html

[daixiang0]

The title is confused, does it mean that Tokio is unfair in some case or we need different priorities for different clients?

[howardjohn]

Tokio fairness is per task. ideally ours would be per-pod

[daixiang0]

Tokio fairness is per task. ideally ours would be per-pod

Sounds like the fairness wrt bandwidth for per-pod, which is better to be done by the OS facilities. I know tc or some NICs can do this.

[howardjohn]

Yeah good point, I guess now that we have "in pod" mode, its much easier to do this at the CNI layer

[howardjohn]

There is still some fairness like number of connections open/establish (sending a few bytes of TLS handshake is way more expensive than a few bytes of data) that would be nice to have

[daixiang0]

Do you mean fairness in connection pool?