Unable to attach or mount volumes spire-oidc-discovery-provider about helm-charts

[faisal-memon]

It would be good to get a root cause. I dont think its good to update settings without knowing why they fix the problem

[marcofranssen]

Found if I put priorityClassName: system-node-critical on the agent daemonsets, I'm unable to reproduce the issue, so far.

Should we put this by default on the spiffe-csi-driver?
Should we put this by default on the spire-agent, or shall we use system-cluster-critical for this component?
Should we just document this and leave it to the enduser?

My feeling is we need to make the spiffe-csi-driver at least system-node-critical.

[kfox1111]

shouldn't need to do that by default. How full are those nodes?

If nothing else, it would be nice if we produced some prod recommendations?

I know its not standard to setup stuff like resource requests/limits by default. but we could provide in the documentation a reference values file with all that stuff turned on and set to some sane defaults a user could download and tweak?

[faisal-memon]

Document for now, address with https://github.com/spiffe/helm-charts/pull/99/files#diff-e5d95a142cf1134e77e5c83dfeac07f49d1f433253a8b07d11a652c784403a6bR1