Run Sonobuoy conformance tests about sig-windows-dev-tools

[johnSchnake]

I just resolved my issue regarding setting up a cluster; going to work on this today and see how it goes. Should be simple if things go according to plan.

[johnSchnake]

I was just able to run

sonobuoy run -p https://raw.githubusercontent.com/vmware-tanzu/sonobuoy-plugins/master/windows-e2e/win-e2e-image-repo-list-master.yaml --wait --security-context-mode=none --aggregator-node-selector kubernetes.io/os:linux --kubernetes-version=v1.22.0 --e2e-focus="should not be able to create pods with unknown usernames" --sonobuoy-image=sonobuoy/sonobuoy:main

with success. Thats just a single test that is windows specific but its a good start. Will put up a PR soon to integrate this.

[sladyn98]

@johnSchnake Hey sonobuoy would run on the linux controlplane right, and does it have to wait for the windows node to be up before running the e2e tests, because in our flow the controlplane.sh runs and then goes over to the windows node for setup

[sladyn98]

sonobuoy run \
>   --plugin-env=e2e.E2E_EXTRA_ARGS='--progress-report-url=http://localhost:8099/progress --node-os-distro=windows' \
>   --e2e-focus="should not be able to create pods with unknown usernames"
INFO[0000] created object                                name=sonobuoy namespace= resource=namespaces
INFO[0000] created object                                name=sonobuoy-serviceaccount namespace=sonobuoy resource=serviceaccounts
INFO[0000] created object                                name=sonobuoy-serviceaccount-sonobuoy namespace= resource=clusterrolebindings
INFO[0000] created object                                name=sonobuoy-serviceaccount-sonobuoy namespace= resource=clusterroles
INFO[0000] created object                                name=sonobuoy-config-cm namespace=sonobuoy resource=configmaps
INFO[0000] created object                                name=sonobuoy-plugins-cm namespace=sonobuoy resource=configmaps
INFO[0000] created object                                name=sonobuoy namespace=sonobuoy resource=pods
INFO[0000] created object                                name=sonobuoy-aggregator namespace=sonobuoy resource=services

[sladyn98]

sonobuoy run   --plugin-env=e2e.E2E_EXTRA_ARGS='--progress-report-url=http://localhost:8099/progress --node-os-distro=windows' --e2e-focus=\[Conformance\]|\[NodeConformance\]|\[sig-windows\]|\[sig-apps\].CronJob|\[sig-api-machinery\].ResourceQuota|\[sig-scheduling\].SchedulerPreemption|\[sig-autoscaling\].\[Feature:HPA\]  skip=\[LinuxOnly\]|\[Serial\]|GMSA|Guestbook.application.should.create.and.stop.a.working.application
[Serial]: command not found
INFO[0000] created object                                name=sonobuoy namespace= resource=namespaces
INFO[0000] created object                                name=sonobuoy-serviceaccount namespace=sonobuoy resource=serviceaccounts
INFO[0000] object already exists                         name=sonobuoy-serviceaccount-sonobuoy namespace= resource=clusterrolebindings
INFO[0000] object already exists                         name=sonobuoy-serviceaccount-sonobuoy namespace= resource=clusterroles
INFO[0000] created object                                name=sonobuoy-config-cm namespace=sonobuoy resource=configmaps
INFO[0000] created object                                name=sonobuoy-plugins-cm namespace=sonobuoy resource=configmaps
INFO[0000] created object                                name=sonobuoy namespace=sonobuoy resource=pods
INFO[0000] created object                                name=sonobuoy-aggregator namespace=sonobuoy resource=services
[NodeConformance]: command not found
[sig-autoscaling].[Feature:HPA]: command not found
Guestbook.application.should.create.and.stop.a.working.application: command not found
GMSA: command not found
[sig-scheduling].SchedulerPreemption: command not found
[sig-windows]: command not found
[sig-api-machinery].ResourceQuota: command not found
[sig-apps].CronJob: command not found

@johnSchnake When running this on the control plane I hit this

[jayunit100]

https://sonobuoy.io/sonobuoy-adds-windows-support/ Sonobuoy slack channel in k8s

[johnSchnake]

I'd love to help implement this.

I am working on getting this project working for our own sonobuoy-on-windows testing too :)

The issue is that I seem to keep hitting problems setting up the cluster. I'll open another issue but know that I'm totally on board for working on this.

[johnSchnake]

So cluster is still having some issues though its progress.

Now I'm able to run:

sonobuoy run -p https://raw.githubusercontent.com/vmware-tanzu/sonobuoy-plugins/master/windows-e2e/win-e2e-image-repo-list-master.yaml --wait --security-context-mode=none --kubernetes-version=v1.21.3

and get things going. The e2e tests themselves stalled out in the pretest logic due to a node being unschedulable:

    taints:
    - effect: NoSchedule
      key: node.kubernetes.io/unreachable
      timeAdded: "2021-10-16T03:52:35Z"
    - effect: NoExecute
      key: node.kubernetes.io/unreachable
      timeAdded: "2021-10-16T03:52:40Z"

Going to try and repro on Monday