openshift / cluster-storage-operator Goto Github PK

Operator that sets OCP cluster wide storage defaults

License: Apache License 2.0

Makefile 0.68% Go 98.19% Dockerfile 0.71% Shell 0.42%

cluster-storage-operator's Introduction

cluster-storage-operator

Operator that sets OCP cluster-wide storage defaults.

Ensures a default storage class exists for OCP clusters, like the addon-manager does for kubernetes clusters. Supports AWS and OpenStack. No configuration is required. The created storage class can be made non-default by editing its annotation but cannot be deleted so long as the operator runs.

Will also ensure default CSI volume plugins are installed in a future release when CSI plugins replace in-tree ones (see csi-operator).

Quick start - running CSO from local workstation

Scale down current CVO and CSO

# Set kubeconfig for connection to existing cluster
export KUBECONFIG=<path-to-kubeconfig>

# Scale down CVO and CSO
oc scale --replicas=0 deploy/cluster-version-operator -n openshift-cluster-version  
oc scale --replicas=0 deploy/cluster-storage-operator -n openshift-cluster-storage-operator

Configure required environment variables

# Set operator and operand image version (this is just a marker for missing version, we assume that operators handle version detection themselves)
export OPERATOR_IMAGE_VERSION="0.0.1-snapshot"
export OPERAND_IMAGE_VERSION=$OPERATOR_IMAGE_VERSION

# Set common environment variables (CCMO and sidecars)
export CLUSTER_CLOUD_CONTROLLER_MANAGER_OPERATOR_IMAGE=quay.io/openshift/origin-cluster-cloud-controller-manager-operator:latest
export PROVISIONER_IMAGE=quay.io/openshift/origin-csi-external-provisioner:latest  
export ATTACHER_IMAGE=quay.io/openshift/origin-csi-external-attacher:latest 
export RESIZER_IMAGE=quay.io/openshift/origin-csi-external-resizer:latest  
export SNAPSHOTTER_IMAGE=quay.io/openshift/origin-csi-external-snapshotter:latest  
export NODE_DRIVER_REGISTRAR_IMAGE=quay.io/openshift/origin-csi-node-driver-registrar:latest  
export LIVENESS_PROBE_IMAGE=quay.io/openshift/origin-csi-livenessprobe:latest  
export KUBE_RBAC_PROXY_IMAGE=quay.io/openshift/origin-kube-rbac-proxy:latest

Configure provider specific variables

Note that each provider requires different env variables to be set. Inspect their respective asset files to see what variables are needed and then find which env variables are used to replace them. Example with AWS EBS: see the asset file here and replacements here.

AWS EBS operator example:

export AWS_EBS_DRIVER_IMAGE=quay.io/openshift/origin-aws-ebs-csi-driver
export AWS_EBS_DRIVER_OPERATOR_IMAGE=quay.io/openshift/origin-aws-ebs-csi-driver-operator

Azure Disk and Azure File operator example:

export AZURE_DISK_DRIVER_OPERATOR_IMAGE=quay.io/openshift/origin-azure-disk-csi-driver-operator:latest
export AZURE_FILE_DRIVER_OPERATOR_IMAGE=quay.io/openshift/origin-azure-file-csi-driver-operator:latest
export AZURE_DISK_DRIVER_IMAGE=quay.io/openshift/origin-azure-disk-csi-driver:latest
export AZURE_FILE_DRIVER_IMAGE=quay.io/openshift/origin-azure-file-csi-driver:latest

Build and run CSO locally

# Build the operator (can be run before exporting variables)
make

# OPTIONAL - delete existing CSO lock
oc -n openshift-cluster-storage-operator delete lease/cluster-storage-operator-lock

# Run the operator via CLI
./cluster-storage-operator start --kubeconfig $KUBECONFIG --namespace openshift-cluster-storage-operator

cluster-storage-operator's People

Contributors

Stargazers

Watchers

Forkers

childsb wongma7 abhinavdahiya suicidesin sosiouxme derekwaynecarr gnufied cgwalters smarterclayton liangxia juan-lee ravisantoshgudimetla cblecker sjenning bertinatto jsafrane openshift-cherrypick-robot acostamanowarrior huffmanca rgolangh deads2k openshift-bot sttts jupierce guillaumerose csrwng mandre cfergeau staebler osherdp global-localhost global19 global19-atlassian-net tsmetana ydayagi sanchezl akhil-rane hexfusion stbenjam cynepco3hahue isabella232 p0lyn0mial duchri66 elbehery vrutkovs openshift-ci-robot gabemontero dobsonj gal-zaidman adambkaplan maysamacedo s-urbaniak rvanderp3 jerpeter1 prietyc123 gayathrimenath-ibm kwoodson isgasho alicerum eggfoobar joelddiaz nutanix-cloud-native lm0943111262 romanbednar alvaroaleman davidvossel jkhelil qjkee madhan-swe dgoodwin deeghuge tuxtof xueqzhan danilo-gemoli sgkokocool1 dharaneeshvrd mhenriks dlom shiftstack jstuever vr4manta mpatlasov barbacbd cjschaef lance5890 jcpowermac liouk c634019 openshift-art-build-bot bryan-cox jan--f rhrmo kramaranya bharath-b-rh

cluster-storage-operator's Issues

Future Release Branches Frozen For Merging | branch:release-4.16 branch:release-4.17

The following branches are being fast-forwarded from the current development branch (master) as placeholders for future releases. No merging is allowed into these release branches until they are unfrozen for production release.

release-4.16
release-4.17

For more information, see the branching documentation.

Assign a priority class to pods

Priority classes docs:
https://docs.openshift.com/container-platform/3.11/admin_guide/scheduling/priority_preemption.html#admin-guide-priority-preemption-priority-class

Example: https://github.com/openshift/cluster-monitoring-operator/search?q=priority&unscoped_q=priority

Notes: The pre-configured system priority classes (system-node-critical and system-cluster-critical) can only be assigned to pods in kube-system or openshift-* namespaces. Most likely, core operators and their pods should be assigned system-cluster-critical. Please do not assign system-node-critical (the highest priority) unless you are really sure about it.

Future Release Branches Frozen For Merging | branch:release-4.6 branch:release-4.5

release-4.6
release-4.5

Contact the Test Platform or Automated Release teams for more information.

[libvirt] CVO is not able to update storage operator and timeout.

I tried latest master of installer and looks like CVO time out during the update of storage operator which never finish and finally error out.

$ openshift-install version
openshift-install unreleased-master-577-g9777df02d2a0dc287bb520c5ea2f409499c28eca
built from commit 9777df02d2a0dc287bb520c5ea2f409499c28eca

$ oc get clusterversion
NAME      VERSION                           AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.0.0-0.alpha-2019-03-19-045826   False       True          27m     Working towards 4.0.0-0.alpha-2019-03
-19-045826: 99% complete

$ oc logs cluster-version-operator-8dc5dc7fb-xslw4 -n openshift-cluster-version | grep error
[...]
E0319 09:35:19.656479       1 task.go:58] error running apply for clusteroperator "monitoring" (200 of 309): Cluster operator monitoring is still updating
E0319 09:41:18.089625       1 task.go:58] error running apply for clusteroperator "storage" (234 of 309): Cluster operator storage is still updating
E0319 09:47:20.090892       1 task.go:58] error running apply for clusteroperator "storage" (234 of 309): Cluster operator storage is still updating
E0319 09:53:24.092701       1 task.go:58] error running apply for clusteroperator "storage" (234 of 309): Cluster operator storage is still updating
E0319 10:00:22.223533       1 task.go:58] error running apply for clusteroperator "storage" (234 of 309): Cluster operator storage is still updating
E0319 10:06:23.224944       1 task.go:58] error running apply for clusteroperator "storage" (234 of 309): Cluster operator storage is still updating

$ oc logs cluster-storage-operator-6d48465ddc-nf7p2 -n openshift-cluster-storage-operator
{"level":"info","ts":1552987778.9392104,"logger":"cmd","msg":"Version of operator-sdk: v0.4.0"}
{"level":"info","ts":1552987778.9575768,"logger":"leader","msg":"Trying to become the leader."}
{"level":"info","ts":1552987780.0816255,"logger":"leader","msg":"No pre-existing lock was found."}
{"level":"info","ts":1552987780.094624,"logger":"leader","msg":"Became the leader."}
{"level":"info","ts":1552987780.494817,"logger":"cmd","msg":"Registering Components."}
{"level":"info","ts":1552987780.4957511,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"clusterstorage-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1552987780.496057,"logger":"kubebuilder.controller","msg":"Starting EventSource","controller":"clusterstorage-controller","source":"kind source: /, Kind="}
{"level":"info","ts":1552987780.4962041,"logger":"cmd","msg":"Starting the Cmd."}
{"level":"info","ts":1552987780.5967765,"logger":"kubebuilder.controller","msg":"Starting Controller","controller":"clusterstorage-controller"}
{"level":"info","ts":1552987780.6976883,"logger":"kubebuilder.controller","msg":"Starting workers","controller":"clusterstorage-controller","worker count":1}
{"level":"info","ts":1552987780.6982288,"logger":"controller_clusterstorage","msg":"Reconciling ConfigMap","Request.Namespace":"kube-system","Request.Name":"cluster-config-v1"}
{"level":"error","ts":1552987780.8459468,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"clusterstorage-controller","request":"kube-system/cluster-config-v1","error":"unsupported platform",
"stacktrace":"github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr/zapr.go:128\ngit
hub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io
/controller-runtime/pkg/internal/controller/controller.go:215\ngithub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github
.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitter
Until.func1\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitt
erUntil\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\
t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
{"level":"info","ts":1552987781.846561,"logger":"controller_clusterstorage","msg":"Reconciling ConfigMap","Request.Namespace":"kube-system","Request.Name":"cluster-config-v1"}
{"level":"error","ts":1552987781.8589041,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"clusterstorage-controller","request":"kube-system/cluster-config-v1","error":"unsupported platform",
"stacktrace":"github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr/zapr.go:128\ngit
hub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io
/controller-runtime/pkg/internal/controller/controller.go:215\ngithub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github
.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitter
Until.func1\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitt
erUntil\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\
t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
{"level":"info","ts":1552987782.864532,"logger":"controller_clusterstorage","msg":"Reconciling ConfigMap","Request.Namespace":"kube-system","Request.Name":"cluster-config-v1"}
{"level":"error","ts":1552987782.8718219,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"clusterstorage-controller","request":"kube-system/cluster-config-v1","error":"unsupported platform",
"stacktrace":"github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr/zapr.go:128\ngit
hub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io
/controller-runtime/pkg/internal/controller/controller.go:215\ngithub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github
.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitter
Until.func1\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitt
erUntil\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\
t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
{"level":"info","ts":1552987783.8890083,"logger":"controller_clusterstorage","msg":"Reconciling ConfigMap","Request.Namespace":"kube-system","Request.Name":"cluster-config-v1"}
{"level":"error","ts":1552987783.9157248,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"clusterstorage-controller","request":"kube-system/cluster-config-v1","error":"unsupported platform",
"stacktrace":"github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr/zapr.go:128\ngit
hub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io
/controller-runtime/pkg/internal/controller/controller.go:215\ngithub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github
.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitter
Until.func1\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitt
erUntil\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\
t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
{"level":"info","ts":1552987784.9165065,"logger":"controller_clusterstorage","msg":"Reconciling ConfigMap","Request.Namespace":"kube-system","Request.Name":"cluster-config-v1"}
{"level":"error","ts":1552987784.929943,"logger":"kubebuilder.controller","msg":"Reconciler error","controller":"clusterstorage-controller","request":"kube-system/cluster-config-v1","error":"unsupported platform","
stacktrace":"github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/github.com/go-logr/zapr/zapr.go:128\ngith
ub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/
controller-runtime/pkg/internal/controller/controller.go:215\ngithub.com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1\n\t/go/src/github.
com/openshift/cluster-storage-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:158\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.JitterU
ntil.func1\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Jitte
rUntil\n\t/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t
/go/src/github.com/openshift/cluster-storage-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}

$ oc get clusterversion
NAME      VERSION                           AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.0.0-0.alpha-2019-03-19-045826   False       True          63m     Unable to apply 4.0.0-0.alpha-2019-03-19-045826: the cluster operator storage has not yet successfully rolled out

Unit test syncStatus/verify that status makes sense

should be a no-op on unknown platforms

See openshift/installer#1112 and e.g. openshift/machine-config-operator#340 - rather than erroring out, just do nothing if the platform is unknown.

This will aid porting to new platforms.

Concretely today this operator errors out on libvirt, but as we e.g. bring up GCP and other platforms it will be less painful if operators like this one don't error out.

(We probably do want to surface their non-operation though in a visible way)

HTTPS_PROXY ENV missing in vmware-vsphere-csi-driver-operator

Hello,

In a not-so-common environment we need the operator to reach vmware API enpoint through a proxy, it seems there is no proxy env set. The proxy is configured clusterwide.

I am honestly not sure if adding the environment variable would make anything work, as the driver would still need to be aware of the variable correct? Also not sure if this is relevant to the cluster-storage-operator or on VMWare side of things maybe?

oc rsh -n openshift-cluster-csi-drivers vmware-vsphere-csi-driver-operator-57bc458d9c-nmwf5
sh-4.4$ curl -vk -m 5 https://xxx.xxxx.xxx.xxx/sdk
*   Trying 999.999.999.999...
* TCP_NODELAY set
* Connection timed out after 5001 milliseconds
* Closing connection 0
curl: (28) Connection timed out after 5001 milliseconds

$ oc rsh -n openshift-cluster-csi-drivers vmware-vsphere-csi-driver-operator-57bc458d9c-nmwf5
sh-4.4$ HTTPS_PROXY=http://yyy.yyy.yyy.yyy:3128 curl -k https://xxx.xxx.xxx.xxx | head -5
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  3618  100  3618    0     0   153k      0 --:--:-- --:--:-- --:--:--  153k
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en">
 <head>
  <meta http-equiv="content-type" content="text/html; charset=utf-8">

Future Release Branches Frozen For Merging | branch:release-4.18 branch:release-4.19

release-4.18
release-4.19

For more information, see the branching documentation.

Default storageclass should have WaitForFirstConsumer

this will prevent unschedulable pods

Read platform from Infrastructure instead of install-config

https://github.com/openshift/api/blob/01e157580c39b8e5a266a1d747bfbed1e1c5a854/config/v1/types_infrastructure.go#L31 instead of https://github.com/openshift/installer/blob/8173c233bc05045e70c6caaaa9589e23c5465170/pkg/types/installconfig.go#L52.

AlertsDisabled: false UnmarshalStrict error

upgrading openshift from 4.13 to 4.14 I found the following error:

VSphereProblemDetectorMonitoringControllerDegraded: invalid format of ConfigMap vsphere-problem-detector: yaml: unmarshal errors:
VSphereProblemDetectorMonitoringControllerDegraded: line 1: field AlertsDisabled not found in type vsphereproblemdetector.DetectorConfig

how should I set the configmap?

thanks

Encryption

Should be able to set the encryption parameter somewhere. Maybe a config map?

I have Openshift 4.3 installed in a vcenter 6.7 cluster

I have Openshift 4.3 installed in a vcenter 6.7 cluster.
I'm also using dynamic thin storage provisioning (default storage class).
But I look in my cluster datastores and cant find where the files are stored.
Where datastore does openshift create the files on?
Any help would be appreciated?

ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "openstack endpoint": net/http: TLS handshake timeout

Hello,
I am getting an error in storage cluster operator when deploying okd 4.13.

[root@bastion ~]# oc describe co storage
Name:         storage
Namespace:
Labels:       <none>
Annotations:  capability.openshift.io/name: Storage
              include.release.openshift.io/ibm-cloud-managed: true
              include.release.openshift.io/self-managed-high-availability: true
              include.release.openshift.io/single-node-developer: true
API Version:  config.openshift.io/v1
Kind:         ClusterOperator
Metadata:
  Creation Timestamp:  2023-12-05T08:01:44Z
  Generation:          1
  Managed Fields:
    API Version:  config.openshift.io/v1
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:capability.openshift.io/name:
          f:include.release.openshift.io/ibm-cloud-managed:
          f:include.release.openshift.io/self-managed-high-availability:
          f:include.release.openshift.io/single-node-developer:
        f:ownerReferences:
          .:
          k:{"uid":"257a57e3-cb63-435c-8ba3-efcb1662a60e"}:
      f:spec:
    Manager:      cluster-version-operator
    Operation:    Update
    Time:         2023-12-05T08:01:44Z
    API Version:  config.openshift.io/v1
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        .:
        f:extension:
    Manager:      cluster-version-operator
    Operation:    Update
    Subresource:  status
    Time:         2023-12-05T08:01:45Z
    API Version:  config.openshift.io/v1
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        f:conditions:
        f:relatedObjects:
        f:versions:
    Manager:      cluster-storage-operator
    Operation:    Update
    Subresource:  status
    Time:         2023-12-05T10:05:42Z
  Owner References:
    API Version:     config.openshift.io/v1
    Controller:      true
    Kind:            ClusterVersion
    Name:            version
    UID:             257a57e3-cb63-435c-8ba3-efcb1662a60e
  Resource Version:  63882
  UID:               d4ef0460-ce92-412b-88d3-c82460522356
Spec:
Status:
  Conditions:
    Last Transition Time:  2023-12-05T08:35:58Z
    Message:               OpenStackCinderCSIDriverOperatorCRDegraded: ConfigSyncDegraded: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
    Reason:                OpenStackCinderCSIDriverOperatorCR_ConfigSync_SyncError
    Status:                True
    Type:                  Degraded
    Last Transition Time:  2023-12-05T08:32:36Z
    Message:               OpenStackCinderCSIDriverOperatorCRProgressing: OpenStackCinderDriverControllerServiceControllerProgressing: Waiting for Deployment to deploy pods
OpenStackCinderCSIDriverOperatorCRProgressing: OpenStackCinderDriverNodeServiceControllerProgressing: Waiting for DaemonSet to deploy node pods
    Reason:                OpenStackCinderCSIDriverOperatorCR_OpenStackCinderDriverControllerServiceController_Deploying::OpenStackCinderDriverNodeServiceController_Deploying
    Status:                True
    Type:                  Progressing
    Last Transition Time:  2023-12-05T08:32:39Z
    Message:               OpenStackCinderCSIDriverOperatorCRAvailable: OpenStackCinderDriverControllerServiceControllerAvailable: Waiting for Deployment
OpenStackCinderCSIDriverOperatorCRAvailable: OpenStackCinderDriverNodeServiceControllerAvailable: Waiting for the DaemonSet to deploy the CSI Node Service
    Reason:                OpenStackCinderCSIDriverOperatorCR_OpenStackCinderDriverControllerServiceController_Deploying::OpenStackCinderDriverNodeServiceController_Deploying
    Status:                False
    Type:                  Available
    Last Transition Time:  2023-12-05T08:32:22Z
    Message:               All is well
    Reason:                AsExpected
    Status:                True
    Type:                  Upgradeable
  Extension:               <nil>
  Related Objects:
    Group:
    Name:       openstack-cinder-csi-driver-operator
    Namespace:  openshift-cluster-csi-drivers
    Resource:   serviceaccounts
    Group:      rbac.authorization.k8s.io
    Name:       openstack-cinder-csi-driver-operator-role
    Namespace:  openshift-cluster-csi-drivers
    Resource:   roles
    Group:      rbac.authorization.k8s.io
    Name:       openstack-cinder-csi-driver-operator-rolebinding
    Namespace:  openshift-cluster-csi-drivers
    Resource:   rolebindings
    Group:      rbac.authorization.k8s.io
    Name:       openstack-cinder-csi-driver-operator-clusterrole
    Resource:   clusterroles
    Group:      rbac.authorization.k8s.io
    Name:       openstack-cinder-csi-driver-operator-clusterrolebinding
    Resource:   clusterrolebindings
    Group:      operator.openshift.io
    Name:       cinder.csi.openstack.org
    Resource:   clustercsidrivers
    Group:
    Name:       openshift-manila-csi-driver
    Resource:   namespaces
    Group:
    Name:       manila-csi-driver-operator
    Namespace:  openshift-cluster-csi-drivers
    Resource:   serviceaccounts
    Group:      rbac.authorization.k8s.io
    Name:       manila-csi-driver-operator-role
    Namespace:  openshift-cluster-csi-drivers
    Resource:   roles
    Group:      rbac.authorization.k8s.io
    Name:       manila-csi-driver-operator-rolebinding
    Namespace:  openshift-cluster-csi-drivers
    Resource:   rolebindings
    Group:      rbac.authorization.k8s.io
    Name:       manila-csi-driver-operator-clusterrole
    Resource:   clusterroles
    Group:      rbac.authorization.k8s.io
    Name:       manila-csi-driver-operator-clusterrolebinding
    Resource:   clusterrolebindings
    Group:      operator.openshift.io
    Name:       manila.csi.openstack.org
    Resource:   clustercsidrivers
    Group:
    Name:       openshift-cluster-storage-operator
    Resource:   namespaces
    Group:
    Name:       openshift-cluster-csi-drivers
    Resource:   namespaces
    Group:      operator.openshift.io
    Name:       cluster
    Resource:   storages
    Group:      rbac.authorization.k8s.io
    Name:       cluster-storage-operator-role
    Resource:   clusterrolebindings
    Group:      sharedresource.openshift.io
    Name:
    Resource:   sharedconfigmaps
    Group:      sharedresource.openshift.io
    Name:
    Resource:   sharedsecrets
  Versions:
    Name:     operator
    Version:  4.13.0-0.okd-2023-09-30-084937
Events:       <none>

[root@bastion ~]# oc logs -n openshift-cluster-csi-drivers openstack-cinder-csi-driver-operator-7db6d5b687-5qpz8
W1205 08:32:50.617789       1 cmd.go:213] Using insecure, self-signed certificates
I1205 08:32:50.618267       1 crypto.go:601] Generating new CA for openstack-cinder-csi-driver-operator-signer@1701765170 cert, and key in /tmp/serving-cert-389677376/serving-signer.crt, /tmp/serving-cert-389677376/serving-signer.key
I1205 08:32:51.271907       1 observer_polling.go:159] Starting file observer
I1205 08:32:51.593901       1 builder.go:262] openstack-cinder-csi-driver-operator version v0.0.0-unknown-90ee04bc-90ee04bc
I1205 08:32:51.595322       1 dynamic_serving_content.go:113] "Loaded a new cert/key pair" name="serving-cert::/tmp/serving-cert-389677376/tls.crt::/tmp/serving-cert-389677376/tls.key"
I1205 08:32:52.502576       1 requestheader_controller.go:244] Loaded a new request header values for RequestHeaderAuthRequestController
I1205 08:32:52.769460       1 maxinflight.go:140] "Initialized nonMutatingChan" len=400
I1205 08:32:52.769490       1 maxinflight.go:146] "Initialized mutatingChan" len=200
I1205 08:32:52.769527       1 maxinflight.go:117] "Set denominator for readonly requests" limit=400
I1205 08:32:52.769537       1 maxinflight.go:121] "Set denominator for mutating requests" limit=200
W1205 08:32:52.773778       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
I1205 08:32:52.773794       1 genericapiserver.go:484] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete
W1205 08:32:52.773804       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
I1205 08:32:53.202130       1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController
I1205 08:32:53.202189       1 shared_informer.go:273] Waiting for caches to sync for RequestHeaderAuthRequestController
I1205 08:32:53.202286       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1205 08:32:53.202312       1 shared_informer.go:273] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1205 08:32:53.202341       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I1205 08:32:53.202355       1 shared_informer.go:273] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I1205 08:32:53.202404       1 tlsconfig.go:200] "Loaded serving cert" certName="serving-cert::/tmp/serving-cert-389677376/tls.crt::/tmp/serving-cert-389677376/tls.key" certDetail="\"localhost\" [serving] validServingFor=[localhost] issuer=\"openstack-cinder-csi-driver-operator-signer@1701765170\" (2023-12-05 08:32:50 +0000 UTC to 2024-01-04 08:32:51 +0000 UTC (now=2023-12-05 08:32:53.202347006 +0000 UTC))"
I1205 08:32:53.202591       1 named_certificates.go:53] "Loaded SNI cert" index=0 certName="self-signed loopback" certDetail="\"apiserver-loopback-client@1701765172\" [serving] validServingFor=[apiserver-loopback-client] issuer=\"apiserver-loopback-client-ca@1701765171\" (2023-12-05 07:32:51 +0000 UTC to 2024-12-04 07:32:51 +0000 UTC (now=2023-12-05 08:32:53.202563975 +0000 UTC))"
I1205 08:32:53.202623       1 secure_serving.go:210] Serving securely on [::]:8443
I1205 08:32:53.202658       1 genericapiserver.go:589] [graceful-termination] waiting for shutdown to be initiated
I1205 08:32:53.202696       1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/tmp/serving-cert-389677376/tls.crt::/tmp/serving-cert-389677376/tls.key"
I1205 08:32:53.202834       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I1205 08:32:53.203616       1 leaderelection.go:248] attempting to acquire leader lease openshift-cluster-csi-drivers/openstack-cinder-csi-driver-operator-lock...
I1205 08:32:53.302431       1 shared_informer.go:280] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I1205 08:32:53.302474       1 shared_informer.go:280] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I1205 08:32:53.302493       1 shared_informer.go:280] Caches are synced for RequestHeaderAuthRequestController
I1205 08:32:53.302941       1 tlsconfig.go:178] "Loaded client CA" index=0 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"aggregator-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:34 +0000 UTC to 2023-12-06 07:29:34 +0000 UTC (now=2023-12-05 08:32:53.302891263 +0000 UTC))"
I1205 08:32:53.303195       1 tlsconfig.go:200] "Loaded serving cert" certName="serving-cert::/tmp/serving-cert-389677376/tls.crt::/tmp/serving-cert-389677376/tls.key" certDetail="\"localhost\" [serving] validServingFor=[localhost] issuer=\"openstack-cinder-csi-driver-operator-signer@1701765170\" (2023-12-05 08:32:50 +0000 UTC to 2024-01-04 08:32:51 +0000 UTC (now=2023-12-05 08:32:53.303171022 +0000 UTC))"
I1205 08:32:53.303447       1 named_certificates.go:53] "Loaded SNI cert" index=0 certName="self-signed loopback" certDetail="\"apiserver-loopback-client@1701765172\" [serving] validServingFor=[apiserver-loopback-client] issuer=\"apiserver-loopback-client-ca@1701765171\" (2023-12-05 07:32:51 +0000 UTC to 2024-12-04 07:32:51 +0000 UTC (now=2023-12-05 08:32:53.30341069 +0000 UTC))"
I1205 08:32:53.303708       1 tlsconfig.go:178] "Loaded client CA" index=0 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"admin-kubeconfig-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:31 +0000 UTC to 2033-12-02 07:29:31 +0000 UTC (now=2023-12-05 08:32:53.303684481 +0000 UTC))"
I1205 08:32:53.303784       1 tlsconfig.go:178] "Loaded client CA" index=1 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kubelet-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:36 +0000 UTC to 2023-12-06 07:29:36 +0000 UTC (now=2023-12-05 08:32:53.303764382 +0000 UTC))"
I1205 08:32:53.303850       1 tlsconfig.go:178] "Loaded client CA" index=2 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kube-control-plane-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:36 +0000 UTC to 2024-12-04 07:29:36 +0000 UTC (now=2023-12-05 08:32:53.303817087 +0000 UTC))"
I1205 08:32:53.303928       1 tlsconfig.go:178] "Loaded client CA" index=3 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kube-apiserver-to-kubelet-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:36 +0000 UTC to 2024-12-04 07:29:36 +0000 UTC (now=2023-12-05 08:32:53.303893409 +0000 UTC))"
I1205 08:32:53.303992       1 tlsconfig.go:178] "Loaded client CA" index=4 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kubelet-bootstrap-kubeconfig-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:33 +0000 UTC to 2033-12-02 07:29:33 +0000 UTC (now=2023-12-05 08:32:53.30395982 +0000 UTC))"
I1205 08:32:53.304041       1 tlsconfig.go:178] "Loaded client CA" index=5 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"aggregator-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:34 +0000 UTC to 2023-12-06 07:29:34 +0000 UTC (now=2023-12-05 08:32:53.30402307 +0000 UTC))"
I1205 08:32:53.304258       1 tlsconfig.go:200] "Loaded serving cert" certName="serving-cert::/tmp/serving-cert-389677376/tls.crt::/tmp/serving-cert-389677376/tls.key" certDetail="\"localhost\" [serving] validServingFor=[localhost] issuer=\"openstack-cinder-csi-driver-operator-signer@1701765170\" (2023-12-05 08:32:50 +0000 UTC to 2024-01-04 08:32:51 +0000 UTC (now=2023-12-05 08:32:53.304233614 +0000 UTC))"
I1205 08:32:53.304478       1 named_certificates.go:53] "Loaded SNI cert" index=0 certName="self-signed loopback" certDetail="\"apiserver-loopback-client@1701765172\" [serving] validServingFor=[apiserver-loopback-client] issuer=\"apiserver-loopback-client-ca@1701765171\" (2023-12-05 07:32:51 +0000 UTC to 2024-12-04 07:32:51 +0000 UTC (now=2023-12-05 08:32:53.304437707 +0000 UTC))"
I1205 08:32:54.679108       1 leaderelection.go:258] successfully acquired lease openshift-cluster-csi-drivers/openstack-cinder-csi-driver-operator-lock
I1205 08:32:54.679243       1 event.go:285] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator-lock", UID:"a98c3ee0-b24a-485c-b369-0007e6f5e85f", APIVersion:"v1", ResourceVersion:"10965", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' openstack-cinder-csi-driver-operator-7db6d5b687-5qpz8_e53a89e2-4183-464d-a5da-0a54ba0d6010 became leader
I1205 08:32:54.679723       1 event.go:285] Event(v1.ObjectReference{Kind:"Lease", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator-lock", UID:"bc11e796-fd2b-445d-b711-a72e22871a2d", APIVersion:"coordination.k8s.io/v1", ResourceVersion:"10971", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' openstack-cinder-csi-driver-operator-7db6d5b687-5qpz8_e53a89e2-4183-464d-a5da-0a54ba0d6010 became leader
I1205 08:32:54.681206       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Warning' reason: 'FastControllerResync' Controller "LoggingSyncer" resync interval is set to 0s which might lead to client request throttling
I1205 08:32:54.692682       1 starter.go:200] Starting the informers
I1205 08:32:54.692720       1 starter.go:206] Starting controllers
I1205 08:32:54.692762       1 base_controller.go:67] Waiting for caches to sync for ConfigSync
I1205 08:32:54.692869       1 base_controller.go:67] Waiting for caches to sync for StorageClassController
I1205 08:32:54.693269       1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer
I1205 08:32:54.693586       1 base_controller.go:67] Waiting for caches to sync for CinderServiceMonitorController
I1205 08:32:54.693290       1 base_controller.go:67] Waiting for caches to sync for OpenStackCinderDriverNodeServiceController
I1205 08:32:54.693303       1 base_controller.go:67] Waiting for caches to sync for ManagementStateController
I1205 08:32:54.693795       1 base_controller.go:67] Waiting for caches to sync for OpenStackCinderDriverStaticResourcesController
I1205 08:32:54.693842       1 base_controller.go:67] Waiting for caches to sync for OpenStackCinderDriverConditionalStaticResourcesController
I1205 08:32:54.693875       1 base_controller.go:67] Waiting for caches to sync for ConfigObserver
I1205 08:32:54.693899       1 base_controller.go:67] Waiting for caches to sync for OpenStackCinderDriverControllerServiceController
I1205 08:32:54.793842       1 base_controller.go:73] Caches are synced for OpenStackCinderDriverNodeServiceController
I1205 08:32:54.793866       1 base_controller.go:73] Caches are synced for ManagementStateController
I1205 08:32:54.793875       1 base_controller.go:110] Starting #1 worker of OpenStackCinderDriverNodeServiceController controller ...
I1205 08:32:54.793880       1 base_controller.go:110] Starting #1 worker of ManagementStateController controller ...
I1205 08:32:54.793900       1 base_controller.go:73] Caches are synced for OpenStackCinderDriverConditionalStaticResourcesController
I1205 08:32:54.793906       1 base_controller.go:110] Starting #1 worker of OpenStackCinderDriverConditionalStaticResourcesController controller ...
I1205 08:32:54.793919       1 base_controller.go:73] Caches are synced for StorageClassController
I1205 08:32:54.793926       1 base_controller.go:110] Starting #1 worker of StorageClassController controller ...
I1205 08:32:54.793932       1 base_controller.go:73] Caches are synced for CinderServiceMonitorController
I1205 08:32:54.793938       1 base_controller.go:110] Starting #1 worker of CinderServiceMonitorController controller ...
I1205 08:32:54.793939       1 base_controller.go:73] Caches are synced for LoggingSyncer
I1205 08:32:54.793945       1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ...
I1205 08:32:54.794284       1 base_controller.go:73] Caches are synced for OpenStackCinderDriverControllerServiceController
I1205 08:32:54.794301       1 base_controller.go:110] Starting #1 worker of OpenStackCinderDriverControllerServiceController controller ...
I1205 08:32:54.794326       1 base_controller.go:73] Caches are synced for ConfigSync
I1205 08:32:54.794331       1 base_controller.go:110] Starting #1 worker of ConfigSync controller ...
I1205 08:32:54.794354       1 base_controller.go:73] Caches are synced for OpenStackCinderDriverStaticResourcesController
I1205 08:32:54.794363       1 base_controller.go:110] Starting #1 worker of OpenStackCinderDriverStaticResourcesController controller ...
I1205 08:32:54.794381       1 base_controller.go:73] Caches are synced for ConfigObserver
I1205 08:32:54.794390       1 base_controller.go:110] Starting #1 worker of ConfigObserver controller ...
I1205 08:32:55.213497       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ServiceMonitorCreated' Created ServiceMonitor.monitoring.coreos.com/v1 because it was missing
I1205 08:32:55.214590       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'DaemonSetCreated' Created DaemonSet.apps/openstack-cinder-csi-driver-node -n openshift-cluster-csi-drivers because it was missing
I1205 08:32:55.215238       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'DeploymentCreated' Created Deployment.apps/openstack-cinder-csi-driver-controller -n openshift-cluster-csi-drivers because it was missing
I1205 08:32:55.224285       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassCreated' Created StorageClass.storage.k8s.io/standard-csi because it was missing
I1205 08:32:55.500258       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'VolumeSnapshotClassCreated' Created VolumeSnapshotClass.snapshot.storage.k8s.io/v1 because it was missing
E1205 08:32:56.591902       1 base_controller.go:272] StorageClassController reconciliation failed: Operation cannot be fulfilled on clustercsidrivers.operator.openshift.io "cinder.csi.openstack.org": the object has been modified; please apply your changes to the latest version and try again
E1205 08:32:57.170243       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Operation cannot be fulfilled on clustercsidrivers.operator.openshift.io "cinder.csi.openstack.org": the object has been modified; please apply your changes to the latest version and try again
I1205 08:32:57.432114       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleCreated' Created ClusterRole.rbac.authorization.k8s.io/openstack-cinder-external-attacher-role because it was missing
I1205 08:32:57.753848       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'DeploymentUpdated' Updated Deployment.apps/openstack-cinder-csi-driver-controller -n openshift-cluster-csi-drivers because it changed
I1205 08:33:01.457143       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleBindingCreated' Created ClusterRoleBinding.rbac.authorization.k8s.io/openstack-cinder-csi-attacher-binding because it was missing
I1205 08:33:05.617930       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleCreated' Created ClusterRole.rbac.authorization.k8s.io/openstack-cinder-privileged-role because it was missing
I1205 08:33:08.636974       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleBindingCreated' Created ClusterRoleBinding.rbac.authorization.k8s.io/openstack-cinder-controller-privileged-binding because it was missing
I1205 08:33:11.197450       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleBindingCreated' Created ClusterRoleBinding.rbac.authorization.k8s.io/openstack-cinder-node-privileged-binding because it was missing
I1205 08:33:13.946640       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleCreated' Created ClusterRole.rbac.authorization.k8s.io/openstack-cinder-external-provisioner-role because it was missing
I1205 08:33:16.020571       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleBindingCreated' Created ClusterRoleBinding.rbac.authorization.k8s.io/openstack-cinder-csi-provisioner-binding because it was missing
I1205 08:33:17.927914       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleCreated' Created ClusterRole.rbac.authorization.k8s.io/openstack-cinder-external-resizer-role because it was missing
I1205 08:33:19.248880       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleBindingCreated' Created ClusterRoleBinding.rbac.authorization.k8s.io/openstack-cinder-csi-resizer-binding because it was missing
I1205 08:33:19.679670       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleCreated' Created ClusterRole.rbac.authorization.k8s.io/openstack-cinder-external-snapshotter-role because it was missing
I1205 08:33:20.125253       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleBindingCreated' Created ClusterRoleBinding.rbac.authorization.k8s.io/openstack-cinder-csi-snapshotter-binding because it was missing
I1205 08:33:20.811028       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleCreated' Created ClusterRole.rbac.authorization.k8s.io/openstack-cinder-kube-rbac-proxy-role because it was missing
I1205 08:33:22.251166       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ClusterRoleBindingCreated' Created ClusterRoleBinding.rbac.authorization.k8s.io/openstack-cinder-kube-rbac-proxy-binding because it was missing
I1205 08:33:24.407530       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RoleCreated' Created Role.rbac.authorization.k8s.io/openstack-cinder-csi-driver-prometheus -n openshift-cluster-csi-drivers because it was missing
E1205 08:33:24.932136       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": dial tcp: lookup subdomain.domain.com: i/o timeout
I1205 08:33:27.229014       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RoleBindingCreated' Created RoleBinding.rbac.authorization.k8s.io/openstack-cinder-csi-driver-prometheus -n openshift-cluster-csi-drivers because it was missing
I1205 08:33:27.735753       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'CSIDriverCreated' Created CSIDriver.storage.k8s.io/cinder.csi.openstack.org because it was missing
I1205 08:33:28.162755       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ServiceAccountCreated' Created ServiceAccount/openstack-cinder-csi-driver-controller-sa -n openshift-cluster-csi-drivers because it was missing
I1205 08:33:28.811646       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'PodDisruptionBudgetCreated' Created PodDisruptionBudget.policy/openstack-cinder-csi-driver-controller-pdb -n openshift-cluster-csi-drivers because it was missing
I1205 08:33:29.233457       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ServiceAccountCreated' Created ServiceAccount/openstack-cinder-csi-driver-node-sa -n openshift-cluster-csi-drivers because it was missing
I1205 08:33:30.219082       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ServiceCreated' Created Service/openstack-cinder-csi-driver-controller-metrics -n openshift-cluster-csi-drivers because it was missing
I1205 08:33:30.386115       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'ConfigMapCreated' Created ConfigMap/openstack-cinder-csi-driver-trusted-ca-bundle -n openshift-cluster-csi-drivers because it was missing
I1205 08:33:49.162085       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'DaemonSetUpdated' Updated DaemonSet.apps/openstack-cinder-csi-driver-node -n openshift-cluster-csi-drivers because it changed
I1205 08:33:49.162554       1 event.go:285] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"574a6d85-967e-4bd1-a918-9cefc11a74ca", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'DeploymentUpdated' Updated Deployment.apps/openstack-cinder-csi-driver-controller -n openshift-cluster-csi-drivers because it changed
E1205 08:33:54.934739       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": dial tcp: lookup subdomain.domain.com: i/o timeout
E1205 08:34:24.936957       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": dial tcp: lookup subdomain.domain.com: i/o timeout
E1205 08:34:54.939077       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": dial tcp: lookup subdomain.domain.com: i/o timeout
E1205 08:35:24.941737       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": dial tcp: lookup subdomain.domain.com: i/o timeout
E1205 08:35:54.944454       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": dial tcp: lookup subdomain.domain.com: i/o timeout
E1205 08:36:24.947001       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": dial tcp: lookup subdomain.domain.com: i/o timeout
E1205 08:36:54.948839       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": dial tcp: lookup subdomain.domain.com: i/o timeout
E1205 08:37:20.433525       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:37:30.441487       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:37:40.448293       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:37:50.474706       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
I1205 08:37:52.986033       1 tlsconfig.go:178] "Loaded client CA" index=0 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"admin-kubeconfig-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:31 +0000 UTC to 2033-12-02 07:29:31 +0000 UTC (now=2023-12-05 08:37:52.985977269 +0000 UTC))"
I1205 08:37:52.986185       1 tlsconfig.go:178] "Loaded client CA" index=1 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kubelet-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:36 +0000 UTC to 2023-12-06 07:29:36 +0000 UTC (now=2023-12-05 08:37:52.986157561 +0000 UTC))"
I1205 08:37:52.986256       1 tlsconfig.go:178] "Loaded client CA" index=2 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kube-control-plane-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:36 +0000 UTC to 2024-12-04 07:29:36 +0000 UTC (now=2023-12-05 08:37:52.986235693 +0000 UTC))"
I1205 08:37:52.986328       1 tlsconfig.go:178] "Loaded client CA" index=3 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kube-apiserver-to-kubelet-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:36 +0000 UTC to 2024-12-04 07:29:36 +0000 UTC (now=2023-12-05 08:37:52.98630776 +0000 UTC))"
I1205 08:37:52.986379       1 tlsconfig.go:178] "Loaded client CA" index=4 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kubelet-bootstrap-kubeconfig-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:33 +0000 UTC to 2033-12-02 07:29:33 +0000 UTC (now=2023-12-05 08:37:52.98635989 +0000 UTC))"
I1205 08:37:52.986428       1 tlsconfig.go:178] "Loaded client CA" index=5 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"kube-csr-signer_@1701765140\" [] issuer=\"kubelet-signer\" (2023-12-05 08:32:19 +0000 UTC to 2023-12-06 07:29:36 +0000 UTC (now=2023-12-05 08:37:52.986409828 +0000 UTC))"
I1205 08:37:52.986493       1 tlsconfig.go:178] "Loaded client CA" index=6 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"openshift-kube-apiserver-operator_node-system-admin-signer@1701765140\" [] issuer=\"<self>\" (2023-12-05 08:32:19 +0000 UTC to 2024-12-04 08:32:20 +0000 UTC (now=2023-12-05 08:37:52.986471938 +0000 UTC))"
I1205 08:37:52.986543       1 tlsconfig.go:178] "Loaded client CA" index=7 certName="client-ca::kube-system::extension-apiserver-authentication::client-ca-file,client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" certDetail="\"aggregator-signer\" [] issuer=\"<self>\" (2023-12-05 07:29:34 +0000 UTC to 2023-12-06 07:29:34 +0000 UTC (now=2023-12-05 08:37:52.986525008 +0000 UTC))"
I1205 08:37:52.986792       1 tlsconfig.go:200] "Loaded serving cert" certName="serving-cert::/tmp/serving-cert-389677376/tls.crt::/tmp/serving-cert-389677376/tls.key" certDetail="\"localhost\" [serving] validServingFor=[localhost] issuer=\"openstack-cinder-csi-driver-operator-signer@1701765170\" (2023-12-05 08:32:50 +0000 UTC to 2024-01-04 08:32:51 +0000 UTC (now=2023-12-05 08:37:52.986770202 +0000 UTC))"
I1205 08:37:52.986981       1 named_certificates.go:53] "Loaded SNI cert" index=0 certName="self-signed loopback" certDetail="\"apiserver-loopback-client@1701765172\" [serving] validServingFor=[apiserver-loopback-client] issuer=\"apiserver-loopback-client-ca@1701765171\" (2023-12-05 07:32:51 +0000 UTC to 2024-12-04 07:32:51 +0000 UTC (now=2023-12-05 08:37:52.986959891 +0000 UTC))"
E1205 08:38:00.486050       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:38:10.723411       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:38:50.733958       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:39:01.693773       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:41:18.894133       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:41:55.550560       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:42:31.291709       1 base_controller.go:272] OpenStackCinderDriverStaticResourcesController reconciliation failed: ["rbac/node_privileged_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-node-privileged-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/provisioner_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-provisioner-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/provisioner_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-provisioner-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/resizer_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-resizer-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/resizer_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-resizer-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/snapshotter_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-snapshotter-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/snapshotter_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/kube_rbac_proxy_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-kube-rbac-proxy-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/kube_rbac_proxy_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-kube-rbac-proxy-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/prometheus_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-cluster-csi-drivers/roles/openstack-cinder-csi-driver-prometheus": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/prometheus_rolebinding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-cluster-csi-drivers/rolebindings/openstack-cinder-csi-driver-prometheus": dial tcp 172.30.0.1:443: connect: connection refused, "csidriver.yaml" (string): Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/csidrivers/cinder.csi.openstack.org": dial tcp 172.30.0.1:443: connect: connection refused, "controller_sa.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/serviceaccounts/openstack-cinder-csi-driver-controller-sa": dial tcp 172.30.0.1:443: connect: connection refused, "controller_pdb.yaml" (string): Get "https://172.30.0.1:443/apis/policy/v1/namespaces/openshift-cluster-csi-drivers/poddisruptionbudgets/openstack-cinder-csi-driver-controller-pdb": dial tcp 172.30.0.1:443: connect: connection refused, "node_sa.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/serviceaccounts/openstack-cinder-csi-driver-node-sa": dial tcp 172.30.0.1:443: connect: connection refused, "service.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/services/openstack-cinder-csi-driver-controller-metrics": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
E1205 08:42:48.420764       1 base_controller.go:272] OpenStackCinderDriverStaticResourcesController reconciliation failed: ["rbac/attacher_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-attacher-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/attacher_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-attacher-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/privileged_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-privileged-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/controller_privileged_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-controller-privileged-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/node_privileged_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-node-privileged-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/provisioner_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-provisioner-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/provisioner_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-provisioner-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/resizer_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-resizer-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/resizer_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-resizer-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/snapshotter_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-snapshotter-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/snapshotter_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/kube_rbac_proxy_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-kube-rbac-proxy-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/kube_rbac_proxy_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-kube-rbac-proxy-binding": dial tcp 172.30.0.1:443: connect: connection refused]
E1205 08:42:51.710200       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:43:01.717822       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:43:11.726005       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:44:05.948075       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:45:39.217707       1 leaderelection.go:330] error retrieving resource lock openshift-cluster-csi-drivers/openstack-cinder-csi-driver-operator-lock: Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/configmaps/openstack-cinder-csi-driver-operator-lock?timeout=1m47s": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:46:05.785472       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:46:20.859932       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:46:30.869905       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
W1205 08:49:23.490875       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:23.490936       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:23.497653       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:23.497718       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:23.503982       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:23.504023       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:23.515348       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:23.515393       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:23.561137       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:23.561176       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:23.647054       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:23.647093       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:23.813886       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:23.813926       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:24.140667       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.140729       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:24.788235       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.788300       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.860356       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:24.866170       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.866243       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:24.866342       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.866371       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.867994       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:24.875430       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.875511       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:24.877023       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.877080       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.882576       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:24.891360       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:24.891447       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:25.093324       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:25.093488       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:25.291349       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:25.491111       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:25.491268       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:25.637412       1 leaderelection.go:330] error retrieving resource lock openshift-cluster-csi-drivers/openstack-cinder-csi-driver-operator-lock: Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/configmaps/openstack-cinder-csi-driver-operator-lock?timeout=1m47s": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:25.691700       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:25.691779       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:25.892027       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:26.090856       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:26.090923       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:26.291059       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:26.291103       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:26.491347       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:26.690894       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:26.690944       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:26.890918       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:26.890962       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:27.091372       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:27.091421       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:27.291834       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:27.491378       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:27.491439       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:27.691868       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:27.691936       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:27.892065       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:28.091026       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:28.091074       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:28.291632       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:28.291699       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:28.491719       1 base_controller.go:272] OpenStackCinderDriverStaticResourcesController reconciliation failed: ["rbac/resizer_binding.yaml" (string): the server has received too many requests and has asked us to try again later (get clusterrolebindings.rbac.authorization.k8s.io openstack-cinder-csi-resizer-binding), "rbac/snapshotter_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-snapshotter-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/snapshotter_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/kube_rbac_proxy_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-kube-rbac-proxy-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/kube_rbac_proxy_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-kube-rbac-proxy-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/prometheus_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-cluster-csi-drivers/roles/openstack-cinder-csi-driver-prometheus": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/prometheus_rolebinding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-cluster-csi-drivers/rolebindings/openstack-cinder-csi-driver-prometheus": dial tcp 172.30.0.1:443: connect: connection refused, "csidriver.yaml" (string): Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/csidrivers/cinder.csi.openstack.org": dial tcp 172.30.0.1:443: connect: connection refused, "controller_sa.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/serviceaccounts/openstack-cinder-csi-driver-controller-sa": dial tcp 172.30.0.1:443: connect: connection refused, "controller_pdb.yaml" (string): Get "https://172.30.0.1:443/apis/policy/v1/namespaces/openshift-cluster-csi-drivers/poddisruptionbudgets/openstack-cinder-csi-driver-controller-pdb": dial tcp 172.30.0.1:443: connect: connection refused, "node_sa.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/serviceaccounts/openstack-cinder-csi-driver-node-sa": dial tcp 172.30.0.1:443: connect: connection refused, "service.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/services/openstack-cinder-csi-driver-controller-metrics": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
E1205 08:49:28.691799       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:28.891405       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:28.891449       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:29.091019       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:29.091069       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
W1205 08:49:29.290862       1 base_controller.go:236] Updating status of "OpenStackCinderDriverControllerServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:29.290906       1 base_controller.go:272] OpenStackCinderDriverControllerServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/deployments/openstack-cinder-csi-driver-controller": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:29.976243       1 base_controller.go:272] CinderServiceMonitorController reconciliation failed: ["servicemonitor.yaml" (string): Get "https://172.30.0.1:443/apis/monitoring.coreos.com/v1/namespaces/openshift-cluster-csi-drivers/servicemonitors/openstack-cinder-csi-driver-controller-monitor": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:30.174565       1 base_controller.go:236] Updating status of "StorageClassController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:30.174620       1 base_controller.go:272] StorageClassController reconciliation failed: Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/storageclasses/standard-csi": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:30.286794       1 base_controller.go:272] OpenStackCinderDriverStaticResourcesController reconciliation failed: ["rbac/attacher_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-attacher-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/attacher_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-attacher-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/privileged_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-privileged-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/controller_privileged_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-controller-privileged-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/node_privileged_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-node-privileged-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/provisioner_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-provisioner-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/provisioner_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-provisioner-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/resizer_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-resizer-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/resizer_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-resizer-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/snapshotter_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-snapshotter-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/snapshotter_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/kube_rbac_proxy_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-kube-rbac-proxy-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/kube_rbac_proxy_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-kube-rbac-proxy-binding": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/prometheus_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-cluster-csi-drivers/roles/openstack-cinder-csi-driver-prometheus": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/prometheus_rolebinding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/namespaces/openshift-cluster-csi-drivers/rolebindings/openstack-cinder-csi-driver-prometheus": dial tcp 172.30.0.1:443: connect: connection refused, "csidriver.yaml" (string): Get "https://172.30.0.1:443/apis/storage.k8s.io/v1/csidrivers/cinder.csi.openstack.org": dial tcp 172.30.0.1:443: connect: connection refused, "controller_sa.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/serviceaccounts/openstack-cinder-csi-driver-controller-sa": dial tcp 172.30.0.1:443: connect: connection refused, "controller_pdb.yaml" (string): Get "https://172.30.0.1:443/apis/policy/v1/namespaces/openshift-cluster-csi-drivers/poddisruptionbudgets/openstack-cinder-csi-driver-controller-pdb": dial tcp 172.30.0.1:443: connect: connection refused, "node_sa.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/serviceaccounts/openstack-cinder-csi-driver-node-sa": dial tcp 172.30.0.1:443: connect: connection refused, "service.yaml" (string): Get "https://172.30.0.1:443/api/v1/namespaces/openshift-cluster-csi-drivers/services/openstack-cinder-csi-driver-controller-metrics": dial tcp 172.30.0.1:443: connect: connection refused, Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused]
W1205 08:49:30.375990       1 base_controller.go:236] Updating status of "OpenStackCinderDriverNodeServiceController" failed: Put "https://172.30.0.1:443/apis/operator.openshift.io/v1/clustercsidrivers/cinder.csi.openstack.org/status": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:30.376035       1 base_controller.go:272] OpenStackCinderDriverNodeServiceController reconciliation failed: Get "https://172.30.0.1:443/apis/apps/v1/namespaces/openshift-cluster-csi-drivers/daemonsets/openstack-cinder-csi-driver-node": dial tcp 172.30.0.1:443: connect: connection refused
E1205 08:49:49.020575       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:49:51.806311       1 base_controller.go:272] OpenStackCinderDriverStaticResourcesController reconciliation failed: ["rbac/attacher_role.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-attacher-role": dial tcp 172.30.0.1:443: connect: connection refused, "rbac/attacher_binding.yaml" (string): Get "https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-attacher-binding": dial tcp 172.30.0.1:443: connect: connection refused]
E1205 08:50:01.264009       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:50:11.279511       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:50:21.293538       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout
E1205 08:52:16.277641       1 base_controller.go:272] ConfigSync reconciliation failed: couldn't collect info about cloud availability zones: failed to create a compute client: Get "https://subdomain.domain.com:13000/": net/http: TLS handshake timeout

I am unable to understand why this issue is coming.

I am able to ping and curl to the openstack endpoint from master and worker nodes without any issues.

Make StorageClass owned by operator

IMO, we should wait for 1.13 clusterscoped OwnerReferences. Alternatively we can add an annotation to make it obvious that it is owned and managed by this operator

Future Release Branches Frozen For Merging | branch:release-4.6

release-4.6

Contact the Test Platform or Automated Release teams for more information.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.