Advertisement
GarbageYard

RancherSingleNodeHA_Issue

Feb 3rd, 2020
265
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
YAML 24.02 KB | None | 0 0
  1. ubuntu@ip-172-31-43-14:~$ kubectl get pods -n cattle-system
  2. NAME                      READY   STATUS    RESTARTS   AGE
  3. rancher-ddf788bbf-fkqpd   1/1     Running   2          54m
  4. rancher-ddf788bbf-jklwq   1/1     Running   2          54m
  5. rancher-ddf788bbf-mnqck   1/1     Running   1          54m
  6. ubuntu@ip-172-31-43-14:~$ kubectl logs -n cattle-system rancher-ddf788bbf-fkqpd
  7. 2020/02/04 07:05:41 [INFO] Rancher version v2.3.5 is starting
  8. 2020/02/04 07:05:41 [INFO] Listening on /tmp/log.sock
  9. 2020/02/04 07:05:41 [INFO] Rancher arguments {ACMEDomains:[] AddLocal:auto Embedded:false KubeConfig: HTTPListenPort:80 HTTPSListenPort:443 K8sMode:auto Debug:false NoCACerts:false ListenConfig:<nil> AuditLogPath:/var/log/auditlog/rancher-api-audit.log AuditLogMaxage:10 AuditLogMaxsize:100 AuditLogMaxbackup:10 AuditLevel:0 Features:}
  10. 2020/02/04 07:05:41 [INFO] Running in clustered mode with ID 10.42.0.10, monitoring endpoint cattle-system/rancher
  11. 2020/02/04 07:05:46 [INFO] Starting API controllers
  12. 2020/02/04 07:05:46 [INFO] Listening on :443
  13. 2020/02/04 07:05:46 [INFO] Listening on :80
  14. 2020/02/04 07:05:46 [ERROR] ListenConfigController cli-config [listener] failed with : secrets "tls-rancher" already exists
  15. 2020/02/04 07:05:58 [INFO] Starting cluster controllers for local
  16. 2020/02/04 07:05:58 [INFO] Starting cluster agent for local [owner=false]
  17. 2020/02/04 07:06:02 [INFO] Adding peer wss://10.42.0.11/v3/connect, 10.42.0.11
  18. 2020/02/04 07:06:02 [INFO] Stopping cluster agent for local
  19. 2020/02/04 07:06:02 [INFO] Shutting down RoleController controller
  20. 2020/02/04 07:06:02 [INFO] Shutting down ClusterRoleController controller
  21. 2020/02/04 07:06:02 [INFO] Shutting down RoleBindingController controller
  22. 2020/02/04 07:06:02 [INFO] Shutting down ClusterRoleBindingController controller
  23. 2020/02/04 07:06:02 [INFO] Shutting down EndpointsController controller
  24. 2020/02/04 07:06:02 [INFO] Shutting down ServiceController controller
  25. 2020/02/04 07:06:02 [INFO] Shutting down NamespaceController controller
  26. 2020/02/04 07:06:02 [INFO] Shutting down APIServiceController controller
  27. 2020/02/04 07:06:02 [INFO] Registering project network policy
  28. 2020/02/04 07:06:02 [INFO] Registering CIS controller
  29. 2020/02/04 07:06:02 [INFO] registering podsecuritypolicy cluster handler for cluster local
  30. 2020/02/04 07:06:02 [INFO] registering podsecuritypolicy project handler for cluster local
  31. 2020/02/04 07:06:02 [INFO] registering podsecuritypolicy namespace handler for cluster local
  32. 2020/02/04 07:06:02 [INFO] registering podsecuritypolicy serviceaccount handler for cluster local
  33. 2020/02/04 07:06:02 [INFO] registering podsecuritypolicy template handler for cluster local
  34. 2020/02/04 07:06:02 [INFO] Registering monitoring for cluster "local"
  35. 2020/02/04 07:06:02 [INFO] Registering istio for cluster "local"
  36. 2020/02/04 07:06:02 [INFO] Creating CRD prometheuses.monitoring.coreos.com
  37. 2020/02/04 07:06:03 [INFO] Creating CRD prometheusrules.monitoring.coreos.com
  38. 2020/02/04 07:06:03 [INFO] Creating CRD alertmanagers.monitoring.coreos.com
  39. 2020/02/04 07:06:03 [INFO] Creating CRD servicemonitors.monitoring.coreos.com
  40. 2020/02/04 07:06:03 [INFO] Waiting for CRD servicemonitors.monitoring.coreos.com to become available
  41. 2020/02/04 07:06:04 [INFO] Done waiting for CRD servicemonitors.monitoring.coreos.com to become available
  42. 2020/02/04 07:06:04 [INFO] Registering namespaceHandler for adding labels
  43. 2020/02/04 07:06:04 [INFO] Starting cluster controllers for local
  44. 2020/02/04 07:06:04 [INFO] Handling backend connection request [10.42.0.11]
  45. 2020/02/04 07:06:04 [INFO] Adding peer wss://10.42.0.9/v3/connect, 10.42.0.9
  46. 2020/02/04 07:06:04 [INFO] Starting cluster agent for local [owner=true]
  47. 2020/02/04 07:06:04 [INFO] Updating workload [cattle-system/rancher] with public endpoints [[{"addresses":["172.31.23.225"],"port":443,"protocol":"HTTPS","serviceName":"cattle-system:rancher","ingressName":"cattle-system:rancher","hostname":"rancher.demo.in","allNodes":false}]]
  48. 2020/02/04 07:06:04 [INFO] Updating ingress [cattle-system:rancher] with public endpoints [[{"addresses":["172.31.23.225"],"port":443,"protocol":"HTTPS","serviceName":"cattle-system:rancher","ingressName":"cattle-system:rancher","hostname":"rancher.demo.in","allNodes":false}]]
  49. 2020/02/04 07:06:05 [INFO] Creating clusterRole for roleTemplate Cluster Owner (cluster-owner).
  50. 2020/02/04 07:06:05 [INFO] Creating clusterRole for roleTemplate Project Owner (project-owner).
  51. 2020/02/04 07:06:05 [INFO] Creating clusterRole for roleTemplate Project Owner (project-owner).
  52. 2020/02/04 07:06:05 [INFO] Updating role project-owner in p-lfb45 because of rules difference with roleTemplate Project Owner (project-owner).
  53. 2020/02/04 07:06:05 [INFO] Updating role project-owner in p-tp7bn because of rules difference with roleTemplate Project Owner (project-owner).
  54. 2020/02/04 07:06:05 [INFO] Updating role project-owner in p-tp7bn because of rules difference with roleTemplate Project Owner (project-owner).
  55. 2020/02/04 07:06:05 [ERROR] CatalogController system-library [system-image-upgrade-catalog-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  56. 2020/02/04 07:06:05 [INFO] Creating clusterRole project-owner-promoted for project access to global resource.
  57. 2020/02/04 07:06:05 [INFO] Creating clusterRole project-owner-promoted for project access to global resource.
  58. 2020/02/04 07:06:05 [INFO] Creating roleBinding User user-cpbn9 Role cluster-owner
  59. 2020/02/04 07:06:05 [INFO] Creating clusterRole project-owner-promoted for project access to global resource.
  60. 2020/02/04 07:06:06 [ERROR] ProjectRoleTemplateBindingController p-lfb45/creator-project-owner [cluster-prtb-sync] failed with : couldn't create role project-owner-promoted: clusterroles.rbac.authorization.k8s.io "project-owner-promoted" already exists
  61. 2020/02/04 07:06:06 [INFO] Updating clusterRole project-owner-promoted for project access to global resource.
  62. 2020/02/04 07:06:06 [ERROR] ClusterAlertRuleController local/high-number-of-leader-changes [cluster-alert-rule-deployer] failed with : update cluster local failed, Operation cannot be fulfilled on clusters.management.cattle.io "local": the object has been modified; please apply your changes to the latest version and try again
  63. 2020/02/04 07:06:06 [ERROR] ClusterAlertRuleController local/deployment-event-alert [cluster-alert-rule-deployer] failed with : update cluster local failed, Operation cannot be fulfilled on clusters.management.cattle.io "local": the object has been modified; please apply your changes to the latest version and try again
  64. 2020/02/04 07:06:06 [ERROR] ClusterAlertRuleController local/node-disk-running-full [cluster-alert-rule-deployer] failed with : update cluster local failed, Operation cannot be fulfilled on clusters.management.cattle.io "local": the object has been modified; please apply your changes to the latest version and try again
  65. 2020/02/04 07:06:06 [ERROR] ClusterAlertRuleController local/etcd-system-service [cluster-alert-rule-deployer] failed with : update cluster local failed, Operation cannot be fulfilled on clusters.management.cattle.io "local": the object has been modified; please apply your changes to the latest version and try again
  66. 2020/02/04 07:06:06 [ERROR] ClusterAlertRuleController local/high-memmory [cluster-alert-rule-deployer] failed with : update cluster local failed, Operation cannot be fulfilled on clusters.management.cattle.io "local": the object has been modified; please apply your changes to the latest version and try again
  67. 2020/02/04 07:06:06 [ERROR] ProjectRoleTemplateBindingController p-tp7bn/creator-project-owner [cluster-prtb-sync] failed with : couldn't create role project-owner-promoted: clusterroles.rbac.authorization.k8s.io "project-owner-promoted" already exists
  68. 2020/02/04 07:06:06 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  69. 2020/02/04 07:06:06 [ERROR] CatalogController system-library [system-image-upgrade-catalog-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  70. 2020/02/04 07:06:06 [INFO] Updating clusterRole project-owner-promoted for project access to global resource.
  71. 2020/02/04 07:06:06 [ERROR] ClusterAlertGroupController local/kube-components-alert [cluster-alert-group-deployer] failed with : update cluster local failed, Operation cannot be fulfilled on clusters.management.cattle.io "local": the object has been modified; please apply your changes to the latest version and try again
  72. 2020/02/04 07:06:06 [ERROR] ClusterAlertGroupController local/etcd-alert [cluster-alert-group-deployer] failed with : update cluster local failed, Operation cannot be fulfilled on clusters.management.cattle.io "local": the object has been modified; please apply your changes to the latest version and try again
  73. 2020/02/04 07:06:06 [ERROR] ClusterAlertGroupController local/event-alert [cluster-alert-group-deployer] failed with : update cluster local failed, Operation cannot be fulfilled on clusters.management.cattle.io "local": the object has been modified; please apply your changes to the latest version and try again
  74. 2020/02/04 07:06:06 [INFO] Created machine for node [172.31.23.225]
  75. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  76. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  77. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role admin
  78. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role admin
  79. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role admin
  80. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  81. 2020/02/04 07:06:07 [INFO] Updating clusterRole project-owner-promoted for project access to global resource.
  82. 2020/02/04 07:06:07 [ERROR] CatalogController system-library [system-image-upgrade-catalog-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  83. 2020/02/04 07:06:07 [INFO] Creating clusterRole for roleTemplate Create Namespaces (create-ns).
  84. 2020/02/04 07:06:07 [INFO] Creating clusterRoleBinding for project access to global resource for subject user-cpbn9 role p-lfb45-namespaces-edit.
  85. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role admin
  86. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  87. 2020/02/04 07:06:07 [INFO] Creating clusterRoleBinding for project access to global resource for subject user-cpbn9 role project-owner-promoted.
  88. 2020/02/04 07:06:07 [INFO] Creating roleBinding User user-cpbn9 Role admin
  89. 2020/02/04 07:06:07 [INFO] Creating clusterRoleBinding for project access to global resource for subject user-cpbn9 role project-owner-promoted.
  90. 2020/02/04 07:06:08 [INFO] Creating roleBinding User user-cpbn9 Role admin
  91. 2020/02/04 07:06:08 [INFO] Creating clusterRoleBinding for project access to global resource for subject user-cpbn9 role create-ns.
  92. 2020/02/04 07:06:08 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  93. 2020/02/04 07:06:08 [INFO] Creating roleBinding User user-cpbn9 Role admin
  94. 2020/02/04 07:06:08 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  95. 2020/02/04 07:06:08 [INFO] Creating user for principal system://p-tp7bn
  96. 2020/02/04 07:06:08 [INFO] Creating roleBinding User user-cpbn9 Role admin
  97. 2020/02/04 07:06:08 [INFO] Creating user for principal system://p-lfb45
  98. 2020/02/04 07:06:08 [INFO] Creating roleBinding User u-b4qkhsnliz Role cluster-owner
  99. 2020/02/04 07:06:08 [INFO] Creating roleBinding User u-b4qkhsnliz Role cluster-owner
  100. 2020/02/04 07:06:08 [INFO] Creating roleBinding User user-cpbn9 Role admin
  101. 2020/02/04 07:06:08 [INFO] Creating clusterRoleBinding for project access to global resource for subject user-cpbn9 role p-tp7bn-namespaces-edit.
  102. 2020/02/04 07:06:08 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  103. 2020/02/04 07:06:08 [INFO] Creating clusterRoleBinding for project access to global resource for subject user-cpbn9 role p-tp7bn-namespaces-edit.
  104. 2020/02/04 07:06:08 [WARNING] error updating ns cattle-global-nt status: Operation cannot be fulfilled on namespaces "cattle-global-nt": the object has been modified; please apply your changes to the latest version and try again
  105. 2020/02/04 07:06:08 [INFO] Updating clusterRoleBinding clusterrolebinding-fmrnr for project access to global resource for subject user-cpbn9 role project-owner-promoted.
  106. 2020/02/04 07:06:08 [INFO] Creating globalRoleBindings for u-mdluwwxl2p
  107. 2020/02/04 07:06:08 [INFO] Updating clusterRoleBinding clusterrolebinding-fmrnr for project access to global resource for subject user-cpbn9 role project-owner-promoted.
  108. 2020/02/04 07:06:08 [INFO] Creating globalRoleBindings for u-bit7ow2r4q
  109. 2020/02/04 07:06:08 [INFO] Deleting roleBinding clusterrolebinding-wtmr8
  110. 2020/02/04 07:06:08 [INFO] Deleting roleBinding clusterrolebinding-pmbjl
  111. 2020/02/04 07:06:08 [INFO] Updating clusterRoleBinding clusterrolebinding-4656r for project access to global resource for subject user-cpbn9 role project-owner-promoted.
  112. 2020/02/04 07:06:08 [INFO] Updating clusterRoleBinding clusterrolebinding-4656r for project access to global resource for subject user-cpbn9 role project-owner-promoted.
  113. 2020/02/04 07:06:08 [INFO] Deleting roleBinding clusterrolebinding-sgp5d
  114. 2020/02/04 07:06:08 [INFO] Deleting roleBinding clusterrolebinding-s8n9l
  115. 2020/02/04 07:06:08 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-lfb45 to namespace=default
  116. 2020/02/04 07:06:09 [ERROR] namespaceHandler: Sync: error adding project id label to namespace err=Operation cannot be fulfilled on namespaces "default": the object has been modified; please apply your changes to the latest version and try again
  117. 2020/02/04 07:06:09 [INFO] Creating clusterRole for roleTemplate Project Member (project-member).
  118. 2020/02/04 07:06:09 [INFO] Creating clusterRole for roleTemplate Project Member (project-member).
  119. 2020/02/04 07:06:09 [INFO] Deleting roleBinding clusterrolebinding-sgmtv
  120. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role project-member
  121. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role project-member
  122. 2020/02/04 07:06:09 [INFO] Updating clusterRoleBinding clusterrolebinding-q9j6l for project access to global resource for subject user-cpbn9 role create-ns.
  123. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  124. 2020/02/04 07:06:09 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-tp7bn to namespace=kube-public
  125. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  126. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  127. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-bit7ow2r4q Role project-member
  128. 2020/02/04 07:06:09 [ERROR] ProjectController local/p-tp7bn [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  129. 2020/02/04 07:06:09 [INFO] Handling backend connection request [10.42.0.9]
  130. 2020/02/04 07:06:09 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  131. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role project-member
  132. 2020/02/04 07:06:09 [INFO] Deleting roleBinding clusterrolebinding-2lhjz
  133. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-bit7ow2r4q Role edit
  134. 2020/02/04 07:06:09 [INFO] Creating roleBinding User user-cpbn9 Role admin
  135. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role project-member
  136. 2020/02/04 07:06:09 [INFO] Creating clusterRole project-member-promoted for project access to global resource.
  137. 2020/02/04 07:06:09 [INFO] Creating roleBinding User user-cpbn9 Role project-owner
  138. 2020/02/04 07:06:09 [ERROR] ProjectController local/p-lfb45 [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  139. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  140. 2020/02/04 07:06:09 [INFO] Deleting roleBinding clusterrolebinding-2lhjz
  141. 2020/02/04 07:06:09 [WARNING] error updating ns local status: Operation cannot be fulfilled on namespaces "local": the object has been modified; please apply your changes to the latest version and try again
  142. 2020/02/04 07:06:09 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-tp7bn to namespace=ingress-nginx
  143. 2020/02/04 07:06:09 [ERROR] CatalogController system-library [system-image-upgrade-catalog-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  144. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  145. 2020/02/04 07:06:09 [INFO] Creating clusterRole project-member-promoted for project access to global resource.
  146. 2020/02/04 07:06:09 [INFO] Creating roleBinding User user-cpbn9 Role admin
  147. 2020/02/04 07:06:09 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-tp7bn to namespace=cert-manager
  148. 2020/02/04 07:06:09 [INFO] Creating roleBinding User user-cpbn9 Role admin
  149. 2020/02/04 07:06:09 [INFO] Creating roleBinding User user-cpbn9 Role admin
  150. 2020/02/04 07:06:09 [INFO] Creating roleBinding User u-mdluwwxl2p Role project-member
  151. 2020/02/04 07:06:10 [INFO] Creating roleBinding User u-mdluwwxl2p Role project-member
  152. 2020/02/04 07:06:10 [INFO] Creating roleBinding User u-mdluwwxl2p Role project-member
  153. 2020/02/04 07:06:10 [INFO] Creating roleBinding User u-mdluwwxl2p Role project-member
  154. 2020/02/04 07:06:10 [ERROR] ProjectRoleTemplateBindingController p-lfb45/u-bit7ow2r4q-member [cluster-prtb-sync] failed with : couldn't create role project-member-promoted: clusterroles.rbac.authorization.k8s.io "project-member-promoted" already exists
  155. 2020/02/04 07:06:10 [INFO] Updating clusterRole project-member-promoted for project access to global resource.
  156. 2020/02/04 07:06:10 [INFO] Deleting roleBinding clusterrolebinding-5hfkk
  157. 2020/02/04 07:06:10 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  158. 2020/02/04 07:06:10 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  159. 2020/02/04 07:06:10 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  160. 2020/02/04 07:06:10 [INFO] Updating clusterRole project-member-promoted for project access to global resource.
  161. 2020/02/04 07:06:10 [WARNING] error updating ns p-tp7bn status: Operation cannot be fulfilled on namespaces "p-tp7bn": the object has been modified; please apply your changes to the latest version and try again
  162. 2020/02/04 07:06:10 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  163. 2020/02/04 07:06:10 [INFO] Deleting roleBinding clusterrolebinding-gctxm
  164. 2020/02/04 07:06:10 [INFO] Updating clusterRole project-member-promoted for project access to global resource.
  165. 2020/02/04 07:06:10 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-tp7bn to namespace=kube-node-lease
  166. 2020/02/04 07:06:10 [INFO] Creating clusterRoleBinding for project access to global resource for subject u-mdluwwxl2p role p-tp7bn-namespaces-edit.
  167. 2020/02/04 07:06:10 [INFO] Updating role project-member in p-lfb45 because of rules difference with roleTemplate Project Member (project-member).
  168. 2020/02/04 07:06:10 [INFO] Creating clusterRoleBinding for project access to global resource for subject u-mdluwwxl2p role project-member-promoted.
  169. 2020/02/04 07:06:10 [INFO] Updating role project-member in p-tp7bn because of rules difference with roleTemplate Project Member (project-member).
  170. 2020/02/04 07:06:10 [INFO] Updating role project-member in p-tp7bn because of rules difference with roleTemplate Project Member (project-member).
  171. 2020/02/04 07:06:10 [INFO] Updating role project-member in p-tp7bn because of rules difference with roleTemplate Project Member (project-member).
  172. 2020/02/04 07:06:10 [INFO] Creating clusterRoleBinding for project access to global resource for subject u-mdluwwxl2p role project-member-promoted.
  173. 2020/02/04 07:06:10 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-tp7bn to namespace=kube-system
  174. 2020/02/04 07:06:10 [INFO] Creating clusterRoleBinding for project access to global resource for subject u-mdluwwxl2p role create-ns.
  175. 2020/02/04 07:06:10 [WARNING] error updating ns kube-system status: Operation cannot be fulfilled on namespaces "kube-system": the object has been modified; please apply your changes to the latest version and try again
  176. 2020/02/04 07:06:10 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-lfb45 to namespace=default
  177. 2020/02/04 07:06:10 [ERROR] namespaceHandler: Sync: error adding project id label to namespace err=Operation cannot be fulfilled on namespaces "default": the object has been modified; please apply your changes to the latest version and try again
  178. 2020/02/04 07:06:10 [INFO] Deleting roleBinding clusterrolebinding-cfscv
  179. 2020/02/04 07:06:10 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-tp7bn to namespace=cattle-system
  180. 2020/02/04 07:06:10 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-tp7bn to namespace=cattle-global-data
  181. 2020/02/04 07:06:10 [INFO] Creating clusterRoleBinding for project access to global resource for subject u-bit7ow2r4q role p-lfb45-namespaces-edit.
  182. 2020/02/04 07:06:10 [INFO] Deleting roleBinding clusterrolebinding-d2cdp
  183. 2020/02/04 07:06:10 [INFO] Creating clusterRoleBinding for project access to global resource for subject u-bit7ow2r4q role project-member-promoted.
  184. 2020/02/04 07:06:10 [INFO] Deleting roleBinding clusterrolebinding-xdrq2
  185. 2020/02/04 07:06:10 [INFO] Deleting roleBinding clusterrolebinding-nxhl8
  186. 2020/02/04 07:06:10 [INFO] Creating clusterRoleBinding for project access to global resource for subject u-bit7ow2r4q role create-ns.
  187. 2020/02/04 07:06:10 [INFO] Deleting roleBinding clusterrolebinding-xdrq2
  188. 2020/02/04 07:06:10 [INFO] Creating roleBinding User u-mdluwwxl2p Role edit
  189. 2020/02/04 07:06:10 [INFO] namespaceHandler: addProjectIDLabelToNamespace: adding label field.cattle.io/projectId=p-lfb45 to namespace=default
  190. 2020/02/04 07:06:10 [ERROR] ProjectController local/p-lfb45 [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  191. 2020/02/04 07:06:10 [ERROR] ProjectController local/p-tp7bn [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  192. 2020/02/04 07:06:12 [ERROR] ProjectController local/p-tp7bn [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  193. 2020/02/04 07:06:12 [ERROR] ProjectController local/p-lfb45 [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  194. 2020/02/04 07:06:13 [ERROR] ProjectController local/p-tp7bn [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  195. 2020/02/04 07:06:13 [ERROR] CatalogController system-library [system-image-upgrade-catalog-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  196. 2020/02/04 07:06:13 [ERROR] ProjectController local/p-lfb45 [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  197. 2020/02/04 07:06:13 [ERROR] ProjectController local/p-tp7bn [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  198. 2020/02/04 07:06:13 [ERROR] ProjectController local/p-lfb45 [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  199. 2020/02/04 07:06:15 [ERROR] ProjectController local/p-tp7bn [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  200. 2020/02/04 07:06:15 [ERROR] ProjectController local/p-lfb45 [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  201. 2020/02/04 07:06:15 [ERROR] ProjectController local/p-tp7bn [system-image-upgrade-controller] failed with : upgrade cluster local system service logging failed: cluster local not ready
  202. ubuntu@ip-172-31-43-14:~$
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement