GKE 主节点升级不断失败

GKE 主节点升级不断失败

我将 google cloud kubernetes 集群从 升级1.16.9-gke.21.16.9-gke.6但失败了。

所有集群资源都已启动,但是:kube-apiserver端点的组件gke-3a1fa906f95b728d035e-59bc不健康。

我一直遇到这个问题。我的生产服务器完全无法访问。无法回滚。上次更新时我也遇到过这个问题。3-4 次后就解决了。这次我更新了 6-7 次。没运气。

Master of cluster [flow-env-prod] will be upgraded from version 
[1.16.9-gke.2] to version [1.16.9-gke.6]. This operation is 
long-running and will block other operations on the cluster (including
 delete) until it has run to completion.

一些日志:

Upgrading flow-env-prod...done.                                                                                                                                                                                                                
ERROR: (gcloud.container.clusters.upgrade) Operation [<Operation
 clusterConditions: [<StatusCondition
 message: u'All cluster resources were brought up, but: component "kube-apiserver" from endpoint "gke-3a1fa906f95b728d035e-59bc" is unhealthy.'>]
 detail: u'All cluster resources were brought up, but: component "kube-apiserver" from endpoint "gke-3a1fa906f95b728d035e-59bc" is unhealthy.'
 endTime: u'2020-06-23T02:09:20.859081264Z'
 name: u'operation-1592876809477-ed87ffb3'
 nodepoolConditions: []
 operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)
 selfLink: u'https://container.googleapis.com/v1/projects/[projectID]/zones/europe-west1-b/operations/operation-1592876809477-ed87ffb3'
 startTime: u'2020-06-23T01:46:49.477981885Z'
 status: StatusValueValuesEnum(DONE, 3)
 statusMessage: u'All cluster resources were brought up, but: component "kube-apiserver" from endpoint "gke-3a1fa906f95b728d035e-59bc" is unhealthy.'
 targetLink: u'https://container.googleapis.com/v1/projects/[projectID]/zones/europe-west1-b/clusters/flow-env-prod'
 zone: u'europe-west1-b'>] finished with error: All cluster resources were brought up, but: component "kube-apiserver" from endpoint "gke-3a1fa906f95b728d035e-59bc" is unhealthy.`

相关内容