Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Detected cluster health issues in your AWS account 808842816990 #6629

Open
dims opened this issue Mar 28, 2024 · 4 comments
Open

Detected cluster health issues in your AWS account 808842816990 #6629

dims opened this issue Mar 28, 2024 · 4 comments
Assignees
Labels
area/infra/aws Issues or PRs related to Kubernetes AWS infrastructure kind/bug Categorizes issue or PR as related to a bug. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra.
Milestone

Comments

@dims
Copy link
Member

dims commented Mar 28, 2024

We got an automated message from Amazon EKS folks

The following is a list of affected clusters with their cluster arns, cluster health status and corresponding cluster health issues(s):
arn:aws:eks:us-east-2:808842816990:cluster/k8s-infra-kops-prow-build : IMPAIRED : Not Enough Free IP Addresses In Subnet.

The health of an EKS cluster is a shared responsibility between AWS and customers. You must resolve these issues to maintain operational stability for your EKS cluster(s). Cluster health issues can prevent Amazon EKS from patching your clusters or prevent you from upgrading to newer Kubernetes versions.

Starting on 2024-04-15, Amazon EKS will patch clusters to the latest supported platform version [1]. Clusters that are unstable due to outstanding health issues may experience loss in connectivity between the Kubernetes control plane instances and worker nodes where your workload runs. To avoid this, we recommend that you resolve outstanding cluster health issues [2] before this date.

You can also view your affected clusters in the 'Affected resources' tab in your AWS Health Dashboard or by using the DescribeCluster API [3].

[1] https://docs.aws.amazon.com/eks/latest/userguide/platform-versions.html
[2] https://docs.aws.amazon.com/eks/latest/userguide/troubleshooting.html#cluster-health-status
[3] https://docs.aws.amazon.com/eks/latest/APIReference/API_DescribeCluster.html
@dims
Copy link
Member Author

dims commented Mar 28, 2024

cc @xmudrii

@ameukam
Copy link
Member

ameukam commented Mar 28, 2024

Working on this currently. I'll take a look next week.
/assign @ameukam

@ameukam
Copy link
Member

ameukam commented Mar 29, 2024

/sig k8s-infra
/kind bug
/area infra/aws
/milestone v1.30

@k8s-ci-robot k8s-ci-robot added the sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. label Mar 29, 2024
@k8s-ci-robot k8s-ci-robot added this to the v1.30 milestone Mar 29, 2024
@k8s-ci-robot k8s-ci-robot added kind/bug Categorizes issue or PR as related to a bug. area/infra/aws Issues or PRs related to Kubernetes AWS infrastructure labels Mar 29, 2024
@ameukam
Copy link
Member

ameukam commented Apr 14, 2024

we also get alerts from e2e-shared account. Looks like it's not specific to an EKS cluster

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/infra/aws Issues or PRs related to Kubernetes AWS infrastructure kind/bug Categorizes issue or PR as related to a bug. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra.
Projects
Status: No status
Development

No branches or pull requests

3 participants