Publick8s on Jenkins Status Page

[Resolved] Kubernetes Maintenance: Nginx Ingress + Falco upgrades

Tue, 09 Aug 2022 09:00:00 +0000

The two main Kubernetes clusters (prodpublick8s and temp-privatek8s) of the Jenkins infrastructure are going under maintenance mode to upgrade their nginx ingress and Falco controllers.

Nginx Ingress Controller: https://github.com/jenkins-infra/kubernetes-management/pull/2591
Falco Controller: https://github.com/jenkins-infra/kubernetes-management/pull/2596

While no major down time is expected, the following services could be restarted leading to a 1 to 5 minute disruption:

www.jenkins.io
plugins.jenkins.io
javadoc.jenkins.io
get.jenkins.io
fallback.get.jenkins.io
reports.jenkins.io
uplink.jenkins.io
customize.jenkins.io
incrementals.jenkins.io
beta.accounts.jenkins.io
mirror.azure.jenkins.io
jenkins-wiki-exporter.jenkins.io
archives.azure.jenkins.io
release.ci.jenkins.io
infra.ci.jenkins.io
admin.accounts.jenkins.io
grafana.publick8s.jenkins.io

[Resolved] AKS publick8s version update

Thu, 17 Jun 2021 08:00:00 +0000

INFRA-3005 NOTES

[Closing Maintenance]

The update to Kubernetes 1.19.11 was successfully finished at 14:00 UTC
The service ldap.jenkins.io had 2 downtimes post-mortem, resulting in authentication not possible on the JIRA and the plugin releases where not possible during the following time windows:
- From 08:08 UTC until 08:13 UTC (6 min)
- From 10:40 UTC until 10:41 UTC (1 min)

[Initial Message] We’ll do an AKS cluster upgrade.

The service ldap.jenkins.io service will be restarted. All other services should remain up and running.

[Resolved] Nginx ingress upgrade

Mon, 03 May 2021 11:00:00 +0000

**Update 2021-05-03 11:58 UTC

The operation is successful, we are now waiting several hours before deleting the temporary resources that we created during the transition to be sure that no DNS traffics is redirected to those locations. We didn’t notice service downtime during the process.

There is no ETA at the moment.

We are upgrading the nginx ingress controllers on the Kubernetes cluster publick8s. While no down time is expected, the risk during this upgrade is to stop redirecting HTTP/HTTPS traffics to the following services:

Public services:

www.jenkins.io
plugins.jenkins.io
javadoc.jenkins.io
get.jenkins.io
fallback.get.jenkins.io
reports.jenkins.io
uplink.jenkins.io
customize.jenkins.io
incrementals.jenkins.io
beta.accounts.jenkins.io
mirror.azure.jenkins.io
jenkins-wiki-exporter.jenkins.io
archives.azure.jenkins.io

Private services:

release.ci.jenkins.io
infra.ci.jenkins.io
admin.accounts.jenkins.io
grafana.publick8s.jenkins.io

The operation consists of deploying temporary ingress controllers listening on ephemeral IPs.

[Resolved] AKS publick8s version update

Wed, 14 Apr 2021 07:30:00 +0000

INFRA-2944 NOTES

We’ll do an AKS cluster upgrade.

The service ldap.jenkins.io service will be restarted. All other services should remain up and running.

[Resolved] AKS publick8s version update

Mon, 07 Dec 2020 13:00:00 +0000

We’ll do an AKS cluster upgrade.