NO-ISSUE: Automated - Update synthetic test data

[openshift-bot]

disruptions Information

There were (2216) added jobs and (832) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 401 jobs increased and 1010 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
azure-network-liveness-new-connections	4.22		amd64	ovn	azure	external	433	6m48.6s	304.55%	15m10.4s	136.31%
gcp-network-liveness-new-connections	4.22		amd64	ovn	azure	external	433	4m16s	293.85%	11m17.2s	185.74%
gcp-network-liveness-new-connections	4.22	4.22	amd64	ovn	azure	ha	758	5m25.45s	79.76%	19m39.45s	470.86%
gcp-network-liveness-new-connections	4.22		arm64	ovn	aws	ha	132	3m14.05s	119.27%	16m34.37s	237.65%
azure-network-liveness-new-connections	4.22		multi	ovn	aws	ha	153	3m28.4s	99.71%	22m18.12s	276.65%
gcp-network-liveness-new-connections	4.22		multi	ovn	aws	ha	153	2m33.2s	189.33%	16m13.76s	343.71%
azure-network-liveness-new-connections	4.22		s390x	ovn	none	ha	167	2m54.5s	116.50%	23m24.7s	171.08%
azure-network-liveness-new-connections	4.22		arm64	ovn	aws	ha	132	3m59.25s	56.37%	23m50.36s	210.95%
openshift-api-http2-localhost-reused-connections	4.22		arm64	ovn	aws	ha	132	2m49.45s	86.21%	2m59s	75.15%
openshift-api-http2-localhost-new-connections	4.22		arm64	ovn	aws	ha	132	2m41s	85.06%	2m50.38s	78.41%
kube-api-http1-localhost-reused-connections	4.22		arm64	ovn	aws	ha	132	2m22.45s	85.00%	2m30.76s	75.92%
kube-api-http2-localhost-reused-connections	4.22		arm64	ovn	aws	ha	132	2m22.45s	85.00%	2m31.07s	76.28%
kube-api-http1-localhost-new-connections	4.22		arm64	ovn	aws	ha	132	2m22.45s	83.81%	2m31.07s	76.28%
kube-api-http2-localhost-new-connections	4.22		arm64	ovn	aws	ha	132	2m22.45s	83.81%	2m31.38s	76.64%
openshift-api-http2-localhost-reused-connections	4.22		amd64	ovn	aws	ha	267	2m29.7s	70.11%	2m50.04s	83.17%
kube-api-http2-localhost-new-connections	4.22		amd64	ovn	aws	ha	180	2m17.05s	79.97%	2m33.21s	86.84%
openshift-api-http2-localhost-new-connections	4.22		amd64	ovn	aws	ha	267	2m28.7s	60.24%	2m49.02s	70.66%
kube-api-http1-localhost-reused-connections	4.22		amd64	ovn	aws	ha	267	2m6.7s	57.59%	2m29.02s	69.26%
kube-api-http1-localhost-new-connections	4.22		amd64	ovn	aws	ha	267	2m6.4s	55.28%	2m29.02s	69.26%
kube-api-http2-localhost-reused-connections	4.22		amd64	ovn	aws	ha	267	2m6.4s	55.28%	2m29.02s	69.26%
gcp-network-liveness-new-connections	4.22		s390x	ovn	none	ha	167	2m2.9s	32.29%	16m27.52s	173.19%
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	aws	ha	894	1m7s	52.97%	1m44.07s	136.74%
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	azure	ha	758	1m19s	38.35%	1m28.43s	52.94%
openshift-api-http2-localhost-reused-connections	4.22	4.22	amd64	ovn	azure	ha	758	1m26s	31.30%	1m37.43s	46.07%
gcp-network-liveness-new-connections	4.22		amd64	ovn	aws	ha	180	36.3s	91.05%	2m40.09s	30.41%
openshift-api-http2-internal-lb-reused-connections	4.22	4.22	amd64	ovn	aws	ha	894	11s	780.00%	1m15.07s	103.72%
kube-api-http1-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	758	6s	200.00%	8s	300.00%
ingress-to-console-new-connections	4.22	4.22	amd64	ovn	aws	ha	894	4s	344.44%	6.07s	519.39%
image-registry-new-connections	4.22	4.22	amd64	ovn	aws	ha	894	4s	344.44%	7s	614.29%
kube-api-http2-service-network-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	6s	50.00%	7s	40.00%
ingress-to-console-reused-connections	4.22	4.22	amd64	ovn	aws	ha	894	2s	100.00%	6s	100.00%
kube-api-http2-service-network-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1064	2s	100.00%	14s	100.00%
openshift-api-http2-service-network-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1064	2s	100.00%	15s	114.29%
openshift-api-http2-service-network-reused-connections	4.22	4.22	amd64	ovn	azure	ha	758	2s	100.00%	15s	1400.00%
ci-cluster-network-liveness-new-connections	4.22		multi	ovn	aws	ha	153	0s	0.00%	8.92s	279.57%
cache-oauth-api-new-connections	4.22		amd64	ovn	aws	external	347	9.7s	0.00%	12m15.62s	171.15%
oauth-api-new-connections	4.22		amd64	ovn	aws	external	347	9.7s	0.00%	12m31.48s	175.93%
ci-cluster-network-liveness-new-connections	4.22	4.22	amd64	ovn	vsphere	ha	106	0s	0.00%	12.35s	964.66%
ci-cluster-network-liveness-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	0s	0.00%	11s	83.33%
cache-openshift-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	0s	0.00%	5s	66.67%
ingress-to-console-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	0s	0.00%	2.37s	137.00%
oauth-api-new-connections	4.22	4.22	amd64	ovn	aws	ha	894	8.35s	0.00%	45.07s	60.96%
ingress-to-oauth-server-new-connections	4.22	4.21	amd64	ovn	gcp	ha	835	1s	0.00%	2s	100.00%
kube-api-http2-internal-lb-reused-connections	4.22	4.22	amd64	ovn	azure	ha	758	1s	0.00%	2s	106.19%
azure-network-liveness-reused-connections	4.22		multi	ovn	aws	ha	153	0s	0.00%	4.48s	130.93%
service-load-balancer-with-pdb-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	0s	0.00%	1.37s	37.00%
kube-api-http2-internal-lb-new-connections	4.22	4.22	amd64	ovn	aws	ha	894	7s	0.00%	23.14s	44.62%
cache-oauth-api-reused-connections	4.22		amd64	ovn	aws	external	347	0s	0.00%	12m16.16s	172.09%
metrics-api-reused-connections	4.22		amd64	ovn	aws	ha	180	0s	0.00%	1s	47.06%
kube-api-new-connections	4.22	4.21	amd64	ovn	gcp	ha	835	1s	0.00%	2s	100.00%
image-registry-new-connections	4.22	4.21	amd64	ovn	gcp	ha	835	2s	0.00%	4s	33.33%
ci-cluster-network-liveness-reused-connections	4.22	4.22	amd64	ovn	vsphere	ha	106	0s	0.00%	950ms	691.67%
ingress-to-console-new-connections	4.22		arm64	ovn	aws	ha	132	450ms	0.00%	8.21s	1072.86%
openshift-api-reused-connections	4.22		amd64	ovn	aws	external	347	0s	0.00%	11m57.1s	147.28%
openshift-api-http2-internal-lb-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1166	0s	0.00%	58.25s	77.16%
cache-oauth-api-new-connections	4.22	4.22	amd64	ovn	aws	ha	894	0s	0.00%	23s	32.18%
cache-openshift-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1162	0s	0.00%	5s	150.00%
cache-kube-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	0s	0.00%	5s	123.21%
metrics-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1162	0s	0.00%	5s	150.00%
ingress-to-oauth-server-new-connections	4.22		arm64	ovn	aws	ha	132	450ms	0.00%	4.76s	580.00%
oauth-api-reused-connections	4.22		amd64	ovn	aws	external	347	0s	0.00%	12m31.94s	174.93%
ingress-to-console-new-connections	4.22		multi	ovn	aws	ha	153	400ms	0.00%	3.4s	240.00%
service-load-balancer-with-pdb-reused-connections	4.22	4.22	amd64	ovn	azure	ha	758	3s	0.00%	4s	34.68%
image-registry-reused-connections	4.22		arm64	ovn	aws	ha	132	0s	0.00%	7.21s	415.00%
cache-oauth-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	0s	0.00%	5s	303.23%
kube-api-http2-service-network-reused-connections	4.22	4.22	amd64	ovn	vsphere	ha	106	0s	0.00%	1s	4900.00%
ingress-to-oauth-server-new-connections	4.22		multi	ovn	aws	ha	153	400ms	0.00%	1.48s	48.00%
azure-network-liveness-reused-connections	4.22		amd64	ovn	aws	external	347	1s	0.00%	9s	50.00%
cache-openshift-api-reused-connections	4.22		amd64	ovn	aws	external	347	0s	0.00%	11m50.4s	146.31%
image-registry-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	0s	0.00%	6s	200.00%
cache-oauth-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1162	0s	0.00%	5s	400.00%
cache-oauth-api-reused-connections	4.22	4.22	amd64	ovn	azure	ha	758	1s	0.00%	2s	106.19%
host-to-service-new-connections	4.22		multi	ovn	aws	ha	153	0s	0.00%	1s	112.77%
cache-openshift-api-new-connections	4.22		amd64	ovn	aws	external	347	12.7s	0.00%	11m49.94s	145.79%
kube-api-reused-connections	4.22		amd64	ovn	aws	ha	180	0s	0.00%	1s	47.06%
cache-kube-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1162	0s	0.00%	5s	150.00%
image-registry-new-connections	4.22		multi	ovn	aws	ha	153	1s	0.00%	10.8s	634.69%
kube-api-http2-internal-lb-new-connections	4.22		ppc64le	ovn	none	ha	165	0s	0.00%	1m10.84s	285.84%
openshift-api-http2-service-network-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	5s	0.00%	8s	33.33%
pod-to-pod-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1064	0s	0.00%	2s	61.29%
ci-cluster-network-liveness-new-connections	4.22	4.22	amd64	ovn	aws	single	754	0s	0.00%	8.88s	77.60%
cache-openshift-api-new-connections	4.22	4.22	amd64	ovn	aws	ha	894	2s	0.00%	26.14s	63.38%
host-to-host-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1064	850ms	0.00%	1m38.22s	94.88%
gcp-network-liveness-new-connections	4.22	4.22	amd64	ovn	aws	single	754	8m25.15s	0.00%	25m17.47s	34.65%
openshift-api-new-connections	4.22		amd64	ovn	aws	external	347	11s	0.00%	11m54.94s	147.03%
ingress-to-console-new-connections	4.22	4.21	amd64	ovn	gcp	ha	835	1s	0.00%	2s	100.00%
openshift-api-reused-connections	4.22	4.22	amd64	ovn	aws	ha	894	9.35s	0.00%	48.07s	49.05%
host-to-service-new-connections	4.22	4.21	amd64	ovn	azure	ha	1064	1s	0.00%	2.37s	137.00%

alerts Information

There were (8212) added jobs and (4388) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 31 jobs increased and 216 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
HighOverallControlPlaneMemory openshift-machine-config-operator Warning	4.22		amd64	ovn	vsphere	ha	302	40m29.7s	255.84%	51m59.7s	177.71%
HighOverallControlPlaneMemory openshift-machine-config-operator Warning	4.22	4.22	amd64	ovn	aws	ha	298	48m42.3s	79.02%	54m45.26s	51.52%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	aws	ha	284	9m28s	175.59%	9m58s	100.67%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	aws	ha	298	4m56s	410.34%	6m56.9s	212.05%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	gcp	ha	261	2m58s	535.71%	4m38.4s	380.00%
TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning	4.22		amd64	ovn	metal	ha	365	1h53m25.2s	0.00%	2h14m42.4s	36.27%
NodeSystemSaturation openshift-monitoring Warning	4.22		amd64	ovn	vsphere	ha	302	0s	0.00%	19m23.72s	139.84%
KubeJobFailed openshift-insights Warning	4.22		amd64	ovn	vsphere	ha	302	3h20m50.3s	0.00%	6h26m52.68s	50.24%
NodeSystemSaturation openshift-monitoring Warning	4.22	4.21	amd64	ovn	aws	ha	284	2m52.8s	0.00%	3m6.34s	256.29%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22		amd64	ovn	azure	ha	199	0s	0.00%	1m28s	63.14%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22		amd64	ovn	vsphere	ha	302	3m26.5s	0.00%	9m25.7s	187.22%
AlertmanagerReceiversNotConfigured openshift-monitoring Warning	4.22		amd64	ovn	metal	two-node-fencing	184	2h3m11.2s	0.00%	2h23m7.94s	41.04%
TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning	4.22		amd64	ovn	metal	two-node-fencing	184	2h3m11.2s	0.00%	2h23m7.94s	41.04%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	azure	ha	269	0s	0.00%	1m58s	321.43%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning	4.22	4.22	amd64	ovn	gcp	ha	295	0s	0.00%	2m58s	121.83%
etcdDatabaseHighFragmentationRatio openshift-etcd Warning	4.22	4.22	amd64	ovn	gcp	ha	295	2m26s	0.00%	4m24s	593.28%
NodeSystemSaturation openshift-monitoring Warning	4.22	4.22	amd64	ovn	aws	single	241	8m28s	0.00%	46m37.2s	87.90%
KubeJobFailed openshift-insights Warning	4.22		amd64	ovn	aws	single	164	0s	0.00%	46m11.06s	1856.96%

/cc @xueqzhan, @neisw, @smg247

[openshift-ci-robot]

Pipeline controller notification
This repo is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: automatic mode

[openshift-ci-robot]

@openshift-bot: This pull request explicitly references no jira issue.

Details

In response to this:

disruptions Information

There were (422) added jobs and (408) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 721 jobs increased and 1695 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
gcp-network-liveness-new-connections	4.22	4.22	amd64	ovn	azure	ha	642	5m32.4s	83.60%	20m2.75s	482.14%
azure-network-liveness-new-connections	4.22		amd64	ovn	azure	external	721	3m28s	105.94%	14m12.8s	121.36%
azure-network-liveness-new-connections	4.21		amd64	ovn	aws	ha	171	3m48s	68.39%	21m18.4s	40.19%
gcp-network-liveness-new-connections	4.22		s390x	ovn	none	ha	143	3m4.4s	98.49%	16m34.24s	175.05%
gcp-network-liveness-new-connections	4.22		amd64	ovn	azure	external	721	2m29s	129.23%	10m29.8s	165.74%
openshift-api-http2-localhost-reused-connections	4.22		arm64	ovn	aws	ha	151	2m46s	82.42%	2m59s	75.15%
openshift-api-http2-localhost-reused-connections	4.22		amd64	ovn	aws	ha	159	2m41.4s	83.41%	2m54.42s	87.89%
openshift-api-http2-localhost-new-connections	4.22		arm64	ovn	aws	ha	151	2m38.5s	82.18%	2m50s	78.01%
gcp-network-liveness-new-connections	4.21		amd64	ovn	aws	ha	171	2m33.5s	70.94%	15m40.5s	39.64%
kube-api-http2-localhost-new-connections	4.22		amd64	ovn	aws	ha	159	2m18.4s	81.75%	2m33.42s	87.10%
kube-api-http2-localhost-reused-connections	4.22		arm64	ovn	aws	ha	151	2m18s	79.22%	2m30.5s	75.61%
kube-api-http1-localhost-new-connections	4.22		amd64	ovn	aws	ha	159	2m22.3s	74.82%	2m33.42s	74.26%
kube-api-http2-localhost-reused-connections	4.22		amd64	ovn	aws	ha	159	2m22.3s	74.82%	2m33.84s	74.74%
kube-api-http1-localhost-reused-connections	4.22		arm64	ovn	aws	ha	151	2m17.5s	78.57%	2m30s	75.03%
kube-api-http2-localhost-new-connections	4.22		arm64	ovn	aws	ha	151	2m17.5s	77.42%	2m31s	76.20%
kube-api-http1-localhost-new-connections	4.22		arm64	ovn	aws	ha	151	2m17.5s	77.42%	2m30.5s	75.61%
openshift-api-http2-localhost-new-connections	4.22		amd64	ovn	aws	ha	233	2m31s	62.72%	2m50.04s	71.69%
kube-api-http1-localhost-reused-connections	4.22		amd64	ovn	aws	ha	159	2m18.4s	72.14%	2m33.42s	74.26%
azure-network-liveness-new-connections	4.22		multi	ovn	aws	ha	165	2m36s	49.50%	22m12.84s	275.16%
gcp-network-liveness-new-connections	4.22		multi	ovn	aws	ha	165	1m34.6s	78.66%	16m6.32s	340.32%
host-to-host-new-connections	4.22	4.21	amd64	ovn	azure	ha	1030	1m23.2s	70.49%	4m45.81s	33.93%
openshift-api-http2-localhost-new-connections	4.21	4.21	amd64	ovn	azure	ha	102	1m21.85s	55.61%	1m33.94s	77.51%
kube-api-http1-localhost-new-connections	4.21	4.21	amd64	ovn	azure	ha	102	1m10s	55.90%	1m25.94s	91.06%
openshift-api-http2-localhost-new-connections	4.22	4.22	amd64	ovn	aws	ha	781	1m14s	51.33%	2m8s	161.33%
openshift-api-http2-localhost-reused-connections	4.21	4.21	amd64	ovn	aws	ha	212	1m12.9s	46.09%	2m2.9s	138.27%
kube-api-http1-localhost-new-connections	4.21	4.21	amd64	ovn	aws	ha	212	1m3s	46.34%	1m35.46s	113.99%
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	gcp	ha	949	55s	53.20%	1m2s	72.32%
kube-api-http1-localhost-reused-connections	4.22	4.22	amd64	ovn	gcp	ha	949	55s	53.20%	1m2s	72.32%
openshift-api-http2-localhost-reused-connections	4.22	4.22	amd64	ovn	gcp	ha	949	1m3s	43.34%	1m9s	56.85%
image-registry-new-connections	4.21		amd64	ovn	aws	ha	171	18.5s	1750.00%	26.8s	34.81%
kube-api-http1-localhost-new-connections	4.21	4.21	amd64	ovn	gcp	ha	190	55s	41.57%	1m0.44s	55.09%
kube-api-http2-localhost-new-connections	4.21	4.21	amd64	ovn	gcp	ha	190	55s	41.57%	1m0.44s	55.09%
azure-network-liveness-new-connections	4.21		amd64	ovn	azure	external	204	17.85s	792.50%	10m4.66s	335.13%
gcp-network-liveness-new-connections	4.21		amd64	ovn	azure	external	204	12.85s	256.94%	7m25.79s	432.48%
kube-api-http2-service-network-reused-connections	4.21	4.20	amd64	ovn	azure	ha	117	7s	258.97%	14.84s	49.15%
host-to-host-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1030	7s	250.00%	1m28.68s	75.95%
openshift-api-new-connections	4.21		amd64	ovn	aws	external	122	4.8s	3100.00%	3m34.19s	1122.55%
azure-network-liveness-new-connections	4.21		amd64	ovn	aws	external	122	4.75s	3066.67%	4m18.37s	445.31%
gcp-network-liveness-new-connections	4.21		amd64	ovn	aws	external	122	5.8s	190.00%	2m19.41s	219.75%
kube-api-new-connections	4.21		amd64	ovn	aws	external	122	3.85s	2466.67%	2m0.97s	590.47%
openshift-api-http2-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	642	4s	116.22%	6s	204.57%
image-registry-new-connections	4.22	4.22	amd64	ovn	aws	ha	781	3s	233.33%	7.2s	634.69%
kube-api-http1-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	642	4s	100.00%	7s	250.00%
pod-to-service-reused-connections	4.21	4.21	amd64	ovn	aws	single	104	5.85s	46.25%	8s	30.72%
pod-to-service-new-connections	4.21	4.21	amd64	ovn	aws	single	104	5.85s	46.25%	8s	30.72%
metrics-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	126	2.5s	150.00%	33.75s	201.88%
azure-network-liveness-reused-connections	4.21	4.21	amd64	ovn	aws	single	104	2s	100.00%	5.97s	62.23%
azure-network-liveness-reused-connections	4.22	4.22	amd64	ovn	aws	ha	781	2s	100.00%	12.2s	37.85%
kube-api-http2-internal-lb-new-connections	4.21		s390x	ovn	none	ha	118	3.7s	0.00%	1m34.39s	6192.67%
cache-oauth-api-new-connections	4.21		amd64	ovn	aws	external	122	2.95s	0.00%	3m20.34s	1043.49%
kube-api-reused-connections	4.21		ppc64le	ovn	none	ha	151	0s	0.00%	5s	2841.18%
aws-network-liveness-new-connections	4.21	4.20	amd64	ovn	gcp	ha	126	750ms	0.00%	1.75s	48.31%
kube-api-http2-localhost-new-connections	4.21		arm64	ovn	aws	ha	130	1m23.55s	0.00%	2m18.42s	59.32%
openshift-api-http2-service-network-reused-connections	4.21	4.20	amd64	ovn	gcp	ha	126	0s	0.00%	34s	60.23%
ingress-to-console-new-connections	4.21		amd64	ovn	aws	ha	171	500ms	0.00%	8.5s	750.00%
openshift-api-reused-connections	4.21	4.20	amd64	ovn	aws	ha	159	2s	0.00%	5.84s	40.38%
kube-api-http1-localhost-new-connections	4.21		arm64	ovn	aws	ha	130	1m24s	0.00%	2m18.42s	59.32%
azure-network-liveness-reused-connections	4.21	4.20	amd64	ovn	azure	ha	117	200ms	0.00%	5.68s	78.06%
openshift-api-http2-service-network-new-connections	4.21		amd64	ovn	aws	external	120	0s	0.00%	3.81s	132.32%
kube-api-http1-service-network-reused-connections	4.21	4.20	amd64	ovn	azure	ha	117	1s	0.00%	1.84s	54.62%
openshift-api-http2-localhost-new-connections	4.21		arm64	ovn	aws	ha	130	1m34.1s	0.00%	2m39.1s	61.10%
openshift-api-http2-localhost-new-connections	4.21		s390x	ovn	none	ha	118	19.15s	0.00%	7m58.34s	93692.16%
azure-network-liveness-new-connections	4.21	4.21	amd64	ovn	aws	single	104	5m31.65s	0.00%	27m43.02s	61.82%
openshift-api-http2-internal-lb-new-connections	4.21	4.20	amd64	ovn	gcp	ha	126	750ms	0.00%	36.5s	116.49%
host-to-service-new-connections	4.21		multi	ovn	aws	ha	184	0s	0.00%	1s	488.24%
cache-kube-api-new-connections	4.21	4.20	amd64	ovn	aws	ha	159	0s	0.00%	5s	762.07%
ingress-to-console-reused-connections	4.21	4.20	amd64	ovn	azure	ha	117	0s	0.00%	840ms	342.11%
kube-api-http2-internal-lb-reused-connections	4.21		amd64	ovn	aws	external	119	0s	0.00%	1s	53.85%
openshift-api-http2-service-network-new-connections	4.21	4.20	amd64	ovn	gcp	ha	126	0s	0.00%	1m9.25s	265.24%
host-to-host-new-connections	4.21		s390x	ovn	none	ha	118	1m50.25s	0.00%	1h5m4.87s	2238.25%
cache-openshift-api-new-connections	4.21		amd64	ovn	aws	external	122	2.95s	0.00%	3m34.19s	1122.55%
openshift-api-http2-service-network-reused-connections	4.21	4.21	amd64	ovn	aws	ha	212	1s	0.00%	42.68s	91.91%
cache-oauth-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	126	1s	0.00%	24.5s	72.78%
openshift-api-http2-localhost-new-connections	4.21		amd64	ovn	aws	ha	171	1m40s	0.00%	2m27.1s	52.21%
ci-cluster-network-liveness-new-connections	4.21	4.21	amd64	ovn	azure	ha	102	0s	0.00%	10.98s	41.49%
kube-api-http1-service-network-new-connections	4.21		amd64	ovn	aws	external	120	0s	0.00%	3.81s	495.31%
pod-to-pod-new-connections	4.21		s390x	ovn	none	ha	118	150ms	0.00%	11.81s	1081.00%
kube-api-http2-internal-lb-new-connections	4.21		amd64	ovn	aws	external	119	1.7s	0.00%	13.82s	30.38%
cache-oauth-api-new-connections	4.21	4.20	amd64	ovn	aws	ha	159	0s	0.00%	5s	762.07%
kube-api-http1-localhost-reused-connections	4.21		arm64	ovn	aws	ha	130	1m23.55s	0.00%	2m18.42s	59.43%
kube-api-http2-localhost-reused-connections	4.21		arm64	ovn	aws	ha	130	1m24s	0.00%	2m18.42s	59.32%
host-to-service-new-connections	4.21	4.21	amd64	ovn	aws	ha	212	1s	0.00%	9.01s	828.87%
metrics-api-new-connections	4.21	4.21	amd64	ovn	aws	ha	212	0s	0.00%	7.78s	30.76%
azure-network-liveness-reused-connections	4.21		s390x	ovn	none	ha	119	1s	0.00%	2.82s	41.00%
host-to-host-reused-connections	4.21	4.20	amd64	ovn	azure	ha	117	0s	0.00%	1m27.68s	563.24%
kube-api-http1-localhost-new-connections	4.21		amd64	ovn	aws	ha	171	1m27.5s	0.00%	2m4.7s	50.46%
aws-network-liveness-new-connections	4.21		amd64	ovn	aws	ha	171	0s	0.00%	10.6s	960.00%
oauth-api-new-connections	4.21		amd64	ovn	aws	external	122	3.9s	0.00%	3m20.97s	1047.09%
openshift-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	126	1s	0.00%	22.5s	58.67%
pod-to-service-new-connections	4.21	4.20	amd64	ovn	azure	ha	117	1s	0.00%	2.68s	168.00%
openshift-api-http2-internal-lb-new-connections	4.21		s390x	ovn	none	ha	118	9.45s	0.00%	1m47.01s	2575.25%
kube-api-http2-localhost-new-connections	4.21		amd64	ovn	aws	ha	171	1m27.5s	0.00%	2m4.7s	50.46%
pod-to-host-new-connections	4.21		s390x	ovn	none	ha	118	1m46.7s	0.00%	1h5m1.4s	7073.01%
openshift-api-http2-service-network-reused-connections	4.21	4.20	amd64	ovn	azure	ha	117	8s	0.00%	41.04s	151.32%
azure-network-liveness-reused-connections	4.21		amd64	ovn	aws	ha	171	1s	0.00%	7.2s	91.49%
host-to-pod-new-connections	4.21	4.20	amd64	ovn	azure	ha	117	0s	0.00%	840ms	342.11%
openshift-api-http2-service-network-new-connections	4.21	4.21	amd64	ovn	aws	ha	212	1.45s	0.00%	39.45s	102.20%
service-load-balancer-with-pdb-new-connections	4.21		amd64	ovn	aws	ha	171	0s	0.00%	45.4s	4440.00%
gcp-network-liveness-new-connections	4.21	4.21	amd64	ovn	aws	single	104	2m50.85s	0.00%	18m11.62s	31.95%
metrics-api-new-connections	4.21		amd64	ovn	aws	ha	171	0s	0.00%	28.3s	114.39%
host-to-pod-new-connections	4.21		s390x	ovn	none	ha	118	1s	0.00%	7.64s	664.00%
cache-openshift-api-new-connections	4.21	4.20	amd64	ovn	aws	ha	159	0s	0.00%	5s	762.07%
oauth-api-reused-connections	4.21		amd64	ovn	aws	ha	171	0s	0.00%	11.5s	1050.00%
kube-api-http2-service-network-new-connections	4.21	4.21	amd64	ovn	gcp	ha	190	0s	0.00%	1.11s	382.61%
host-to-pod-new-connections	4.21	4.21	amd64	ovn	aws	ha	212	0s	0.00%	3.89s	897.44%
kube-api-http1-localhost-reused-connections	4.21		amd64	ovn	aws	ha	171	1m27s	0.00%	2m4.7s	50.46%
kube-api-http2-localhost-reused-connections	4.21		amd64	ovn	aws	ha	171	1m27s	0.00%	2m4.7s	50.46%
host-to-service-new-connections	4.21		s390x	ovn	none	ha	118	0s	0.00%	3.49s	249.00%
ci-cluster-network-liveness-new-connections	4.21		amd64	ovn	azure	external	204	850ms	0.00%	11.97s	32.41%
kube-api-http2-internal-lb-new-connections	4.21	4.21	amd64	ovn	aws	ha	212	1s	0.00%	22.12s	148.54%
kube-api-http2-service-network-reused-connections	4.21	4.20	amd64	ovn	aws	ha	159	0s	0.00%	1s	72.41%
azure-network-liveness-new-connections	4.21	4.21	amd64	ovn	gcp	ha	190	3m48.85s	0.00%	23m23.75s	339.83%
pod-to-service-new-connections	4.21		ppc64le	ovn	none	ha	151	0s	0.00%	1.5s	782.35%
cache-kube-api-new-connections	4.21		amd64	ovn	aws	external	122	3s	0.00%	2m1.6s	594.06%
cache-openshift-api-new-connections	4.21	4.20	amd64	ovn	gcp	ha	126	1s	0.00%	18.25s	47.65%
ingress-to-oauth-server-new-connections	4.21		amd64	ovn	aws	ha	171	500ms	0.00%	3.4s	240.00%
openshift-api-http2-localhost-reused-connections	4.21		amd64	ovn	aws	ha	171	1m41.5s	0.00%	2m30.9s	57.58%
host-to-service-new-connections	4.21	4.21	amd64	ovn	aws	single	104	850ms	0.00%	1.97s	97.00%
kube-api-http1-internal-lb-new-connections	4.21		s390x	ovn	none	ha	118	4.15s	0.00%	1m31.2s	4460.00%
metrics-api-new-connections	4.21	4.20	amd64	ovn	aws	ha	159	0s	0.00%	6s	417.24%
ingress-to-oauth-server-new-connections	4.21	4.20	amd64	ovn	gcp	ha	126	1s	0.00%	4.75s	375.00%
pod-to-pod-new-connections	4.21	4.20	amd64	ovn	azure	ha	117	0s	0.00%	840ms	342.11%
openshift-api-http2-localhost-reused-connections	4.21		arm64	ovn	aws	ha	130	1m39.1s	0.00%	2m43.71s	53.60%
cache-openshift-api-reused-connections	4.22		amd64	ovn	aws	external	605	0s	0.00%	6m57.68s	44.82%
cache-oauth-api-new-connections	4.22		amd64	ovn	aws	external	605	5.8s	0.00%	11m7.32s	145.97%
kube-api-http1-localhost-reused-connections	4.22		s390x	ovn	none	ha	142	0s	0.00%	9m32.86s	221.54%
kube-api-new-connections	4.22	4.21	amd64	ovn	gcp	ha	683	1s	0.00%	3s	200.00%
ingress-to-console-new-connections	4.22	4.21	amd64	ovn	azure	ha	1030	0s	0.00%	2s	100.00%
azure-network-liveness-new-connections	4.22		amd64	ovn	aws	ha	233	9m41.6s	0.00%	27m23.32s	49.01%
kube-api-http1-internal-lb-reused-connections	4.22		s390x	ovn	none	ha	142	0s	0.00%	15.03s	96.99%
kube-api-http2-service-network-reused-connections	4.22		amd64	ovn	aws	external	605	0s	0.00%	2m22.2s	36.99%
kube-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	949	1s	0.00%	7.52s	659.60%
aws-network-liveness-new-connections	4.22		multi	ovn	aws	ha	165	0s	0.00%	7.4s	403.40%
kube-api-http2-internal-lb-new-connections	4.22		s390x	ovn	none	ha	142	0s	0.00%	9m12.23s	123.09%
service-load-balancer-with-pdb-new-connections	4.22		arm64	ovn	aws	ha	151	0s	0.00%	1.5s	50.00%
aws-network-liveness-reused-connections	4.22		multi	ovn	aws	ha	165	0s	0.00%	1s	112.77%
kube-api-reused-connections	4.22	4.22	amd64	ovn	azure	ha	642	1s	0.00%	4.59s	373.20%
kube-api-http1-service-network-new-connections	4.22		s390x	ovn	none	ha	142	0s	0.00%	7m49.24s	139.03%
azure-network-liveness-reused-connections	4.22		multi	ovn	aws	ha	165	0s	0.00%	4.36s	124.74%
cache-oauth-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1117	0s	0.00%	6s	500.00%
oauth-api-reused-connections	4.22		amd64	ovn	aws	external	605	0s	0.00%	11m13.12s	146.11%
openshift-api-new-connections	4.22		amd64	ovn	aws	external	605	9s	0.00%	7m0.16s	45.17%
kube-api-http1-internal-lb-reused-connections	4.22	4.22	multi	ovn	aws	ha	100	0s	0.00%	1s	488.24%
oauth-api-new-connections	4.22		amd64	ovn	aws	external	605	6.8s	0.00%	11m14.04s	147.50%
pod-to-host-new-connections	4.22		s390x	ovn	none	ha	142	49.6s	0.00%	2h22m42.66s	70.81%
cache-openshift-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1030	0s	0.00%	5s	66.67%
azure-network-liveness-new-connections	4.22		arm64	ovn	aws	ha	151	2m56.5s	0.00%	19m54s	159.57%
cache-openshift-api-reused-connections	4.22		amd64	ovn	azure	external	721	0s	0.00%	1s	40.85%
image-registry-new-connections	4.22		multi	ovn	aws	ha	165	0s	0.00%	3.44s	134.01%
host-to-service-new-connections	4.22	4.21	amd64	ovn	azure	ha	1030	1s	0.00%	2s	100.00%
openshift-api-http2-internal-lb-new-connections	4.22		ppc64le	ovn	none	ha	131	0s	0.00%	1m29.3s	396.11%
cache-kube-api-reused-connections	4.22		amd64	ovn	aws	ha	159	0s	0.00%	1s	47.06%
openshift-api-http2-internal-lb-reused-connections	4.22	4.22	amd64	ovn	aws	ha	781	1s	0.00%	49.8s	35.14%
ingress-to-console-new-connections	4.22		arm64	ovn	aws	ha	151	0s	0.00%	1s	42.86%
ingress-to-console-new-connections	4.22	4.22	multi	ovn	aws	ha	100	1s	0.00%	3s	50.00%
host-to-service-new-connections	4.22		multi	ovn	aws	ha	165	0s	0.00%	1s	112.77%
kube-api-http2-internal-lb-new-connections	4.22		ppc64le	ovn	none	ha	131	0s	0.00%	1m25.8s	367.32%
kube-api-reused-connections	4.22		amd64	ovn	aws	ha	159	0s	0.00%	1s	47.06%
gcp-network-liveness-new-connections	4.22		arm64	ovn	aws	ha	151	1m34s	0.00%	13m29.5s	174.87%
pod-to-pod-new-connections	4.22	4.21	amd64	ovn	azure	ha	1030	0s	0.00%	2.71s	35.50%
cache-kube-api-new-connections	4.22	4.21	amd64	ovn	gcp	ha	683	0s	0.00%	3s	50.00%
cache-kube-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1030	0s	0.00%	5s	123.21%
openshift-api-reused-connections	4.22		amd64	ovn	aws	ha	159	100ms	0.00%	1s	47.06%
azure-network-liveness-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1030	1s	0.00%	6s	50.00%
openshift-api-http2-service-network-reused-connections	4.22	4.22	multi	ovn	aws	ha	100	0s	0.00%	1.01s	494.12%
openshift-api-reused-connections	4.22		amd64	ovn	aws	external	605	0s	0.00%	6m59.6s	44.69%
pod-to-pod-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1030	0s	0.00%	2s	61.29%
oauth-api-reused-connections	4.22	4.22	amd64	ovn	azure	ha	642	2s	0.00%	5.59s	183.76%
ingress-to-oauth-server-new-connections	4.22		multi	ovn	aws	ha	165	0s	0.00%	1.36s	36.00%
kube-api-http2-internal-lb-reused-connections	4.22		amd64	ovn	aws	external	605	1s	0.00%	1m55.12s	35.37%
ingress-to-oauth-server-new-connections	4.22		arm64	ovn	aws	ha	151	0s	0.00%	1s	42.86%
cache-oauth-api-reused-connections	4.22		amd64	ovn	aws	external	605	0s	0.00%	11m8.28s	147.00%
metrics-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1117	0s	0.00%	5.84s	192.00%
gcp-network-liveness-new-connections	4.22	4.22	amd64	ovn	aws	single	649	6m32.6s	0.00%	25m37.24s	36.40%
gcp-network-liveness-new-connections	4.22	4.22	multi	ovn	aws	ha	100	1m16.4s	0.00%	6m39.53s	47.88%
cache-oauth-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1030	0s	0.00%	5s	303.23%
openshift-api-http2-localhost-reused-connections	4.22		s390x	ovn	none	ha	142	0s	0.00%	16m23.65s	195.85%
cache-kube-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1117	0s	0.00%	6s	200.00%
cache-openshift-api-new-connections	4.22		amd64	ovn	aws	external	605	11.4s	0.00%	6m58.24s	44.80%
pod-to-host-reused-connections	4.22		s390x	ovn	none	ha	142	0s	0.00%	1h2m31.53s	122.68%
metrics-api-reused-connections	4.22		amd64	ovn	aws	ha	233	0s	0.00%	1s	47.06%
cache-openshift-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1117	0s	0.00%	6s	200.00%
azure-network-liveness-reused-connections	4.22		amd64	ovn	aws	external	605	0s	0.00%	7.96s	32.67%
image-registry-reused-connections	4.22		arm64	ovn	aws	ha	151	0s	0.00%	6s	328.57%
ingress-to-oauth-server-reused-connections	4.22		ppc64le	ovn	none	ha	131	0s	0.00%	3.5s	1358.33%
host-to-host-reused-connections	4.22		s390x	ovn	none	ha	142	0s	0.00%	42m36.09s	123.68%
kube-api-http2-localhost-reused-connections	4.22		s390x	ovn	none	ha	142	0s	0.00%	7m0.46s	215.42%

alerts Information

There were (9318) added jobs and (2878) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 59 jobs increased and 489 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
CannotRetrieveUpdates openshift-cluster-version Warning	4.21		amd64	ovn	metal	ha	126	1h22m32s	5691.81%	1h47m24.5s	4281.03%
TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning	4.22		amd64	ovn	metal	ha	265	2h24m22.4s	59.38%	2h46m24.4s	68.34%
HighOverallControlPlaneMemory openshift-machine-config-operator Warning	4.22		amd64	ovn	vsphere	ha	237	26m23.2s	131.87%	37m53.68s	102.40%
HighOverallControlPlaneMemory openshift-machine-config-operator Warning	4.21		amd64	ovn	vsphere	ha	125	17m55.2s	95.78%	38m45.84s	47.95%
etcdGRPCReadRequestsSlow openshift-etcd Critical	4.22	4.22	amd64	ovn	azure	ha	151	13m11s	78.96%	21m25s	72.90%
etcdGRPCWriteRequestsSlow openshift-etcd Critical	4.22	4.22	amd64	ovn	azure	ha	151	6m28s	646.15%	11m43s	82.31%
NodeSystemSaturation openshift-monitoring Warning	4.22	4.22	amd64	ovn	gcp	ha	275	6m6.4s	423.43%	21m5.52s	78.34%
NodeSystemSaturation openshift-monitoring Warning	4.22	4.21	amd64	ovn	gcp	ha	139	5m19s	289.02%	20m31s	58.23%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	aws	ha	173	1m56s	100.00%	4m52.64s	119.04%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	gcp	ha	275	58s	107.14%	4m26.52s	44.28%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	gcp	ha	139	28s	0.00%	3m33.96s	268.90%
etcdDatabaseHighFragmentationRatio openshift-etcd Warning	4.22	4.22	amd64	ovn	gcp	ha	275	0s	0.00%	2m20.36s	268.59%
KubeJobFailed openshift-insights Warning	4.22		amd64	ovn	aws	single	112	4m59.7s	0.00%	2h14m9.78s	5584.87%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	gcp	ha	139	1m3.8s	0.00%	7m53.04s	75.41%
etcdGRPCRequestsSlow openshift-etcd Critical	4.22	4.21	amd64	ovn	azure	ha	261	0s	0.00%	3m52s	150.00%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	azure	ha	151	0s	0.00%	43s	53.57%

/cc @xueqzhan, @neisw, @smg247

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: openshift-bot
Once this PR has been reviewed and has the lgtm label, please assign dgoodwin for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[coderabbitai]

Important

Review skipped

Review was skipped as selected files did not have any reviewable changes.

💤 Files selected but had no reviewable changes (2)

• pkg/monitortestlibrary/allowedalerts/query_results.json
• pkg/monitortestlibrary/allowedbackenddisruption/query_results.json

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 74e345df-1823-407f-a1e7-05a481c6409b

📥 Commits

Reviewing files that changed from the base of the PR and between 85dec4b and 00d7e3d.

📒 Files selected for processing (2)

• pkg/monitortestlibrary/allowedalerts/query_results.json
• pkg/monitortestlibrary/allowedbackenddisruption/query_results.json

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[openshift-ci-robot]

Scheduling required tests:
/test e2e-aws-csi
/test e2e-aws-ovn-fips
/test e2e-aws-ovn-microshift
/test e2e-aws-ovn-microshift-serial
/test e2e-aws-ovn-serial-1of2
/test e2e-aws-ovn-serial-2of2
/test e2e-gcp-csi
/test e2e-gcp-ovn
/test e2e-gcp-ovn-upgrade
/test e2e-metal-ipi-ovn-ipv6
/test e2e-vsphere-ovn
/test e2e-vsphere-ovn-upi

[openshift-ci-robot]

@openshift-bot: This pull request explicitly references no jira issue.

Details

In response to this:

disruptions Information

There were (1090) added jobs and (524) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 358 jobs increased and 1006 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
gcp-network-liveness-new-connections	4.22		amd64	ovn	aws	ha	230	4m38s	1363.16%	20m24.95s	897.84%
azure-network-liveness-new-connections	4.22		s390x	ovn	none	ha	146	5m10s	284.62%	23m25.75s	171.29%
gcp-network-liveness-new-connections	4.22		multi	ovn	aws	ha	160	2m45.25s	212.09%	16m9.42s	341.73%
azure-network-liveness-new-connections	4.22		multi	ovn	aws	ha	160	3m32.05s	103.21%	22m15.04s	275.78%
gcp-network-liveness-new-connections	4.22		arm64	ovn	aws	ha	139	3m10.9s	115.71%	15m26.26s	214.52%
gcp-network-liveness-new-connections	4.22		s390x	ovn	none	ha	146	2m58.75s	92.41%	16m33.4s	174.81%
openshift-api-http2-localhost-reused-connections	4.22		arm64	ovn	aws	ha	139	2m49.1s	85.82%	2m59s	75.15%
openshift-api-http2-localhost-new-connections	4.22		arm64	ovn	aws	ha	139	2m41s	85.06%	2m50.24s	78.26%
azure-network-liveness-new-connections	4.22		amd64	ovn	azure	external	534	2m50.75s	69.06%	14m32.67s	126.51%
azure-network-liveness-new-connections	4.22		arm64	ovn	aws	ha	139	3m41.3s	44.64%	22m23.28s	192.02%
openshift-api-http2-localhost-new-connections	4.22		amd64	ovn	aws	ha	174	2m39.7s	72.09%	2m51s	72.66%
openshift-api-http2-localhost-reused-connections	4.22		amd64	ovn	aws	ha	230	2m34.55s	75.62%	2m52.26s	85.57%
kube-api-http2-localhost-reused-connections	4.22		arm64	ovn	aws	ha	139	2m22.1s	84.55%	2m30.86s	76.03%
kube-api-http1-localhost-reused-connections	4.22		arm64	ovn	aws	ha	139	2m22.1s	84.55%	2m30.48s	75.59%
kube-api-http2-localhost-new-connections	4.22		arm64	ovn	aws	ha	139	2m22.1s	83.35%	2m31.24s	76.48%
kube-api-http1-localhost-new-connections	4.22		arm64	ovn	aws	ha	139	2m22.1s	83.35%	2m30.86s	76.03%
kube-api-http2-localhost-reused-connections	4.22		amd64	ovn	aws	ha	174	2m19.4s	71.25%	2m33.54s	74.40%
kube-api-http1-localhost-reused-connections	4.22		amd64	ovn	aws	ha	174	2m16.7s	70.02%	2m33.27s	74.09%
kube-api-http2-localhost-new-connections	4.22		amd64	ovn	aws	ha	230	2m9.65s	70.26%	2m30.13s	83.09%
kube-api-http1-localhost-new-connections	4.22		amd64	ovn	aws	ha	230	2m9.65s	59.28%	2m30.13s	70.52%
gcp-network-liveness-new-connections	4.22		amd64	ovn	azure	external	534	1m39.25s	52.69%	10m58.75s	177.95%
openshift-api-http2-localhost-new-connections	4.22	4.22	amd64	ovn	aws	ha	746	1m15s	53.37%	2m9.75s	164.90%
kube-api-http1-localhost-reused-connections	4.22	4.22	amd64	ovn	gcp	ha	1067	58s	61.56%	1m4.34s	78.82%
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	azure	ha	626	1m19s	38.35%	1m29s	53.93%
host-to-host-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	1m10.2s	43.85%	4m43.72s	32.95%
kube-api-http1-localhost-new-connections	4.22	4.22	amd64	ovn	aws	ha	746	1m4s	46.12%	1m26.55s	96.88%
kube-api-http2-localhost-reused-connections	4.22	4.22	amd64	ovn	aws	ha	746	1m2s	41.55%	1m21s	84.26%
openshift-api-http2-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	626	5s	170.27%	7s	255.33%
kube-api-http2-service-network-new-connections	4.22	4.22	amd64	ovn	azure	ha	626	6s	100.00%	7s	40.00%
image-registry-new-connections	4.22	4.22	amd64	ovn	aws	ha	746	3s	233.33%	6.55s	568.37%
ingress-to-console-new-connections	4.22	4.22	amd64	ovn	aws	ha	746	3s	233.33%	5s	410.20%
host-to-host-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1049	4s	100.00%	1m39.12s	96.67%
pod-to-host-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1049	4s	100.00%	1m25.84s	84.68%
azure-network-liveness-reused-connections	4.22	4.22	amd64	ovn	azure	ha	626	2s	135.29%	9.75s	905.15%
kube-api-http2-service-network-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1049	2s	100.00%	14s	100.00%
openshift-api-http2-service-network-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1049	2s	100.00%	14.52s	107.43%
cache-openshift-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1138	0s	0.00%	6s	200.00%
cache-openshift-api-new-connections	4.22		amd64	ovn	aws	external	435	12.3s	0.00%	9m50.3s	104.37%
image-registry-reused-connections	4.22		arm64	ovn	aws	ha	139	0s	0.00%	6.96s	397.14%
openshift-api-new-connections	4.22		amd64	ovn	aws	external	435	11s	0.00%	9m54.28s	105.33%
oauth-api-new-connections	4.22		amd64	ovn	aws	external	435	9s	0.00%	12m4.94s	166.19%
ingress-to-console-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	4.56s	356.00%
ingress-to-oauth-server-reused-connections	4.22		ppc64le	ovn	none	ha	138	0s	0.00%	3.15s	1212.50%
aws-network-liveness-new-connections	4.22		multi	ovn	aws	ha	160	0s	0.00%	2s	36.05%
azure-network-liveness-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1049	1s	0.00%	5.52s	38.00%
ingress-to-console-new-connections	4.22		arm64	ovn	aws	ha	139	0s	0.00%	7.2s	928.57%
azure-network-liveness-reused-connections	4.22	4.21	amd64	ovn	gcp	ha	666	1s	0.00%	5.35s	33.75%
cache-oauth-api-new-connections	4.22		amd64	ovn	aws	external	435	9s	0.00%	11m55.3s	163.66%
cache-oauth-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	5s	303.23%
azure-network-liveness-reused-connections	4.22		multi	ovn	aws	ha	160	0s	0.00%	4.41s	127.32%
image-registry-new-connections	4.22	4.21	amd64	ovn	gcp	ha	666	2s	0.00%	4s	33.33%
image-registry-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	5s	150.00%
gcp-network-liveness-new-connections	4.22	4.22	amd64	ovn	aws	single	619	12m33.6s	0.00%	25m48.34s	37.39%
kube-api-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1067	1s	0.00%	6s	506.06%
host-to-pod-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	3.52s	57.14%
ingress-to-oauth-server-new-connections	4.22		multi	ovn	aws	ha	160	50ms	0.00%	1.41s	41.00%
metrics-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1138	0s	0.00%	6s	200.00%
oauth-api-reused-connections	4.22		amd64	ovn	aws	external	435	0s	0.00%	12m5.26s	165.18%
host-to-service-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	1s	0.00%	3s	200.00%
cache-oauth-api-reused-connections	4.22		amd64	ovn	aws	external	435	0s	0.00%	11m55.64s	164.50%
oauth-api-reused-connections	4.22		amd64	ovn	aws	ha	174	0s	0.00%	1s	47.06%
oauth-api-reused-connections	4.22	4.22	amd64	ovn	azure	ha	626	1s	0.00%	3.75s	90.36%
ci-cluster-network-liveness-new-connections	4.22		multi	ovn	aws	ha	160	0s	0.00%	8.64s	267.66%
azure-network-liveness-new-connections	4.22		amd64	ovn	aws	ha	230	7m0.2s	0.00%	27m26.29s	49.27%
kube-api-new-connections	4.22	4.21	amd64	ovn	gcp	ha	666	1s	0.00%	3s	200.00%
cache-kube-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	5s	123.21%
host-to-service-new-connections	4.22		multi	ovn	aws	ha	160	0s	0.00%	1s	112.77%
azure-network-liveness-reused-connections	4.22		amd64	ovn	aws	external	435	0s	0.00%	8.66s	44.33%
azure-network-liveness-reused-connections	4.22	4.22	amd64	ovn	gcp	ha	1067	0s	0.00%	1.34s	31.37%
cache-kube-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1138	0s	0.00%	6s	200.00%
metrics-api-reused-connections	4.22		amd64	ovn	aws	ha	174	0s	0.00%	1s	47.06%
cache-openshift-api-reused-connections	4.22		amd64	ovn	aws	external	435	0s	0.00%	9m50.96s	104.90%
kube-api-http2-internal-lb-reused-connections	4.22	4.22	amd64	ovn	azure	ha	626	1s	0.00%	2s	106.19%
service-load-balancer-with-pdb-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	2s	100.00%
cache-openshift-api-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	5s	66.67%
pod-to-service-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	1s	0.00%	1.52s	52.00%
cache-oauth-api-new-connections	4.22	4.21	amd64	ovn	aws	ha	1138	0s	0.00%	6s	500.00%
openshift-api-reused-connections	4.22		amd64	ovn	aws	external	435	0s	0.00%	9m54.28s	104.92%
openshift-api-http2-internal-lb-new-connections	4.22	4.22	amd64	ovn	gcp	ha	1067	0s	0.00%	1m58.68s	260.95%
ingress-to-console-new-connections	4.22		multi	ovn	aws	ha	160	1s	0.00%	3.05s	205.00%
ci-cluster-network-liveness-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	9.56s	59.33%
openshift-api-http2-service-network-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	5s	0.00%	8s	33.33%
pod-to-pod-reused-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	2s	61.29%
image-registry-new-connections	4.22		multi	ovn	aws	ha	160	1s	0.00%	10.1s	587.07%
kube-api-http2-service-network-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	5s	0.00%	7s	40.00%
ingress-to-oauth-server-new-connections	4.22		arm64	ovn	aws	ha	139	0s	0.00%	4.1s	485.71%
cache-oauth-api-reused-connections	4.22	4.22	amd64	ovn	azure	ha	626	1s	0.00%	2s	106.19%
pod-to-pod-new-connections	4.22	4.21	amd64	ovn	azure	ha	1049	0s	0.00%	4s	100.00%

alerts Information

There were (5954) added jobs and (3284) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 42 jobs increased and 194 jobs decreased.

Click To Show Table

Name	Release	From	Arch	Network	Platform	Topology	Job Results	P95	P95 % Increase	P99	P99 % Increase
HighOverallControlPlaneMemory openshift-machine-config-operator Warning	4.22		amd64	ovn	vsphere	ha	259	34m42.4s	204.98%	48m51.52s	160.96%
NodeSystemSaturation openshift-monitoring Warning	4.22		arm64	ovn	aws	ha	130	22m58s	831.08%	27m28s	206.32%
HighOverallControlPlaneMemory openshift-machine-config-operator Warning	4.22	4.22	amd64	ovn	aws	ha	230	47m34.1s	74.84%	51m16.78s	41.91%
NodeSystemSaturation openshift-monitoring Warning	4.22	4.22	amd64	ovn	aws	ha	230	25m17.8s	410.01%	29m30.26s	83.77%
etcdGRPCReadRequestsSlow openshift-etcd Critical	4.22	4.22	amd64	ovn	azure	ha	204	14m51.5s	101.70%	27m18.66s	120.49%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	aws	ha	288	9m28s	175.59%	10m28s	110.74%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	aws	ha	230	5m11.4s	436.90%	6m28s	190.42%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	gcp	ha	195	1m58s	321.43%	3m57.92s	310.21%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	gcp	ha	288	1m58s	321.43%	4m28s	45.08%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	gcp	ha	288	1m58s	321.43%	11m1.64s	62.81%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.21	amd64	ovn	gcp	ha	195	2m26.6s	152.76%	10m4.8s	124.27%
NodeSystemSaturation openshift-monitoring Warning	4.22	4.22	amd64	ovn	aws	single	186	13m5s	0.00%	33m1.4s	33.10%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning	4.22		arm64	ovn	aws	ha	130	28s	0.00%	3m29.9s	424.75%
KubeJobFailed openshift-insights Warning	4.22		amd64	ovn	gcp	ha	195	3h3m19.2s	0.00%	6h21m27s	36.76%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22		amd64	ovn	aws	ha	410	28s	0.00%	14m7.1s	253.43%
KubeJobFailed openshift-insights Warning	4.22		amd64	ovn	aws	single	134	0s	0.00%	11m43.64s	396.92%
NodeSystemSaturation openshift-monitoring Warning	4.22	4.21	amd64	ovn	aws	ha	288	2m39.7s	0.00%	3m31.9s	305.16%
etcdDatabaseHighFragmentationRatio openshift-etcd Warning	4.22	4.22	amd64	ovn	gcp	ha	288	0s	0.00%	1m31.64s	140.65%
KubeJobFailed openshift-insights Warning	4.22		amd64	ovn	vsphere	ha	259	3h40m45s	0.00%	9h58m32.28s	132.43%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22	4.22	amd64	ovn	azure	ha	204	0s	0.00%	1m27.1s	211.07%
NodeSystemSaturation openshift-monitoring Warning	4.22		amd64	ovn	aws	single	134	11m6.5s	0.00%	19m56s	31.46%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning	4.22		amd64	ovn	azure	ha	176	35.5s	0.00%	2m20.5s	160.47%
AlertmanagerReceiversNotConfigured openshift-monitoring Warning	4.22		amd64	ovn	aws	external	223	1h29m43.6s	0.00%	2h32m33.64s	39.46%
TechPreviewNoUpgrade openshift-kube-apiserver-operator Warning	4.22		amd64	ovn	metal	ha	301	1h53m16s	0.00%	2h19m28s	41.08%

/cc @xueqzhan, @neisw, @smg247

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-ci]

@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-metal-ipi-ovn-ipv6	46cb411	link	true	/test e2e-metal-ipi-ovn-ipv6
ci/prow/unit	00d7e3d	link	true	/test unit

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.