USHIFT-6175: Ginkgo releases tests are failing in CI by agullon · Pull Request #5518 · openshift/microshift

agullon · 2025-09-24T12:56:58Z

Filter out Ginkgo disruptive tests adding ~Disruptive filter
Add global timeout for all the Ginkgo tests suite
Use 'does_commit_exist()' instead of 'does_image_exist()' in rpm-ostree
Use make all instead of make build command to update ginkgo repo to the latest version
Clone specific commit from openshift-test-private repo to secure successful execution of test
- This commit id must be updated every few days/weeks to be in sync with latest changes
- I'll propose a follow up change to automate or improve this proccess

… RF test

openshift-ci-robot · 2025-09-24T12:57:02Z

@agullon: This pull request references USHIFT-6175 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the bug to target the "4.21.0" version, but no target version was set.

Details

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot · 2025-09-24T12:59:20Z

@agullon: This pull request references USHIFT-6175 which is a valid jira issue.

Details

In response to this:

Filter out Ginkgo disruptive tests adding ~Disruptive filter

Add global timeout for all the Ginkgo tests suite

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

agullon · 2025-09-24T12:59:33Z

/retest

agullon · 2025-09-24T13:07:24Z

/retest

agullon · 2025-09-24T13:47:25Z

/retest

kasturinarra · 2025-09-24T13:56:56Z

test/bin/scenario.sh

+    fi
+
+    # Run the tests and capture output with 10m timeout for every test case
+    if ! "${timeout_ginkgo}" run --timeout 10m --junit-dir="${test_results_dir}" -f "${case_selected}" 2>&1 | tee "${test_results_dir}/test-output.log"; then


Is not 10m too less ?

for every test case, I think is more than enough. For example, on Jenkins, for release-4.20 branch 59 tests take less than 23 mins to run.

test/bin/scenario.sh

agullon · 2025-09-24T14:24:58Z

/retest

agullon · 2025-09-24T14:50:20Z

/retest

agullon · 2025-09-24T15:17:12Z

/restest

agullon · 2025-09-24T15:28:42Z

/retest

agullon · 2025-09-24T15:35:22Z

/retest-required

agullon · 2025-09-24T16:07:00Z

/retest-required

kasturinarra · 2025-09-24T18:05:26Z

/lgtm
From the code perspective.

agullon · 2025-09-24T19:14:09Z

/retest-required

test/bin/scenario.sh

test/scenarios-bootc/releases/el96-lrel@ginkgo-tests.sh

pacevedom · 2025-09-25T11:58:19Z

/test e2e-aws-tests-arm

agullon · 2025-09-30T08:19:15Z

/retest-required

agullon · 2025-09-30T08:41:03Z

/retest

agullon · 2025-09-30T08:53:02Z

/restes-required

agullon · 2025-09-30T09:19:50Z

/restest-required

agullon · 2025-09-30T09:43:32Z

/retest

agullon · 2025-09-30T10:00:58Z

/retest

agullon · 2025-09-30T10:17:09Z

/retest

agullon · 2025-09-30T10:30:00Z

/retest

openshift-ci-robot · 2025-09-30T13:43:16Z

@agullon: This pull request references USHIFT-6175 which is a valid jira issue.

Details

In response to this:

Filter out Ginkgo disruptive tests adding ~Disruptive filter

Add global timeout for all the Ginkgo tests suite

Use 'does_commit_exist()' instead of 'does_image_exist()' in rpm-ostree

Use make all instead of make build command to update ginkgo repo to the latest version

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

kasturinarra · 2025-09-30T14:58:37Z

/lgtm

agullon · 2025-09-30T15:53:46Z

/test e2e-aws-tests-bootc-release-arm

…test-private repos are not in sync

agullon · 2025-10-01T10:56:35Z

/retest-required

agullon · 2025-10-01T12:50:39Z

/test e2e-aws-tests-bootc-release

openshift-ci-robot · 2025-10-01T12:53:41Z

@agullon: This pull request references USHIFT-6175 which is a valid jira issue.

Details

In response to this:

Filter out Ginkgo disruptive tests adding ~Disruptive filter

Add global timeout for all the Ginkgo tests suite

Use 'does_commit_exist()' instead of 'does_image_exist()' in rpm-ostree

Use make all instead of make build command to update ginkgo repo to the latest version

Clone specific commit from openshift-test-private repo to secure successful execution of test

This commit id must be updated every few days/weeks to be in sync with latest changes

I'll propose a follow up change to automate or improve this proccess

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci · 2025-10-01T14:14:59Z

@agullon: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

kasturinarra · 2025-10-01T17:17:56Z

/lgtm

openshift-ci · 2025-10-01T17:19:27Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: agullon, kasturinarra

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

~~OWNERS~~ [agullon,kasturinarra]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

agullon · 2025-10-01T17:35:24Z

/verify by CI

agullon · 2025-10-01T19:00:23Z

/verified by CI

openshift-ci-robot · 2025-10-01T19:00:35Z

@agullon: This PR has been marked as verified by CI.

Details

In response to this:

/verified by CI

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

USHIFT-6175: Ginkgo releases tests are failing in CI (cherry picked from commit 527f77d)

agullon added 3 commits September 22, 2025 11:31

reenable again "Router Verify Access Logging Configuration Container"…

5130c46

… RF test

filter out Disruptive Ginkgo tests

b2db105

add timeout for the Ginkgo test suite

f1dc659

openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Sep 24, 2025

openshift-ci bot requested review from ggiguash and jerpeter1 September 24, 2025 12:57

openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 24, 2025

kasturinarra reviewed Sep 24, 2025

View reviewed changes

test/bin/scenario.sh Show resolved Hide resolved

openshift-ci bot assigned kasturinarra Sep 24, 2025

openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Sep 24, 2025

need to scape tilde char

432db32

openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Sep 25, 2025

kasturinarra reviewed Sep 25, 2025

View reviewed changes

test/bin/scenario.sh Show resolved Hide resolved

kasturinarra reviewed Sep 25, 2025

View reviewed changes

test/scenarios-bootc/releases/el96-lrel@ginkgo-tests.sh Show resolved Hide resolved

fix ginkgo timeout path

5c2a644

agullon added 2 commits September 30, 2025 12:21

small fixes to gettool_ginkgo()

1793cf8

use make all instead of make build to update before building

dfb32f6

openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Sep 30, 2025

set specific commit to avoid errors because microshift and openshift-…

2aab4c9

…test-private repos are not in sync

openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Oct 1, 2025

openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Oct 1, 2025

openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Oct 1, 2025

openshift-merge-bot bot merged commit 527f77d into openshift:main Oct 1, 2025
17 checks passed

agullon pushed a commit to agullon/microshift that referenced this pull request Oct 2, 2025

Merge pull request openshift#5518 from agullon/USHIFT-6175

2ded5c7

USHIFT-6175: Ginkgo releases tests are failing in CI (cherry picked from commit 527f77d)

agullon mentioned this pull request Oct 2, 2025

[release-4.20] NO-ISSUE: bulk backport tests changes from main #5548

Merged

Conversation

agullon commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci-robot commented Sep 24, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci-robot commented Sep 24, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

kasturinarra Sep 24, 2025

Choose a reason for hiding this comment

Uh oh!

agullon Sep 24, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

kasturinarra commented Sep 24, 2025

Uh oh!

agullon commented Sep 24, 2025

Uh oh!

Uh oh!

Uh oh!

pacevedom commented Sep 25, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

openshift-ci-robot commented Sep 30, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

kasturinarra commented Sep 30, 2025

Uh oh!

agullon commented Sep 30, 2025

Uh oh!

agullon commented Oct 1, 2025

Uh oh!

agullon commented Oct 1, 2025

Uh oh!

openshift-ci-robot commented Oct 1, 2025 • edited by openshift-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci bot commented Oct 1, 2025

Uh oh!

kasturinarra commented Oct 1, 2025

Uh oh!

openshift-ci bot commented Oct 1, 2025

Uh oh!

agullon commented Oct 1, 2025

agullon commented Sep 24, 2025 •

edited

Loading

openshift-ci-robot commented Sep 24, 2025 •

edited by openshift-ci bot

Loading

openshift-ci-robot commented Sep 24, 2025 •

edited by openshift-ci bot

Loading

openshift-ci-robot commented Sep 30, 2025 •

edited by openshift-ci bot

Loading

openshift-ci-robot commented Oct 1, 2025 •

edited by openshift-ci bot

Loading