Skip to content

ROX-30354: Configure cypress ocp min version#18737

Draft
dvail wants to merge 1 commit intomasterfrom
dv/30354-configure-cypress-ocp-min-version
Draft

ROX-30354: Configure cypress ocp min version#18737
dvail wants to merge 1 commit intomasterfrom
dv/30354-configure-cypress-ocp-min-version

Conversation

@dvail
Copy link
Contributor

@dvail dvail commented Jan 28, 2026 •
edited
Loading

Description

Blocked until we find a solution for #16698

Runs Cypress e2e tests against the console plugin immediately after running e2e tests for the standalone UI. The script is designed to:

  1. Skip plugin e2e tests if we are not on OpenShift
  2. Skip plugin e2e tests if we determine we are on OpenShift version < 4.19

A note on 2 above - rather than skip unless we are on >= 4.19, we are detecting if the version is too low and skipping. This will give us false positive test runs rather than false negative. The impact of the two scenarios is:

  1. If version detection fails or is incorrect, we will run the e2e tests, which most likely fail. In this case, we get notice, and fix the edge cases.
  2. If version detection fails or is incorrect, and we do not run tests unless we detect >= 4.19, then tests will be skipped silently for versions of OpenShift that we must support.

Approach confirmed with automation team: https://redhat-internal.slack.com/archives/CC5UHD0KA/p1769783633309749

User-facing documentation

Testing and quality

  • the change is production ready: the change is GA, or otherwise the functionality is gated by a feature flag
  • CI results are inspected

Automated testing

  • added unit tests
  • added e2e tests
  • added regression tests
  • added compatibility tests
  • modified existing tests

How I validated my change

Run tests against a GKE cluster:

  • Standalone e2e tests run and pass.
  • Plugin tests are skipped with ORCHESTRATOR_FLAVOR is not 'openshift', skipping cypress-ocp tests

Run tests against OpenShift 4.12

  • Stanadlone e2e tests run and pass.
  • Plugin tests are skipped with OpenShift 4.12 < 4.19, skipping cypress-ocp tests

Run tests against OpenShift 4.20 (TBD)

@openshift-ci
Copy link

openshift-ci bot commented Jan 28, 2026

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@dvail
Copy link
Contributor Author

dvail commented Jan 28, 2026

/test ocp-4-20-ui-e2e-tests

@openshift-ci
Copy link

openshift-ci bot commented Jan 28, 2026

@dvail: No presubmit jobs available for stackrox/stackrox@vb/ocp-plugin-helm-test

Details

In response to this:

/test ocp-4-20-ui-e2e-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@dvail dvail changed the base branch from vb/ocp-plugin-helm-test to master January 28, 2026 18:31
@dvail
Copy link
Contributor Author

dvail commented Jan 28, 2026

/test ocp-4-20-ui-e2e-tests

@dvail
Copy link
Contributor Author

dvail commented Jan 28, 2026

/test gke-ui-e2e-tests

@dvail
Copy link
Contributor Author

dvail commented Jan 28, 2026

/test ocp-4-12-ui-e2e-tests

@rhacs-bot
Copy link
Contributor

rhacs-bot commented Jan 28, 2026 •
edited
Loading

Images are ready for the commit at 9455a07.

To use with deploy scripts, first export MAIN_IMAGE_TAG=4.11.x-15-g9455a07d19.

@codecov
Copy link

codecov bot commented Jan 28, 2026 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 49.38%. Comparing base (dbb1204) to head (9455a07).
⚠️ Report is 5 commits behind head on master.

Additional details and impacted files 
@@           Coverage Diff           @@
##           master   #18737   +/-   ##
=======================================
  Coverage   49.38%   49.38%           
=======================================
  Files        2659     2659           
  Lines      200712   200722   +10     
=======================================
+ Hits        99129    99134    +5     
- Misses      94145    94149    +4     
- Partials     7438     7439    +1
Flag Coverage Δ
go-unit-tests 49.38% <ø> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@dvail
Copy link
Contributor Author

dvail commented Jan 29, 2026

/test ocp-4-12-ui-e2e-tests

@dvail
Copy link
Contributor Author

dvail commented Jan 29, 2026

/test ocp-4-20-ui-e2e-tests

@dvail dvail force-pushed the dv/30354-configure-cypress-ocp-min-version branch from b89a34d to 59e4aab Compare January 29, 2026 18:08
@dvail
Copy link
Contributor Author

dvail commented Jan 29, 2026

/test ocp-4-20-ui-e2e-tests

@dvail
Copy link
Contributor Author

dvail commented Jan 29, 2026

/test ocp-4-12-ui-e2e-tests

1 similar comment
@dvail
Copy link
Contributor Author

dvail commented Jan 30, 2026

/test ocp-4-12-ui-e2e-tests

@dvail dvail force-pushed the dv/30354-configure-cypress-ocp-min-version branch from 59e4aab to 8c66091 Compare February 2, 2026 14:52
@dvail
Copy link
Contributor Author

dvail commented Feb 2, 2026

/test ocp-4-20-ui-e2e-tests

@dvail
Copy link
Contributor Author

dvail commented Feb 2, 2026

/test ocp-4-12-ui-e2e-tests

@dvail
Copy link
Contributor Author

dvail commented Feb 2, 2026

/test gke-ui-e2e-tests

@dvail dvail force-pushed the dv/30354-configure-cypress-ocp-min-version branch from 8c66091 to 9455a07 Compare February 2, 2026 18:06
@dvail
Copy link
Contributor Author

dvail commented Feb 2, 2026

/test ocp-4-20-ui-e2e-tests

@openshift-ci
Copy link

openshift-ci bot commented Feb 2, 2026

@dvail: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/ocp-4-20-ui-e2e-tests 9455a07 link false /test ocp-4-20-ui-e2e-tests

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

area/ui do-not-merge/work-in-progress

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@dvail @rhacs-bot