ROX-29840: Add Cypress configuration to run tests against OCP console by dvail · Pull Request #16203 · stackrox/stackrox

dvail · 2025-07-29T19:05:35Z

Description

Add Cypress configuration to run tests against OCP console.

OCP Plugin specific tests reside under cypress/integration-ocp
Test artifacts, videos, etc are stored in a subfolder artifacts/ocp-console-plugin

Note that running these tests is currently disabled in CI via the Makefile, as plugin e2e tests will not succeed until the plugin is deployed along with the ACS installation in CI.

Non-UI work courtesy of @davdhacs 🙏

User-facing documentation

CHANGELOG.md is updated OR update is not needed
documentation PR is created and is linked above OR is not needed

Testing and quality

the change is production ready: the change is GA, or otherwise the functionality is gated by a feature flag
CI results are inspected

Automated testing

How I validated my change

Validate artifacts exist and smoke test successfully authenticates with the console:

https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/stackrox_stackrox/16203/pull-ci-stackrox-stackrox-master-ocp-4-19-ui-e2e-tests/1958230648233660416/artifacts/ui-e2e-tests/stackrox-stackrox-e2e-test/artifacts/

dvail · 2025-07-29T19:05:37Z

This change is part of the following stack:

ROX-29844: Add configuration of base URL in plugin requests #16097
- ROX-29840: Add Cypress configuration to run tests against OCP console #16203 ◀

_{Change managed by git-spice.}

openshift-ci · 2025-07-29T19:05:40Z

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

dvail · 2025-07-29T19:06:20Z

/test ocp-4-19-ui-e2e-tests

openshift-ci · 2025-07-29T19:06:24Z

@dvail: No presubmit jobs available for stackrox/stackrox@dv/ROX-29844-add-configuration-of-base-url-and-e2e-requests

Details

In response to this:

/test ocp-4-19-ui-e2e-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

dvail · 2025-07-29T19:09:02Z

/test ocp-4-18-ui-e2e-tests

openshift-ci · 2025-07-29T19:09:07Z

@dvail: No presubmit jobs available for stackrox/stackrox@dv/ROX-29844-add-configuration-of-base-url-and-e2e-requests

Details

In response to this:

/test ocp-4-18-ui-e2e-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

dvail · 2025-07-29T19:09:58Z

/test ocp-4-19-ui-e2e-tests

rhacs-bot · 2025-07-29T19:25:03Z

Images are ready for the commit at 34c6769.

To use with deploy scripts, first export MAIN_IMAGE_TAG=4.9.x-642-g34c67693a7.

codecov · 2025-07-29T19:36:56Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 49.08%. Comparing base (7ae2bca) to head (34c6769).
⚠️ Report is 27 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #16203      +/-   ##
==========================================
- Coverage   49.09%   49.08%   -0.01%     
==========================================
  Files        2649     2649              
  Lines      196680   196680              
==========================================
- Hits        96551    96546       -5     
- Misses      92572    92576       +4     
- Partials     7557     7558       +1

Flag	Coverage Δ
go-unit-tests	`49.08% <ø> (-0.01%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

dvail · 2025-07-29T21:23:32Z

/test ocp-4-19-ui-e2e-tests

openshift-ci · 2025-07-29T21:23:35Z

@dvail: No presubmit jobs available for stackrox/stackrox@dv/ROX-29844-add-configuration-of-base-url-and-e2e-requests

Details

In response to this:

/test ocp-4-19-ui-e2e-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

dvail · 2025-07-29T21:32:12Z

/test ocp-4-19-ui-e2e-tests

dvail · 2025-07-30T11:33:39Z

/test ocp-4-19-ui-e2e-tests

dvail · 2025-07-30T13:41:23Z

/test ocp-4-19-ui-e2e-tests

dvail · 2025-07-30T15:42:35Z

/test ocp-4-19-ui-e2e-tests

tests/e2e/lib.sh

dvail · 2025-08-04T20:53:20Z

/test ocp-4-19-ui-e2e-tests

dvail · 2025-08-05T11:24:03Z

/test ocp-4-19-ui-e2e-tests

dvail · 2025-08-05T12:46:26Z

/test ocp-4-19-ui-e2e-tests

ui/apps/platform/cypress.config.js

Co-authored-by: David Vail <dcvail17@gmail.com>

… console (#16203)" This reverts commit 87b258a.

openshift-ci bot added the do-not-merge/work-in-progress label Jul 29, 2025

github-actions bot added the area/ui label Jul 29, 2025

dvail changed the base branch from dv/ROX-29844-add-configuration-of-base-url-and-e2e-requests to master July 29, 2025 19:09

dvail changed the base branch from master to dv/ROX-29844-add-configuration-of-base-url-and-e2e-requests July 29, 2025 21:23

dvail changed the base branch from dv/ROX-29844-add-configuration-of-base-url-and-e2e-requests to master July 29, 2025 21:32

dvail changed the base branch from master to dv/ROX-29844-add-configuration-of-base-url-and-e2e-requests July 30, 2025 11:33

dvail changed the base branch from dv/ROX-29844-add-configuration-of-base-url-and-e2e-requests to master July 30, 2025 11:33

dvail commented Jul 30, 2025

View reviewed changes

tests/e2e/lib.sh Outdated Show resolved Hide resolved

dvail commented Jul 30, 2025

View reviewed changes

tests/e2e/lib.sh Outdated Show resolved Hide resolved

dvail force-pushed the dv/ROX-29840-base-config-for-cypress-e2e-test-ocp branch from e422e4d to fdd5aaa Compare August 4, 2025 19:57

github-actions bot added the area/ci label Aug 4, 2025

dvail force-pushed the dv/ROX-29840-base-config-for-cypress-e2e-test-ocp branch from fdd5aaa to ab62f56 Compare August 5, 2025 11:23

dvail force-pushed the dv/ROX-29840-base-config-for-cypress-e2e-test-ocp branch from 994d667 to f7696fd Compare August 26, 2025 20:21

dvail added the ai-assisted label Aug 26, 2025

dvail force-pushed the dv/ROX-29840-base-config-for-cypress-e2e-test-ocp branch from c052742 to 2642c64 Compare August 28, 2025 13:57

dvail commented Aug 29, 2025

View reviewed changes

ui/apps/platform/cypress.config.js Show resolved Hide resolved

dvail commented Aug 29, 2025

View reviewed changes

ui/apps/platform/cypress.config.js Show resolved Hide resolved

dvail and others added 20 commits August 29, 2025 15:54

Add Cypress configuration to run tests against OCP console

e418085

(WIP) debug in ci

36fe0cf

Test ci_export

9716fea

Export when the vars is in scope, perhaps

e26dc08

Lets try this again, but for jobs that do not start with "osd"

2c21313

One more time with feeling

30a7e9a

More debug

e3789aa

More debug

db5e038

Update dispatch.sh

d44c45a

ROX-29840: access ocp console (#16436)

bf69407

Co-authored-by: David Vail <dcvail17@gmail.com>

Fix artifact output for OCP tests

309beaf

A couple other clean up items

bf94174

fix spec

55dd0d8

More tweaks

8fc9942

Cleanup

9c8fa37

Docs

ab2fdf7

Fix misnamed var

94ac189

Move non-openshift skip earlier in cypress entry script

4523d6c

Disable automatic run of OCP tests

d4c9a20

Revert unneeded markdown changes

34c6769

dvail force-pushed the dv/ROX-29840-base-config-for-cypress-e2e-test-ocp branch from 2642c64 to 34c6769 Compare August 29, 2025 19:57

pedrottimark approved these changes Aug 29, 2025

View reviewed changes

dvail merged commit 87b258a into master Sep 2, 2025
144 of 172 checks passed

dvail deleted the dv/ROX-29840-base-config-for-cypress-e2e-test-ocp branch September 2, 2025 11:40

kylape added a commit that referenced this pull request Sep 7, 2025

Revert "ROX-29840: Add Cypress configuration to run tests against OCP…

936feca

… console (#16203)" This reverts commit 87b258a.

Conversation

dvail commented Jul 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

User-facing documentation

Testing and quality

Automated testing

How I validated my change

Uh oh!

dvail commented Jul 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

openshift-ci bot commented Jul 29, 2025

Uh oh!

dvail commented Jul 29, 2025

Uh oh!

openshift-ci bot commented Jul 29, 2025

Uh oh!

dvail commented Jul 29, 2025

Uh oh!

openshift-ci bot commented Jul 29, 2025

Uh oh!

dvail commented Jul 29, 2025

Uh oh!

rhacs-bot commented Jul 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codecov bot commented Jul 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

dvail commented Jul 29, 2025

Uh oh!

openshift-ci bot commented Jul 29, 2025

Uh oh!

dvail commented Jul 29, 2025

Uh oh!

dvail commented Jul 30, 2025

Uh oh!

dvail commented Jul 30, 2025

Uh oh!

dvail commented Jul 30, 2025

Uh oh!

Uh oh!

Uh oh!

dvail commented Aug 4, 2025

Uh oh!

dvail commented Aug 5, 2025

Uh oh!

dvail commented Aug 5, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

dvail commented Jul 29, 2025 •

edited

Loading

dvail commented Jul 29, 2025 •

edited

Loading

rhacs-bot commented Jul 29, 2025 •

edited

Loading

codecov bot commented Jul 29, 2025 •

edited

Loading