OCPBUGS-83585: Skip e2e jobs for test/envtest-only changes in hypershift by jparrill · Pull Request #77954 · openshift/release

jparrill · 2026-04-17T10:38:10Z

Summary

Add test/envtest to the skip_if_only_changed and pipeline_skip_if_only_changed patterns in hypershift CI configs (main and release-4.22)
Changes limited to test/envtest/ will no longer trigger expensive e2e jobs (AWS, AKS, Azure, KubeVirt, etc.) or security scans
Regenerated Prow jobs via make jobs

Test plan

Verify CI jobs pass on this PR
Create a test PR on hypershift that only modifies files in test/envtest/ and confirm e2e jobs are skipped

🤖 Generated with Claude Code

Summary by CodeRabbit

Chores
- Updated CI/CD pipeline configuration to optimize test execution by skipping unnecessary test runs when only test-related internal paths are modified.

Add test/envtest to the skip_if_only_changed and pipeline_skip_if_only_changed patterns so that changes limited to test/envtest/ no longer trigger expensive e2e jobs in CI. Signed-off-by: Juan Manuel Parrilla Madrid <jparrill@redhat.com> Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> Signed-off-by: Juan Manuel Parrilla Madrid <jparrill@redhat.com>

openshift-ci-robot · 2026-04-17T10:38:17Z

@jparrill: This pull request references Jira Issue OCPBUGS-83585, which is invalid:

expected the bug to be in one of the following states: NEW, ASSIGNED, POST, but it is MODIFIED instead

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

Details

In response to this:

Summary

Add test/envtest to the skip_if_only_changed and pipeline_skip_if_only_changed patterns in hypershift CI configs (main and release-4.22)

Changes limited to test/envtest/ will no longer trigger expensive e2e jobs (AWS, AKS, Azure, KubeVirt, etc.) or security scans

Regenerated Prow jobs via make jobs

Test plan

Verify CI jobs pass on this PR

Create a test PR on hypershift that only modifies files in test/envtest/ and confirm e2e jobs are skipped

🤖 Generated with Claude Code

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

coderabbitai · 2026-04-17T10:38:46Z

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Repository: openshift/coderabbit/.coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: 41f69cfa-0f97-4782-89f0-8b9949d82514

📥 Commits

Reviewing files that changed from the base of the PR and between 3f85ef2 and 1a97d06.

📒 Files selected for processing (4)

ci-operator/config/openshift/hypershift/openshift-hypershift-main.yaml
ci-operator/config/openshift/hypershift/openshift-hypershift-release-4.22.yaml
ci-operator/jobs/openshift/hypershift/openshift-hypershift-main-presubmits.yaml
ci-operator/jobs/openshift/hypershift/openshift-hypershift-release-4.22-presubmits.yaml

Walkthrough

Extended pipeline_skip_if_only_changed and skip_if_only_changed regex patterns across four CI job configuration files to include test/envtest as a skippable path. Updates affect job definitions for multiple e2e and security tests in both main and release 4.22 branches.

Changes

Cohort / File(s)	Summary
CI Config Files `ci-operator/config/openshift/hypershift/openshift-hypershift-main.yaml`, `ci-operator/config/openshift/hypershift/openshift-hypershift-release-4.22.yaml`	Extended `pipeline_skip_if_only_changed` and `skip_if_only_changed` regex patterns to include `test/envtest/` as a skippable-only-change path for e2e and security test jobs.
CI Presubmit Jobs `ci-operator/jobs/openshift/hypershift/openshift-hypershift-main-presubmits.yaml`, `ci-operator/jobs/openshift/hypershift/openshift-hypershift-release-4.22-presubmits.yaml`	Extended `pipeline_skip_if_only_changed` and `skip_if_only_changed` regex patterns to include `test/envtest` as a skippable path in presubmit job definitions.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~8 minutes

Important

Pre-merge checks failed

Please resolve all errors before merging. Addressing warnings is optional.

❌ Failed checks (1 inconclusive)

Check name	Status	Explanation	Resolution
Ote Binary Stdout Contract	❓ Inconclusive	The shell commands provided search for specific hypershift configuration files but no actual command output or verification results are shown.	Execute the provided shell scripts to verify presence of the specified PR configuration files and obtain their details for validation.

✅ Passed checks (9 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title clearly and specifically describes the main change: adding test/envtest to skip patterns for e2e jobs in hypershift CI configs, which directly matches the file modifications across all four YAML configuration files.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Stable And Deterministic Test Names	✅ Passed	PR modifies YAML CI configuration files, not Ginkgo test files, so the test naming stability check is not applicable.
Test Structure And Quality	✅ Passed	PR exclusively modifies CI operator configuration YAML files with no Ginkgo test files present, making the custom check inapplicable.
Microshift Test Compatibility	✅ Passed	This PR modifies only CI/CD configuration files in openshift/release repository, updating skip patterns for e2e jobs. No new Ginkgo tests or test code is being introduced.
Single Node Openshift (Sno) Test Compatibility	✅ Passed	PR modifies only CI configuration YAML files; no new Ginkgo e2e test files are introduced.
Topology-Aware Scheduling Compatibility	✅ Passed	The PR modifies only Prow CI configuration files to adjust job skip patterns. No deployment manifests, operator code, scheduling constraints, or topology-related workload specifications are introduced.
Ipv6 And Disconnected Network Test Compatibility	✅ Passed	This PR only modifies CI operator configuration YAML files that define Prow job skip patterns. No new Ginkgo e2e test code with IPv4 assumptions or external connectivity requirements is added.

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

openshift-merge-bot · 2026-04-17T10:41:19Z

[REHEARSALNOTIFIER]
@jparrill: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name	Repo	Type	Reason
pull-ci-openshift-hypershift-main-e2e-aks	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-main-e2e-aws	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-main-e2e-aws-upgrade-hypershift-operator	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-main-e2e-azure-self-managed	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-main-e2e-kubevirt-aws-ovn-reduced	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-main-e2e-v2-aws	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-main-security	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-release-4.22-e2e-aks	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-release-4.22-e2e-aws	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-release-4.22-e2e-aws-upgrade-hypershift-operator	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-release-4.22-e2e-azure-self-managed	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-release-4.22-e2e-kubevirt-aws-ovn-reduced	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-release-4.22-e2e-v2-aws	openshift/hypershift	presubmit	Ci-operator config changed
pull-ci-openshift-hypershift-release-4.22-security	openshift/hypershift	presubmit	Ci-operator config changed

Prior to this PR being merged, you will need to either run and acknowledge or opt to skip these rehearsals.

Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse list to get an up-to-date list of affected jobs
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

openshift-ci · 2026-04-17T10:47:01Z

@jparrill: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

enxebre · 2026-04-17T11:03:36Z

/lgtm

openshift-ci · 2026-04-17T11:07:01Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: enxebre, jparrill

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

~~ci-operator/config/openshift/hypershift/OWNERS~~ [enxebre,jparrill]
~~ci-operator/jobs/openshift/hypershift/OWNERS~~ [enxebre,jparrill]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

jparrill · 2026-04-17T12:00:08Z

/jira refresh

openshift-ci-robot · 2026-04-17T12:00:12Z

@jparrill: This pull request references Jira Issue OCPBUGS-83585, which is invalid:

expected the bug to be in one of the following states: NEW, ASSIGNED, POST, but it is MODIFIED instead

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

Details

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

jparrill · 2026-04-17T12:01:14Z

/jira refresh

openshift-ci-robot · 2026-04-17T12:01:20Z

@jparrill: This pull request references Jira Issue OCPBUGS-83585, which is valid.

3 validation(s) were run on this bug

bug is open, matching expected state (open)
bug target version (5.0.0) matches configured target version for branch (5.0.0)
bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

Details

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

jparrill · 2026-04-17T12:02:11Z

/pj-rehearse ack

openshift-merge-bot · 2026-04-17T12:02:15Z

@jparrill: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

openshift-ci-robot · 2026-04-17T13:01:04Z

@jparrill: Jira Issue OCPBUGS-83585: All pull requests linked via external trackers have merged:

Jira Issue OCPBUGS-83585 has been moved to the MODIFIED state.

Details

In response to this:

Summary

Add test/envtest to the skip_if_only_changed and pipeline_skip_if_only_changed patterns in hypershift CI configs (main and release-4.22)

Changes limited to test/envtest/ will no longer trigger expensive e2e jobs (AWS, AKS, Azure, KubeVirt, etc.) or security scans

Regenerated Prow jobs via make jobs

Test plan

Verify CI jobs pass on this PR

Create a test PR on hypershift that only modifies files in test/envtest/ and confirm e2e jobs are skipped

🤖 Generated with Claude Code

Summary by CodeRabbit

Chores

Updated CI/CD pipeline configuration to optimize test execution by skipping unnecessary test runs when only test-related internal paths are modified.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

…ift (openshift#77954) Add test/envtest to the skip_if_only_changed and pipeline_skip_if_only_changed patterns so that changes limited to test/envtest/ no longer trigger expensive e2e jobs in CI. Signed-off-by: Juan Manuel Parrilla Madrid <jparrill@redhat.com> Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

openshift-ci-robot added jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Apr 17, 2026

openshift-ci Bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 17, 2026

openshift-ci Bot requested review from bryan-cox and enxebre April 17, 2026 10:38

openshift-ci Bot assigned enxebre Apr 17, 2026

openshift-ci Bot added the lgtm Indicates that a PR is ready to be merged. label Apr 17, 2026

openshift-ci-robot added jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. and removed jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Apr 17, 2026

openshift-merge-bot Bot added the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label Apr 17, 2026

openshift-merge-bot Bot merged commit 791fe43 into openshift:main Apr 17, 2026
16 checks passed

Uh oh!

Conversation

jparrill commented Apr 17, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test plan

Summary by CodeRabbit

Uh oh!

openshift-ci-robot commented Apr 17, 2026

Summary

Test plan

Uh oh!

coderabbitai Bot commented Apr 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Walkthrough

Changes

Estimated code review effort

Pre-merge checks failed

❌ Failed checks (1 inconclusive)

Uh oh!

openshift-merge-bot Bot commented Apr 17, 2026

Uh oh!

openshift-ci Bot commented Apr 17, 2026

Uh oh!

enxebre commented Apr 17, 2026

Uh oh!

openshift-ci Bot commented Apr 17, 2026

Uh oh!

jparrill commented Apr 17, 2026

Uh oh!

openshift-ci-robot commented Apr 17, 2026

Uh oh!

jparrill commented Apr 17, 2026

Uh oh!

openshift-ci-robot commented Apr 17, 2026

Uh oh!

jparrill commented Apr 17, 2026

Uh oh!

openshift-merge-bot Bot commented Apr 17, 2026

Uh oh!

Uh oh!

openshift-ci-robot commented Apr 17, 2026

Summary

Test plan

Summary by CodeRabbit

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

jparrill commented Apr 17, 2026 •

edited by coderabbitai Bot

Loading

coderabbitai Bot commented Apr 17, 2026 •

edited

Loading