Skip to content

feat: add test-placement skill for the plugin testing strategy (v0.7.0)#58

Open
gustavolira wants to merge 3 commits into
redhat-developer:mainfrom
gustavolira:feat/test-placement-skill
Open

feat: add test-placement skill for the plugin testing strategy (v0.7.0)#58
gustavolira wants to merge 3 commits into
redhat-developer:mainfrom
gustavolira:feat/test-placement-skill

Conversation

@gustavolira

Copy link
Copy Markdown
Member

Summary

Adds a test-placement skill (skills/test-placement/): when a developer asks "where should I test this?", the assistant gathers the context and proposes the right repo (rhdh-plugins / rhdh-plugin-export-overlays / rhdh), the right test layer (L1 unit → L4b cluster e2e), the location, and how to scaffold the test.

It encodes the per-repository testing responsibility split consolidated on epic RHIDP-13501: artifact bugs → overlays native smoke (merged in overlays#2714 — install from OCI + startTestBackend boot, workspace mode, bundle presence) · source bugs → the plugin's source repo · integration/UI-render bugs → the rhdh cluster-free harness (merged in rhdh#5005) · platform bugs → cluster e2e. Guiding rule: the cheapest environment that catches the bug wins. Includes the researched dead-ends (catalog-extending modules in minimal startTestBackend, local-path artifacts, standalone Scalprum host) so devs don't burn time on them.

Why here

Per review feedback on overlays#2726: the skill covers the entire RHDH ecosystem (three repos, five test layers), not any single repo — exactly what this centralized repo exists to hold. Supersedes and replaces the three per-repo sibling PRs:

Compared to those PRs, the References section was refreshed: overlays#2714 and rhdh#5005 have since merged.

Changes

  • New skill: skills/test-placement/SKILL.md (content-only, no scripts)
  • README: new "Test Placement" section
  • Orchestrator (skills/rhdh/SKILL.md): new "Test Placement Routes" entry
  • Version bump 0.6.10.7.0 (new skill = minor), in sync across pyproject.toml, plugin.json, marketplace.json

Related

Epic RHIDP-13501 · overlays#2714 · rhdh#5005 · rhdh#5044 (layer matrix) · rhdh#4967 (catalog-index sanity)

🤖 Generated with Claude Code

Centralizes the test-placement skill here instead of duplicating it
across rhdh, rhdh-plugins, and rhdh-plugin-export-overlays
(supersedes overlays#2726, rhdh#5045, plugins#3670).

Given a change, bug, or feature in the RHDH dynamic-plugin ecosystem,
the skill proposes the right repo, the right test layer (L1 unit to
L4b cluster e2e), the location, and how to scaffold the test. Encodes
the RHIDP-13501 per-repo responsibility split and researched dead-ends.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Comment thread skills/rhdh/SKILL.md Outdated
Comment thread skills/test-placement/SKILL.md
Comment thread skills/test-placement/SKILL.md Outdated
Comment thread skills/test-placement/SKILL.md Outdated
Comment thread skills/test-placement/SKILL.md Outdated
Comment thread README.md
gustavolira and others added 2 commits July 7, 2026 10:59
- Quote literal trigger phrases in the frontmatter description,
  matching the nfs-migration/backstage-upgrade convention
- Add test-placement to the orchestrator intake menu (item 10) and
  skills_index; renumber release/general items and routes
- Cross-reference skills/rhdh/references/rhdh-repos.md with the
  standalone-install caveat (backstage-upgrade pattern)
- Drop the layer-matrix URL that 404s until rhdh#5044 merges; keep
  the repo path + PR reference
- Remove the hardcoded date from the References header
- Add parametrized frontmatter validation for every skills/*/SKILL.md
  (name matches directory, description within spec limits)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
… merged

The cluster-free harness expansion (10 specs / 14 test cases) and the
native-smoke workspace mode both merged on 2026-07-07; the References
section now cites them so the decision-table capabilities stay backed by
merged PRs.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant