feat: add run-e2e-test shared skill for interactive e2e test replay#10143
Merged
nilo19 merged 3 commits intokubernetes-sigs:masterfrom Apr 10, 2026
Merged
feat: add run-e2e-test shared skill for interactive e2e test replay#10143nilo19 merged 3 commits intokubernetes-sigs:masterfrom
nilo19 merged 3 commits intokubernetes-sigs:masterfrom
Conversation
Add a new shared skill that parses Go e2e test files from tests/e2e/, translates each step to kubectl and az CLI commands, and interactively replays the test against a live Kubernetes+Azure cluster. The skill includes: - analyze_test.py: Ginkgo test parser that extracts Describe/When/ Context/It/BeforeEach/AfterEach structure into a structured replay plan with kubectl and az CLI equivalents - check_context.py: displays current kube context and Azure subscription for user confirmation before execution - patterns.md: comprehensive reference mapping Go e2e test patterns to CLI commands with manifest templates and polling patterns - INDEX.md: generated keyword index for token-efficient partial reads of patterns.md - gen_patterns_index.py: generator script to keep INDEX.md line numbers in sync with patterns.md /kind feature
k8s-ci-robot
added
kind/feature
Contributor
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: nilo19 The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
k8s-ci-robot
added
the
approved
github-actions
Bot
added
the
tide/merge-method-squash
k8s-ci-robot
added
size/XXL
Contributor
Author
|
Part of #10054 |
Liunardy
reviewed
Apr 10, 2026
Comment on lines
+8
to
+13
| ## When To Use | ||
|
|
||
| Use this skill when the user wants to manually replay a cloud-provider-azure e2e | ||
| test case against a live Kubernetes cluster. The skill parses the Go test source, | ||
| translates each step to CLI commands (`kubectl` / `az`), and guides interactive | ||
| execution. |
Contributor
There was a problem hiding this comment.
Should put the when to use in description. https://agentskills.io/specification#description-field
Contributor
Author
There was a problem hiding this comment.
added, as well as other skills.
Update the run-e2e-test skill description to include activation
triggers ("Use when...") per the Agent Skills specification. Enrich
authoring.md with a new Description Field section documenting the
spec requirements: what-it-does + when-to-use structure, keyword
guidance, progressive disclosure token budgets, and examples. Update
the skill template placeholder to prompt for triggers.
Reference: https://agentskills.io/specification#description-field
Add "Use when..." activation triggers to the description field of all five existing skills per the Agent Skills specification guidance added in the previous commit. This helps agents match user requests to the correct skill at startup. Skills updated: cherry-pick-pr, create-release-tags, create-release-note-doc-pr, release, fix-image-cves.
This was referenced Apr 10, 2026
nilo19
added a commit
to nilo19/cloud-provider-azure
that referenced
this pull request
Apr 10, 2026
feat: add run-e2e-test shared skill for interactive e2e test replay
nilo19
added a commit
to nilo19/cloud-provider-azure
that referenced
this pull request
Apr 10, 2026
feat: add run-e2e-test shared skill for interactive e2e test replay
nilo19
added a commit
to nilo19/cloud-provider-azure
that referenced
this pull request
Apr 10, 2026
feat: add run-e2e-test shared skill for interactive e2e test replay
nilo19
added a commit
to nilo19/cloud-provider-azure
that referenced
this pull request
Apr 10, 2026
feat: add run-e2e-test shared skill for interactive e2e test replay
nilo19
added a commit
that referenced
this pull request
Apr 10, 2026
feat: add run-e2e-test shared skill for interactive e2e test replay
nilo19
added a commit
that referenced
this pull request
Apr 10, 2026
feat: add run-e2e-test shared skill for interactive e2e test replay
nilo19
added a commit
that referenced
this pull request
Apr 10, 2026
feat: add run-e2e-test shared skill for interactive e2e test replay
nilo19
added a commit
that referenced
this pull request
Apr 10, 2026
feat: add run-e2e-test shared skill for interactive e2e test replay
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What type of PR is this?
/kind feature
What this PR does / why we need it:
Adds a new shared skill under
.agents/skills/run-e2e-test/that enables AI agents to interactively replay cloud-provider-azure e2e tests against a live cluster usingkubectlandazCLI commands.The skill workflow:
Key features:
analyze_test.py— regex-based Go test parser that translates SDK calls to CLI equivalents; handles nested Describe blocks, When/Context scoping, and annotation resolution via a static map of 30+ Azure service annotationscheck_context.py— displays current kube context + Azure subscription for user confirmationpatterns.md— comprehensive CLI command reference (396 lines) with manifest templates, polling patterns, and verification commandsINDEX.md— generated keyword index for token-efficient partial reads of patterns.mdgen_patterns_index.py— keeps INDEX.md line numbers in sync with patterns.mdValidated against all 12 e2e test files in
tests/e2e/(network, node, auth, autoscaling).Which issue(s) this PR fixes:
NONE
Special notes for your reviewer:
analyze_test.pyparser uses regex-based pattern matching (not a full Go parser). It handles the standard Ginkgo patterns used in this repo but may need manual interpretation for unusual test structures.sed(no GNUgrep -oP) for macOS compatibility.INDEX.mdis generated — runpython3 scripts/gen_patterns_index.pyafter editingpatterns.mdto keep line numbers in sync.Does this PR introduce a user-facing change?
Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.: