Fix WebMCP tool references and document MiMo/Luna retest - #8
Merged
Merged
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem and change
Models sometimes copy the catalog digest into a WebMCP tool revision or miscopy frame/document identifiers, causing avoidable rejected calls and recovery loops. Discovery now returns session-local
toolRefhandles; the browser plugin resolves each handle to the exact discovered identity and schema before dispatch.References expire on tab/document/frame/version/schema changes. Legacy identity calls remain strictly validated. Errors distinguish
not_dispatchedfrom an unknown execution outcome and provide recovery guidance; uncertain actions are never automatically replayed. All runtime changes are in the Cordis browser plugin; upstream Harness and Jev changes are excluded.Benchmark evidence
Retested six error-heavy WebMCP ON cases with MiMo V2.6 Flash and GPT-5.6 Luna, three attempts per case/model. All 36 formal attempts passed. Old baseline is one attempt per case; these tasks previously passed after tool failures, so this measures efficiency, not an increase in task success rate.
This is a selected historical comparison, not a full-suite or contemporaneous A/B claim. Auth-boundary exploration regresses in steps/cost; Luna is also slower on auth-boundary and course enrollment. The report preserves these counterexamples and documents nine excluded MiMo configuration-calibration attempts and three Luna scoring-auth failures replaced by a complete three-attempt rerun. All 48 recorded attempts are included in the usage ledger. Luna costs are API-equivalent estimates, not subscription charges.
The committed report and sanitized per-attempt data include usage, rates, exclusions, operation-evidence checks, source hashes and raw-report hashes. Raw transcripts and credentials are not published. Paid benchmarks ran on the recorded working-tree snapshot before this PR was assembled; the seven code/test/doc files were copied unchanged onto current main.
Validation
On this isolated PR branch:
Before PR isolation, the source workspace also passed
pnpm check,pnpm build, and the full test suite withNODE_OPTIONS=--no-webstorage(needed for Node 25's localStorage behavior). These full-workspace checks were not rerun on the isolated PR branch.