Skip to content

plan(seed): Fable 5 long-range remediation roadmap (planning-only, drafts) - #1347

Merged
rickylabs merged 17 commits into
mainfrom
plan/fable5-remediation-roadmap
Aug 8, 2026
Merged

plan(seed): Fable 5 long-range remediation roadmap (planning-only, drafts)#1347
rickylabs merged 17 commits into
mainfrom
plan/fable5-remediation-roadmap

Conversation

@rickylabs

@rickylabs rickylabs commented Aug 8, 2026

Copy link
Copy Markdown
Owner

Summary

Planning-only seed run that produced and then, after explicit owner ratification, filed the complete long-range NetScript remediation roadmap: master plan with a 12-fork owner sweep, milestone train, 41 issues, two RFC entry points, existing-owner amendments, Wave-7 measured-adoption design, implementation handoff, and a cited research corpus.

GitHub is now authoritative. This draft PR preserves the planning rationale and filing receipts; it must not be merged.

Scope

  • Archetype / area: docs and run artifacts only (.llm/runs/plan-fable5-remediation-roadmap--seed/)
  • Seed run per .llm/harness/workflow/seed-run.md; profile SCOPE-docs
  • No product/framework source touched

Slices

  • S1 Bootstrap — run dir, supervisor identity, owner eval waivers, draft PR
  • S2 Discovery corpus — prior waves, live board, repo/docs audit, external bar
  • S3 Synthesis — gap taxonomy, adjudications, T1–T8 packs, train direction
  • S4 Design packs — 41 issue drafts, RFC-A/RFC-B, amendments, dedup table
  • S5 Plan lock — master plan, implementation handoff, run close
  • S6 Stage-H filing — milestone insertion, 41 live issues, dependency and amendment reconciliation

Stage H — owner-ratified filing

Full durable receipt: fable-5-remediation-plan/FILING-LOG.md at commit 1ef78e29f.

Validation and harness

  • Docs/run-artifact-only PR: ci:skip-e2e + ci:skip-scaffold intentionally applied.
  • Baseline at plan lock: origin/main @ fac9e339042c.
  • PLAN-EVAL and IMPL-EVAL were owner-waived for this planning/filing run. The waiver does not extend to implementation.
  • Workflows: wf_e2194004-808, wf_03b88126-e7e, wf_ebfe8327-306; 25 Opus 5 contributors, 0 workflow errors.

Do not merge: this draft PR is the durable planning record. The owner-ratified board filing is complete and GitHub issues are authoritative.

🤖 Generated with Claude Code

Run dir + supervisor identity, owner eval waivers (PLAN-EVAL/IMPL-EVAL),
lane overrides (Fable 5 high orchestrator, Opus 5 workflow contributors),
drafts-only mutation boundary.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@rickylabs rickylabs added area:docs type:docs ci:skip-e2e status:research Harness research phase ci:skip-scaffold Skip the scaffold-static (deno-only) scaffold gate labels Aug 8, 2026
@rickylabs

Copy link
Copy Markdown
Owner Author

[PHASE: RESEARCH] — Stage A charter read-back (seed run plan-fable5-remediation-roadmap--seed)

Charter. Planning-only seed run: long-range NetScript remediation roadmap as drafts under .llm/runs/plan-fable5-remediation-roadmap--seed/fable-5-remediation-plan/. Supervisor: Claude Fable 5 · high (owner override of planning_decisions low), native Anthropic subscription, bypassPermissions, Remote Control enabled. Claude Workflows with Opus 5 subagents serve as research/synthesis contributors only.

Owner waivers (recorded in supervisor.md / worklog.md / drift.md): PLAN-EVAL waived; IMPL-EVAL waived. No formal evaluator, OpenHands, or OpenRouter session will be launched. Owner personally reviews the plan and decides on later adversarial passes / board filing.

Mutation boundary. Zero GitHub board mutation (issues/epics/milestones/labels/comments outside this PR). No framework/product source edits. Writable surfaces: this branch, its commits, this draft PR (body/comments/PR labels). Filing (stage H) is explicitly out of scope.

CI lane. ci:skip-e2e + ci:skip-scaffold applied intentionally: the entire diff is run-artifact/docs under .llm/runs/; scaffold-static and e2e are not applicable. ci:full remains the escape hatch if that ever changes (it will not — no code paths in scope).

Evidence inputs. (1) Codex pre-plan package (README / ISSUE-DEDUP-MATRIX / EVIDENCE-REGISTER); (2) all agent-posts waves (archive + waves 3–6); (3) live GitHub board (wins over carried-in reports); (4) deep repo + published-docs audit; (5) eis-chat + competing meta-frameworks + oRPC; (6) 0.0.5 milestone/orchestrator history.

Baseline. origin/main @ fac9e339042c — verified equal to HEAD at run start; will re-fetch read-only before plan lock.

Next: Stage B discovery corpus (S2).

rickylabs and others added 3 commits August 8, 2026 11:37
Two read-only Opus-subagent research workflows (prior waves + live board;
repo/docs domain audit + external comparisons), per seed-run Tier-C rule.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
… Stage-B fan-out

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…ound truth

Seven Opus-5 research artifacts (3.8k lines): waves 1-6 evidence, exhaustive
open-board snapshot (259 issues/13 milestones), 0.0.5 orchestration history,
live conventions incl. label/milestone/RFC practice. Supervisor-reviewed.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@rickylabs

Copy link
Copy Markdown
Owner Author

[PHASE: RESEARCH] — S2a landed: prior-wave evidence + live board ground truth (d5b984044)

Workflow wf_e2194004-808 (7 Opus 5 subagents, 796k tokens, read-only) produced fable-5-remediation-plan/research/: prior-waves-early.md, wave-4.md, wave-5-6-plans.md, wave-6-runs.md, github-board-open.md (exhaustive 259-issue/13-milestone snapshot), github-board-history.md (0.0.5 train + orchestration plans v2/v3), github-conventions.md (live label/milestone/issue-form/RFC practice). Supervisor substantively reviewed all seven before this sign-off commit.

Load-bearing corrections vs the carried-in pre-plan (current GitHub wins):

Note: this commit also carried the first 8 domain files under research/repo-audit/ written by the still-running second workflow (wf_03b88126-e7e); their supervisor review lands with S2b.

Next: S2b — repo/docs domain audit + external comparisons (eis-chat, meta-frameworks, oRPC).

…ternal bar

Eleven Opus-5 artifacts (5.2k lines): docs/MCP/CLI/web/SDK/auth/runtime/
observability/scaffold-doctrine audits with execution-verified defect
verdicts, plus eis-chat teardown, meta-framework competitive bar, oRPC
extension-model deep dive. Supervisor-reviewed (see worklog S2b note).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@rickylabs

Copy link
Copy Markdown
Owner Author

[PHASE: RESEARCH] — S2b landed: repo/docs domain audit + external bar (e0d3c3883); Stage B complete

Workflow wf_03b88126-e7e (11 Opus 5 subagents, 1.78M tokens, 905 tool calls, read-only) delivered research/repo-audit/ (8 domains) + research/external/ (eis-chat, meta-frameworks, oRPC). Several verdicts are execution-verified (#1249 reproduced byte-identical; isDefinedErrornever proven by executed deno check; registry 66-vs-50 counted by deno eval). Supervisor reviewed all 11 before this sign-off commit.

Highest-leverage findings:

Next: Stage C synthesis (SYNTHESIS.md) → Stage D design packs.

rickylabs and others added 5 commits August 8, 2026 12:05
…cks, train direction

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…afts)

Two-milestone insertion via house rename pattern; complete per-issue move
ledger; entry/exit criteria; thin Wave-7 A/B/C measured smoke matrix.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
… amendments

Three milestone directories (0.0.6 verification/docs/RFCs; 0.0.7 typed
seams+generation; 0.0.8 runtime truth+service slice), 929-line amendments
file, dedup table + Stage-E ledger. Supervisor-reviewed; six corpus
corrections recorded.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@rickylabs

Copy link
Copy Markdown
Owner Author

[PHASE: PLAN] — S4 landed: design packs (33adc65d7); Stage D complete

Workflow wf_ebfe8327-306 (7 Opus 5 subagents, 1.25M tokens) + supervisor additions delivered the full draft board:

Quality note: every pack re-verified corpus claims at source before drafting, producing six corrections now recorded in the dedup §3.1 — most notably the wave-6 ServiceReferences claim has worktree counter-evidence (T4-07 drafted verify-first, not as implementation), and arch:check:repo's 7-week accepted-red decomposes into 52 A14 false positives + one missing --root (two cheap fixes, not package debt). Supervisor reviewed all packs before sign-off; deviations (TA-03 a/b/c split, two priority raises to p0) accepted with recorded rationale.

All 44 files carry the — DRAFT (no GitHub mutation; owner ratification pending) H1 marker (grep-verified). Zero board mutation performed.

Next: Stage E plan lock — MASTER-PLAN.md, IMPLEMENTATION-HANDOFF.md, plan.md, PR body refresh, closing statement.

…run close

12-fork owner sweep, program DAG, filing gate + first executable PR groups;
plan.md locked, context-pack finalized, session record written. No board
mutation occurred in this run.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@rickylabs rickylabs added status:plan Harness plan phase and removed status:research Harness research phase labels Aug 8, 2026
@rickylabs

Copy link
Copy Markdown
Owner Author

[PHASE: PLAN] [VERDICT: LOCKED — awaiting owner review] — Stage E complete (1d6c6a70f); seed run finished

The complete long-range remediation plan is committed under .llm/runs/plan-fable5-remediation-roadmap--seed/fable-5-remediation-plan/. Reading order for review: MASTER-PLAN.md (start with §7, the 12-fork owner sweep) → MILESTONE-TRAIN.mdISSUE-DEDUP-AND-SUPERSESSION.md (incl. §3 Stage-E ledger) → the three milestones/ directories (41 drafts) → rfcs/ (RFC-A, RFC-B) → EXISTING-ISSUE-AMENDMENTS.mdWAVE7-AND-AGENT-ADOPTION.mdIMPLEMENTATION-HANDOFF.md. Everything traces to the 19-artifact corpus in research/.

Program in one paragraph: the gap is not missing capability but a product surface that contradicts it — one central seam (contract → typed client → query → page) broken across docs, generation, API sealing, and runtime proof. The plan lands five contracts (typed extension chain RFC-A; generated canonical vertical slice; service slice + command kit RFC-B; runtime truth; agent-native surface) across two inserted milestones (0.0.7 typed seams + generation, 0.0.8 runtime truth + service slice) with 0.0.5 closing as scoped, RFCs ratifying in 0.0.6, existing 0.0.7–0.0.13 shifting to 0.0.9–0.0.15 by title-only rename (every issue retained), and a Wave-7 measured A/B/C adoption smoke as the exit gate before #922's train resumes.

Owner decisions requested: forks F1–F12 in MASTER-PLAN.md §7 (milestone insertion, #922 timing, duplicate-umbrella folds, RFC mechanism, dialect choice, receipt mechanism, Wave-7 scale, and five more) — each with a reversible default. Plus whether to run the later adversarial pass / PLAN-EVAL the waiver deferred.

Closing statement: No GitHub issue, epic, milestone, project, label-set, or comment mutation occurred in this run. The only GitHub writes were this draft PR's own branch/commits/body/comments/PR-labels. All 44 draft files carry the no-mutation H1 marker; filing happens once, from the committed manifest, only after owner ratification, in a separately authorized session. Evaluator waivers (PLAN-EVAL, IMPL-EVAL) are recorded in supervisor.md/worklog.md/drift.md and do not extend to future implementation runs. Worktree is clean; all 9 commits pushed with the explicit refspec.

This was referenced Aug 8, 2026
@rickylabs

Copy link
Copy Markdown
Owner Author

[PHASE: FILING] [VERDICT: COMPLETE]

Owner-ratified Stage H is complete. The milestone train was shifted highest-first, fresh 0.0.6 and 0.0.7 milestones were created, the full former-0.0.6 membership was preserved, and all 41 roadmap issues (#1348#1388) were filed and audited. Live dependencies use live issue numbers; 20 additive existing-owner amendments were posted; no issue was closed.

Durable receipt: fable-5-remediation-plan/FILING-LOG.md (1ef78e29f). GitHub is now authoritative; this PR remains draft and must not be merged.

rickylabs and others added 2 commits August 8, 2026 20:04
…luator delegation record)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>


Both CHANGES_REQUESTED (cycle 1); cross-RFC composition verdict, amendment
map, and v2-migration epic proposal in CROSS-RFC-REVIEW.md. Evaluator-only
writes; no board mutation.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@rickylabs

Copy link
Copy Markdown
Owner Author

[PHASE: REVIEW] — Cross-RFC PLAN-EVAL advisory (RFC-A #1390 × RFC-B #1389)

Both RFC PLAN-EVALs are complete (owner-designated cross-family evaluator: this Fable 5 session; generators: Codex Sol xhigh; deep dives: 3× Opus 5 xhigh, recorded). Both verdicts: CHANGES_REQUESTED, FAIL_PLAN cycle 1 — full findings on each PR and in each run's plan-eval.md (f1a29fe1a, 122301d25). Durable cross-RFC record: fable-5-remediation-plan/CROSS-RFC-REVIEW.md @ a4648d49d.

Cross-RFC verdict: they compose cleanly. No circular dependency (#1350 is a shared one-way stage-0/1 prerequisite); error policies are disjoint by construction (local preparation failures vs route-opt-in contract errors, both deferring client typing to #1350's literal-preserving spelling — whichever lands first establishes it, the other reuses it); context/telemetry ownership does not overlap (transport-owned trace headers vs persisted W3C row context). Sequencing matches the filed train (ratify 0.0.6 → RFC-A impl 0.0.7 → RFC-B impl 0.0.8).

Headline findings: RFC-A — the zero-oRPC-symbol gate fails on unchanged code (ContractLike carries '~orpc'), the server query-key algebra's public 3-tuples are unaddressed, streaming reconnect freezes credentials under prepare-once, the desktop transport bypasses contributions, and the v2 amendment has the GET decision inverted (GET is on today; v2 rejects it by default). RFC-B — the receipt-claim unique-violation algorithm is unspecified (PG transaction poisoning), relay-port package ownership is a hole that can invert the dependency arrow, and the reuse-vs-reinvent decision against @netscript/queue's existing claim/lease/DLQ mechanics is missing. Both cores survived adversarial verification — every repair is a scoped amendment.

Board: existing children #1348#1364 are sufficient — no duplicates needed; the named amendments (#1351 OTel-rename/pin-policy/dedupe-trap, #1349 channel/port-location/key-algebra, #1350 stage-0 spelling, #1362/#1363 relay-ownership + PrismaTransactionClient deliverable) are listed in the cross-RFC record for owner-ratified application. Recommended after acceptance: one new oRPC-v2-migration RFC tracking issue with the exact scope/dependency list in CROSS-RFC-REVIEW.md §3 — not filed by this evaluator; no board mutation occurred.

Handoff: root orchestrator resumes both Codex generators with their finding lists (branch HEADs f1a29fe1a / 122301d25, both status:plan); cycle 2 is the last before escalation. The Qwen 3.8 Max adversarial pass waits until both RFCs reach APPROVED.

@rickylabs
rickylabs marked this pull request as ready for review August 8, 2026 21:28
@rickylabs

Copy link
Copy Markdown
Owner Author

@openhands-agent model=openrouter/minimax/minimax-m3 output=pr-comment iterations=400

use harness

SKILL

  • netscript-harness — preserve evaluator separation and record a concise, evidence-based verdict.
  • netscript-tools — use repository-native commands and keep lock/worktree state clean.
  • openhands-handoff — honor the pr-comment output contract and write the required summary.
  • netscript-cli — hand-test scaffold and documented CLI commands when executable claims exist.
  • rtk — keep changed-file and command inspection compact.

Act as a cheap-and-quick documentation accuracy evaluator. Do not edit source, documentation,
deno.lock, or run artifacts, and do not create commits. Write the complete result to
OPENHANDS_SUMMARY_PATH; output mode pr-comment will publish that result as the single PR
comment.

  1. Identify every changed documentation file in this PR and read each one fully. Include Markdown,
    MDX, READMEs, RFCs, harness/process docs, and skill instructions; do not review only the diff
    hunks.
  2. For every executable claim, QUICKLY hand-test the exact documented command or snippet from the
    repository root. Use the smallest representative scaffold/workspace needed, compare real output
    and generated paths with the document's claim, and stop after the highest-value small checks. Do
    not substitute a full expensive E2E suite for a focused manual check.
  3. If the changed set contains no executable command, snippet, flag, verb, or path claim, say
    exactly:
    No executable documentation claims in this changed set; manual command testing was not applicable.
    Full accuracy and hallucination review is still mandatory.
  4. Check every named command verb, flag, file path, package, API, and expected output against the
    repository. Any hallucinated or nonexistent verb, flag, or path is a BLOCKING finding.
  5. Return a compact per-file table with accurate, inaccurate, or unverifiable, the commands or
    snippets tested, observed-versus-claimed output, and blocking findings. End with one overall
    PASS or FAIL_FIX verdict and a short list of exact fixes.

Keep the iteration budget small. Prefer one to three decisive manual checks over broad exploration,
but never omit a changed documentation file from the per-file verdict table.

@rickylabs

rickylabs commented Aug 8, 2026

Copy link
Copy Markdown
Owner Author

OpenHands Agent — Agent failed

OPENHANDS_VERDICT: NONE

Model: openrouter/minimax/minimax-m3
Provider: OPENROUTER
Job status: failure
Verdict source: none
Summary source: synthesized-after-iteration-limit
Housekeeping: ack=success trace=success commit-artifacts=success replies=skipped draft-pr=skipped
Trace: .llm/tmp/run/openhands/pr-1347/run-31279410211-1 (in the Actions artifact)
Artifact: openhands-agent-31279410211-1

OpenHands Agent Summary — INCOMPLETE (iteration limit)

The agent hit the maximum iterations limit (400) before
finishing the task. Any commits on the branch reflect partial work;
treat claims of completed artifacts as unverified.

Re-trigger with a narrower task or a higher iterations= value.

Run: https://github.com/rickylabs/netscript/actions/runs/31279410211

@rickylabs
rickylabs merged commit c383b2e into main Aug 8, 2026
31 checks passed
rickylabs added a commit that referenced this pull request Aug 9, 2026
#1395 merged as aa8e151, closing #1329. Wave 2 landed four issues across three PRs.

Its IMPL-EVAL required two verdicts: the first passed the implementation, then
75832db landed generic suite-runner and deferred-gate semantics after it, so the
mandatory evaluation was re-opened against the merging head. The correction review
passed, establishing that the deferral machinery cannot hide a failing gate by
construction.

C17's payload is frozen from first-parent history: seven merges since canary.16's
source. Four of them — #1391, #1337, #1347, #1215 — were never dispatched as part of
the wave and are in the payload regardless, which is the membership rule working as
canary-cadence.md intends: the wave is a dispatch unit, the canary is a content unit.

Refs #1329

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LCtRhvYeuhQpvxwQAibz5a
@github-actions github-actions Bot added the canary:0.0.5-canary.17 Published NetScript prerelease 0.0.5-canary.17 label Aug 9, 2026
rickylabs added a commit that referenced this pull request Aug 12, 2026
…iled in one milestone

Three 0.0.6 issues prescribed a fix that, implemented literally, would
have produced a guard that could never fire. Two were caught in this lane
(#1377's group-level command gate is green on arrival; #1374's locked
deno check line exits 1 on every input). The third was caught
independently by the internals lane (#1436 prescribed adding a word
boundary that was already present and is the cause, not the cure), which
is what makes it a pattern rather than a coincidence.

Common cause: all three came from the same planning seed (PR #1347). Its
evidence was excellent and still holds; its prescriptions were reasoned
from that evidence rather than executed against it.

Each lane caught its instance by executing something -- re-measuring
before dispatch, building the mechanism and running it, or committing a
baseline probe recording RED before the fix.

Proposes a predecessor clause for milestone-run.md Gate integrity: an
issue that prescribes a fix has its prescription re-verified before
implementation, executed rather than read. 0.0.4 taught that shipped
guards can be inert; 0.0.6 shows filed prescriptions can be inert before
anyone writes a line.

Refs #1374 #1377

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01QGrdeXR3yuCZt78FxtpMy5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:docs canary:0.0.5-canary.17 Published NetScript prerelease 0.0.5-canary.17 ci:skip-e2e ci:skip-scaffold Skip the scaffold-static (deno-only) scaffold gate status:plan Harness plan phase type:docs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant