laguna §5d: correct the soak counts, including a turn-success figure that was wrong at source - #20
Open
Blackwellboy wants to merge 1 commit into
Open
Conversation
…that was wrong at source Two separate errors, both ours, both at source rather than in this guide. 1. The ~389-session / ~2,947-turn figures are an ~11.5h checkpoint of a run that finished at 409 sessions and 3,096 turns. Same single run, later cut. 2. The 99.9% turn-success figure was wrong in our own primary. turns.jsonl has 3,099 lines, but 3 of those are kind: integrity_probe records, not turns. All 3,096 turn records returned HTTP 200. The turn log is written unconditionally with whatever status came back, so a failed turn would carry a non-200 status, and none does. Turn success is 100%. Also restated: 409 is the session count, of which 400 completed and 9 were killed at the driver's session-token cap by design, and the thinking rate is 3 of 3,096 (0.0969%) rather than 3 of 2,944, unchanged at ~0.1%. Six surfaces, not the four we first sent: §5d prose, the stability bullet, the thinking-rate denominator, the changelog entry, the card, and the verdict line in this guide's own frontmatter. Depth-collapse language is untouched; PR TheTom#19 owns that reconciliation. Primary correction: Blackwellboy/laguna-s21-lab@4507826
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Drafted with AI assistance (Claude); reviewed and submitted by @Blackwellboy.
Counts only. No depth-collapse language is touched here; #19 owns that reconciliation and this PR deliberately does not overlap it.
All values below were re-derived from the published artifacts before editing, not transcribed from our earlier message.
Two errors, both ours
1. Checkpoint, not final cut. The
~389 sessions / ~2,947 turnsfigures come from an ~11.5h checkpoint of a run that finished at 409 sessions / 3,096 turns. Same single run, later cut. You already had the corrected turn count sitting in your own changelog, which is how the document disagreed with itself.2. The 99.9% turn-success figure was wrong in our primary, and you inherited it in good faith.
soak/logs/turns.jsonlhas 3,099 lines. Three of those arekind: integrity_proberecords, not turns: a different shape,status: 200,http_error: false, and the same three records asintegrity_probes.jsonl. Every note we published described them as incomplete in-flight turns and derived 99.9% from them.All 3,096 turn records returned HTTP 200. The turn log in
soak_driver.pyis written unconditionally with whatever status came back, so a failed turn would appear with a non-200 status. None does. Turn success is 100%.Corrected at source first, so this PR cites a primary that agrees rather than one that contradicts it: laguna-s21-lab@4507826.
The precise distinctions
turns.jsonlkind: integrity_proberecords in the same fileThe 9 killed sessions are the same 9 incidents your 2026-07-25 entry already scopes as his driver cap firing by design. They were never subtracted from our headline, which is why 409 was reported as though all of them completed.
Six surfaces, not four
Our earlier four-line correction list was incomplete. It gave you §5d prose, the stability bullet, the changelog entry and the card, and it missed the thinking-rate denominator,
~3 of 2,944 turns. That line is the one where a wrong denominator actually moves a published rate, so it was the worst one to leave out.A sixth surface turned up while making the edit and is corrected here too: the
verdict:line in this guide own frontmatter also carried99.9% turn success. It was in neither of our lists.models/laguna-s-2.1.md§5d prose:~389 sessions and ~2,947 turnsto409 sessions and 3,096 turnsmodels/laguna-s-2.1.mdstability bullet:2,944 of 2,947 turns succeeded (99.9%)toall 3,096 turns returned HTTP 200 (100%)models/laguna-s-2.1.mdthinking rate:~3 of 2,944 turns (~0.1%)to3 of 3,096 turns (0.0969%, ~0.1%)models/laguna-s-2.1.mdchangelog2026-07-24entry: turn count and99.9%to100%cards/laguna-s-2.1.html:12h / 2947 turns,99.9% turn successto12h / 3096 turns,100% turn successmodels/laguna-s-2.1.mdfrontmatterverdict::99.9% turn successto100%Plus a dated
2026-07-29changelog entry recording the correction and pointing at the primary, following your existing convention.Checks
python3 scripts/check_guides.pypasses: valid frontmatter, required keys, no em/en-dashes.git diff --checkclean.One line I did NOT touch, deliberately
The
2026-07-26changelog entry says his soaksent enable_thinking: true on all 3,099 turns. Strictly that should be 3,096, since 3,099 is the line count and 3 of those lines are probes rather than turns. It sits inside an entry that #19 is reconciling, so it is yours to fold in whichever way suits that PR rather than something to fix from two directions at once. Flagging it so it is not missed.Nothing about the thinking-gate, persona-gate or depth-collapse conclusions changes. Only counts.