Skip to content

feat(dashboard): prioritize operational telemetry - #1113

Merged
brokemac79 merged 2 commits into
mainfrom
codex/csw-125-telemetry-overview
Aug 10, 2026
Merged

feat(dashboard): prioritize operational telemetry#1113
brokemac79 merged 2 commits into
mainfrom
codex/csw-125-telemetry-overview

Conversation

@brokemac79

@brokemac79 brokemac79 commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Put decision-useful operational telemetry first on the dashboard overview.
  • Move the full Fleet Review Coverage inventory below telemetry into a collapsed native disclosure.
  • Preserve repository counts, flags, links, loading/empty/error behavior, and the degraded coverage signal in the always-visible health hero.

Problem

The overview opened with a long repository inventory. On production-sized data that inventory consumed the initial viewport and pushed queue, throughput, capacity, and incident telemetry far below the fold. Operators had to scroll past coverage detail before they could answer the page's primary questions: whether the system is healthy, whether work is flowing, and where intervention is needed.

Implementation

  • Reordered the existing overview so System Overview and its operational cards precede repository coverage in document order.
  • Wrapped the unchanged repository exploration UI in semantic native <details>/<summary>, collapsed by default.
  • Kept the coverage health indicator in the hero so stale/degraded coverage is never hidden by progressive disclosure.
  • Added responsive disclosure styling, visible keyboard focus, and native disclosure affordance using the existing ClawSweeper visual language.
  • Added deterministic rendering assertions for order, collapsed-default behavior, preserved loading/error/repository content, and accessibility semantics.

Validation

Exact head: 6f3571adf1fe028483f94e934db067419286f66d
Tree: 7b1150e2ecbd5994be97da99984e95792df44263
Recorded base: 91272a65e6ffbf1eafddf520639c9acbd339e1bf

User-authorized direct local Docker proof used pinned image:

mcr.microsoft.com/playwright@sha256:9bd26ad900bb5e0f4dee75839e957a89ae89c2b7ab1e76050e559790e946b948

The container materialized the exact commit with git archive from read-only Git objects, asserted commit/tree/manifest identity, then ran:

pnpm install --frozen-lockfile
pnpm run build:all
pnpm run check:static
pnpm run format:check
pnpm run lint
node --test test/dashboard-github-api.test.ts test/dashboard-health.test.ts test/dashboard-operational-health.test.ts test/dashboard-smoke.test.ts test/dashboard-worker.test.ts test/worker-records-request.test.ts test/worker-state-blobs.test.ts
pnpm run test:coverage:changed:no-build

Results:

  • Relevant dashboard/Worker tests: 375/375 passed.
  • Changed coverage tests: 12/12 passed; 100% lines, 100% functions, 88.61% branches.
  • Build, static checks, formatting, and every lint lane passed.
  • git diff --check passed and the host worktree remained clean at the exact head.

Real Behavior Proof

Claim: the dashboard's initial desktop viewport prioritizes operational health and telemetry while keeping complete repository exploration reachable and accessible.

Exercised surface: the exact archived Worker/dashboard build was served with Wrangler inside the pinned Linux container and exercised with real Chromium/Playwright.

Scenario/fixture: deterministic healthy/degraded operational data plus two repository coverage fixtures, including per-repository flags and explicit loading and error responses.

Observed result:

  • Desktop 1440×900: System Overview began at y=422.56 (above fold); repository coverage began at y=2849.91 and followed it in heading/document order.
  • Narrow 390×844: page scroll width remained 390 with no horizontal overflow.
  • Coverage was collapsed by default.
  • Keyboard Enter opened the native disclosure and focus remained on its summary.
  • Both repository fixtures and their flags rendered after expansion.
  • Loading and error semantics remained intact.
  • The hero continued to show the degraded signal 7d coverage 50% · 3 stale while the inventory was collapsed.

Artifacts retained outside the worktree under C:\clawsweeper-work\artifacts\csw-125\direct-docker-6f3571adf1 include the browser report, test transcripts, archive/manifest hashes, exit code, and screenshots. Container csw-125-direct-proof-6f3571adf1 (ec6244f6616e954aa3e1b61ce354f9198caf723ffa57ce67918bc2151172fe26) ran from 2026-08-10T21:15:14Z to 21:16:04Z and exited 0:

  • overview-desktop-1440x900.png
  • overview-narrow-390x844.png
  • repository-coverage-open.png
  • repository-coverage-narrow-open.png
  • repository-coverage-summary-focus.png

The successful proof container exited 0 and was removed by its exact task-owned name after its ID, inspection, log, and Docker events were recorded. Other task containers were not modified.

Proof boundary: this is Martin-authorized direct-Docker evidence, not a Crabbox lease/run receipt. Earlier Crabbox local-container/AWS transport failures are retained as infrastructure diagnostics; they did not weaken or replace this unchanged exact-head proof contract. No production mutation or deployment was performed.

Review closeout

  • Dirty Codex review found and prompted restoration of the native disclosure marker; the fix was tested and the repeat review was clean.
  • Committed Codex range review found an undefined color token; the fix was tested and the review was clean.
  • ClawSweeper's PR review then identified an invalid heading nested in <summary>. The heading was moved immediately before <details>, the toggle was made phrasing-only, and structural tests were updated.
  • Post-fix dirty and committed Codex reviews found no actionable defects.
  • Post-fix local ClawSweeper range review against the recorded base returned keep_open with high confidence.

Accessibility and responsive checks

  • Semantic heading order is telemetry first, coverage second.
  • Native <details>/<summary> provides keyboard and assistive-technology disclosure semantics.
  • Summary has a visible :focus-visible treatment and retains focus when toggled.
  • Urgent/degraded coverage status remains outside the collapsed region.
  • Desktop and narrow layouts have no horizontal overflow.

Compatibility and overlap

Risks and rollback

Risk is limited to overview presentation and discoverability: operators accustomed to the expanded inventory need one disclosure action. Counts and degraded status remain visible before expansion, and native disclosure behavior avoids custom state machinery. Rollback is a single-commit revert; no data, API, polling, queue, runtime, route, or deployment migration is involved.

Non-goals

  • No new route or broad brand redesign.
  • No changes to telemetry meaning, data sources, polling cadence, queue/runtime behavior, gates, or production state.
  • No deployment or production mutation.

@clawsweeper

clawsweeper Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

🦞👀
ClawSweeper picked this up.

Pull request received. I will update this pull request when review starts.

Copy link
Copy Markdown
Contributor Author

@clawsweeper review

@clawsweeper

clawsweeper Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

🦞🧹
ClawSweeper re-review requested.

I asked ClawSweeper to review this item again.
Action: item re-review queued (workflow sweep.yml, event repository_dispatch).
Result: when the review finishes, ClawSweeper will create the durable review comment if needed or update the existing comment in place.

Re-review progress:

@clawsweeper

clawsweeper Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Codex review: needs maintainer review before merge. Reviewed August 10, 2026, 5:24 PM ET / 21:24 UTC.

ClawSweeper review

What this changes

The PR puts operational telemetry before repository coverage on the dashboard overview and collapses the coverage inventory behind a native disclosure.

Merge readiness

⚠️ Ready for maintainer review - 3 items remain

Keep open for a maintainer product decision: the patch is technically sound and proof-backed, but it intentionally makes per-repository coverage less immediately discoverable.

Priority: P2
Reviewed head: 6f3571adf1fe028483f94e934db067419286f66d
Owner decision: Required. See Decision needed.

Review scores

Measure Result What it means
Overall readiness 🐚 platinum hermit (4/6) A focused, well-tested dashboard patch with credible real-browser evidence; only the intended operator-UX decision remains.
Proof confidence 🐚 platinum hermit (4/6) Sufficient (live_output): The PR body documents an exact-head local Docker Chromium run with desktop and narrow-view results, disclosure keyboard behavior, preserved loading/error paths, and visible degraded coverage state.
Patch quality 🐚 platinum hermit (4/6) No actionable review findings were identified.

Verification

Check Result Evidence
Real behavior Verified Sufficient (live_output): The PR body documents an exact-head local Docker Chromium run with desktop and narrow-view results, disclosure keyboard behavior, preserved loading/error paths, and visible degraded coverage state.
Evidence reviewed 6 items Current main does not include the UI change: Current main renders Fleet Review Coverage before System Overview as an always-visible section; the PR moves it after the overview and wraps it in a closed details element.
Native disclosure and telemetry-first order: The PR uses native details/summary markup and places it after the System Overview, avoiding custom disclosure state.
Degraded aggregate coverage remains visible: The existing health-strip renderer continues to expose aggregate seven-day coverage and stale-count state outside the collapsed inventory.
Findings None None.
Security None None.

How this fits together

The dashboard Worker combines review coverage and operational-health data into an operator overview. This change only changes the order and default visibility of those existing rendered sections.

flowchart LR
A[Review coverage data] --> B[Dashboard Worker]
C[Operational health data] --> B
B --> D[Health hero]
B --> E[System overview]
B --> F[Coverage disclosure]
D --> G[Operator decision making]
E --> G
F --> G
Loading

Decision needed

Question Recommendation
Should the overview hide detailed Fleet Review Coverage by default in favor of immediately visible operational telemetry? Approve telemetry-first overview: Keep coverage collapsed by default, relying on the always-visible health chip for urgent aggregate state.

Why: The patch preserves aggregate degraded coverage, but the appropriate default discoverability of detailed per-repository flags is an operator-UX decision rather than a correctness fact.

Before merge

  • Resolve merge risk (P1) - Per-repository stale, failed, and unmanaged-record flags move from the initial overview to a collapsed control below a long System Overview; the aggregate health chip mitigates this but does not replace the detailed inventory.
  • Complete next step (P2) - A maintainer must choose the intended default discoverability of detailed coverage before this otherwise-correct UI change can land.
Agent review details

Security

None.

Review metrics

Metric Value Why it matters
Production and test delta production +32/-8, tests +14/-1 The small dashboard-only change adds matching structural coverage for the new default disclosure.

Merge-risk options

Maintainer options:

  1. Approve telemetry-first scanning (recommended)
    Accept one disclosure action for detailed coverage because aggregate coverage and stale status remain in the health hero.
  2. Preserve always-visible coverage
    Pause or close this presentation change if per-repository flags must remain in the initial operator viewport.

Technical review

Best possible solution:

Adopt the native disclosure only if maintainers explicitly accept telemetry-first scanning over always-visible per-repository detail, then refresh the branch and browser proof if #1112 lands first.

Do we have a high-confidence way to reproduce the issue?

Not applicable as a bug reproduction: the PR body provides a concrete exact-head Chromium scenario showing the intended desktop, narrow-screen, disclosure, keyboard, and degraded-health behavior.

Is this the best way to solve the issue?

Yes, conditionally: native details is the narrowest maintainable implementation, but maintainers must decide whether the default discoverability tradeoff is acceptable.

AGENTS.md: found and applied where relevant.

Codex review notes: model internal, reasoning high; reviewed against 91272a65e6ff.

Labels

Label justifications:

  • P2: This is a bounded operator-dashboard improvement with a meaningful but limited discoverability tradeoff.
  • merge-risk: 🚨 other: Merging changes the default visibility of detailed per-repository coverage without changing the underlying telemetry.
  • rating: 🐚 platinum hermit: Overall readiness is 🐚 platinum hermit; proof is 🐚 platinum hermit and patch quality is 🐚 platinum hermit.
  • status: 👀 ready for maintainer look: ClawSweeper has no concrete contributor-facing blocker left for this PR. Sufficient (live_output): The PR body documents an exact-head local Docker Chromium run with desktop and narrow-view results, disclosure keyboard behavior, preserved loading/error paths, and visible degraded coverage state.
  • proof: sufficient: Contributor real behavior proof is sufficient. The PR body documents an exact-head local Docker Chromium run with desktop and narrow-view results, disclosure keyboard behavior, preserved loading/error paths, and visible degraded coverage state.

Evidence

What I checked:

  • Current main does not include the UI change: Current main renders Fleet Review Coverage before System Overview as an always-visible section; the PR moves it after the overview and wraps it in a closed details element. (dashboard/worker.ts:9510, 91272a65e6ff)
  • Native disclosure and telemetry-first order: The PR uses native details/summary markup and places it after the System Overview, avoiding custom disclosure state. (dashboard/worker.ts:9585, 6f3571adf1fe)
  • Degraded aggregate coverage remains visible: The existing health-strip renderer continues to expose aggregate seven-day coverage and stale-count state outside the collapsed inventory. (dashboard/worker.ts:10176, 6f3571adf1fe)
  • Focused regression assertions: The changed test asserts document order, closed-by-default native disclosure, semantic heading placement, and the preserved accessibility reference. (test/dashboard-worker.test.ts:21628, 6f3571adf1fe)
  • Feature-history routing: Recent current-main history shows Martin Cleary and Peter Steinberger repeatedly maintaining the dashboard Worker and its operational-health behavior. (dashboard/worker.ts:10152, 91272a65e6ff)
  • Not shipped or on main: The PR head is neither contained by current main nor by a local release tag, so the requested dashboard behavior remains an active proposal. (6f3571adf1fe)

Likely related people:

  • Martin Cleary: Recent current-main changes include dashboard Worker and dashboard-test work around review and queue behavior. (role: recent dashboard contributor; confidence: medium; commits: 91272a65e6ff, 3a38d3622a9b; files: dashboard/worker.ts, test/dashboard-worker.test.ts)
  • Peter Steinberger: Recent history includes operational-health and observability changes in the same dashboard surface. (role: recent operational-dashboard contributor; confidence: medium; commits: 35b5f622c968, 621b297eadd5; files: dashboard/worker.ts)

Rank-up moves

Optional improvements that raise the rating; they are not merge blockers.

Rating scale

Score Internal tier Crab rank Meaning
6/6 S 🦀 challenger crab Exceptional readiness
5/6 A 🦞 diamond lobster Very strong readiness
4/6 B 🐚 platinum hermit Good normal PR; ordinary maintainer review
3/6 C 🦐 gold shrimp Useful, but confidence is limited
2/6 D 🦪 silver shellfish Proof or implementation needs work
1/6 F 🧂 unranked krab Not merge-ready
N/A NA 🌊 off-meta tidepool Rating does not apply

Overall follows the weaker of proof and patch quality.
Shiny media proof means a screenshot, video, or linked artifact directly shows the changed behavior. Runtime, network, CSP, and security claims still need visible diagnostics.

Workflow

  • ClawSweeper keeps one durable marker-backed review comment per issue or PR.
  • Re-runs edit this comment so the latest verdict, findings, and automation markers stay together instead of adding duplicate bot comments.
  • A fresh review can be triggered by eligible @clawsweeper re-review comments, exact-item GitHub events, scheduled/background review runs, or manual workflow dispatch.
  • PR/issue authors and users with repository write access can comment @clawsweeper re-review or @clawsweeper re-run on an open PR or issue to request a fresh review only.
  • Maintainers can also comment @clawsweeper review to request a fresh review only.
  • Fresh-review commands do not start repair, autofix, rebase, CI repair, or automerge.
  • Maintainer-only repair and merge flows require explicit commands such as @clawsweeper autofix, @clawsweeper automerge, @clawsweeper fix ci, or @clawsweeper address review.
  • Maintainers can comment @clawsweeper explain to ask for more context, or @clawsweeper stop to stop active automation.

History

Review history (3 earlier review cycles)
  • reviewed 2026-08-10T20:43:36.352Z sha 5754f2a :: needs changes before merge. :: [P2] Move the coverage heading out of the summary
  • reviewed 2026-08-10T20:47:32.507Z sha 5754f2a :: needs changes before merge. :: [P2] Move the coverage heading out of the summary
  • reviewed 2026-08-10T21:07:45.103Z sha d67585b :: needs maintainer review before merge. :: none

@clawsweeper clawsweeper Bot added merge-risk: 🚨 other 🚨 Merging this PR has meaningful risk outside the owned taxonomy. P2 Normal priority bug or improvement with limited blast radius. proof: sufficient Contributor real behavior proof is sufficient. rating: 🦐 gold shrimp Decent PR readiness signal, but merge confidence is limited. status: ⏳ waiting on author ClawSweeper has contributor-facing work open and is waiting for author action. labels Aug 10, 2026

Copy link
Copy Markdown
Contributor Author

@clawsweeper re-review

@clawsweeper

clawsweeper Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

🦞🧹
ClawSweeper re-review requested.

I asked ClawSweeper to review this item again.
Action: item re-review queued (workflow sweep.yml, event repository_dispatch).
Result: when the review finishes, ClawSweeper will create the durable review comment if needed or update the existing comment in place.

Re-review progress:

@clawsweeper clawsweeper Bot added rating: 🐚 platinum hermit Good normal PR readiness with ordinary maintainer review expected. status: 👀 ready for maintainer look ClawSweeper has no concrete contributor-facing blocker left for this PR. and removed status: ⏳ waiting on author ClawSweeper has contributor-facing work open and is waiting for author action. rating: 🦐 gold shrimp Decent PR readiness signal, but merge confidence is limited. labels Aug 10, 2026
@brokemac79
brokemac79 force-pushed the codex/csw-125-telemetry-overview branch from d67585b to 6f3571a Compare August 10, 2026 21:20

Copy link
Copy Markdown
Contributor Author

@clawsweeper re-review

@clawsweeper

clawsweeper Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

🦞🧹
ClawSweeper re-review requested.

I asked ClawSweeper to review this item again.
Action: item re-review queued (workflow sweep.yml, event repository_dispatch).
Result: when the review finishes, ClawSweeper will create the durable review comment if needed or update the existing comment in place.

Re-review progress:

@brokemac79
brokemac79 marked this pull request as ready for review August 10, 2026 21:28
@brokemac79
brokemac79 merged commit f9a2f94 into main Aug 10, 2026
12 of 13 checks passed
@brokemac79
brokemac79 deleted the codex/csw-125-telemetry-overview branch August 10, 2026 21:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

merge-risk: 🚨 other 🚨 Merging this PR has meaningful risk outside the owned taxonomy. P2 Normal priority bug or improvement with limited blast radius. proof: sufficient Contributor real behavior proof is sufficient. rating: 🐚 platinum hermit Good normal PR readiness with ordinary maintainer review expected. status: 👀 ready for maintainer look ClawSweeper has no concrete contributor-facing blocker left for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant