Skip to content

chore(metrics): measure adoption of source-verification and property-based-testing skills (#2172) #2205

Description

@bdfinst

Part of #2200. Blocked on slice 0.

Measure

  • Invocations: count from ~/.claude/metrics/artifact-usage.json via /artifact-lifecycle, split into direct user invocations and dispatches from the wired consumers (doc-review/tech-writer and correctness-review category 6 for source-verification; test-design-advisor for PBT).
  • source-verification: the verdict mix (verified / contradicted / unverifiable). A contradicted verdict that caught a real wrong claim is the benefit signal. Report the rate per invocation against slice 0's threshold; one catch over the whole window is not enough to keep the skill.
  • property-based-testing: the mutants killed by the generated properties (/mutation-testing) against the same target's pre-existing tests.

Acceptance criteria


Generated by Claude Code

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions