feat: profile precision enhancement v2 — Beta confidence model with 44 fixes#152
feat: profile precision enhancement v2 — Beta confidence model with 44 fixes#152rookie136 wants to merge 1 commit into
Conversation
4c9e610 to
1022f81
Compare
…4 fixes Core changes: - Beta unified confidence model (syncConfidence, alpha/beta accumulation replaces confidence saturation) - mergeConfirmedMatch rename (combineItems → called only for confirmed matches) - forced merge / cross-validation use direct field manipulation (avoid alpha desync) - Thompson weak-hit sampling uses isolated weakAlpha/weakBeta - Semantic dedup pass: deduplicateItems + checkSemanticDuplicate + pair cache LRU - pendingValidation cross-batch confirmation + lazy migration - Remove capConfidences / applyConfidenceDecay / decayWeakHits dead code - Validator extended: 5-value verdict + patterns coverage + oversimplified → evolve - Injection quality: dedupByCategory + scoreByRecency + workflow context anchor - AI-cleanup preserveKeys updated for Beta fields + alpha accumulation - Bug fixes: P3 retry path decay, P10 evolve evidence threshold >= 3 Deployment results (2026-07-03): - confidence distribution: 0.42~0.99 (distinguishable) - 0 saturation events - dedup: steady-state 0 LLM calls per cycle - 0 decay false positives - Thompson weak/familiar isolation correct - injection: 5-dimension full coverage
|
Thanks for this substantial PR. I attempted to merge it as part of a batch release, but I'm holding it back because it does not pass the test suite on its own. Merging
Example failure: The new Beta-confidence model changes the resulting confidence values (e.g. ~5/7 ≈ 0.714), but |
Summary
Comprehensive upgrade from linear confidence model to Beta posterior model, plus injection quality improvements, semantic deduplication, Thompson sampling isolation, and validator extensions.
Core Changes
Beta Confidence Model
syncConfidence(item):confidence = alpha/(alpha+beta) × min(timeFactor, trendMultiplier)lazyMigrateAlpha: detects legacy Thompson prior (0.5, 1.5) and migrates to evidence-based alphaMerge Method Constraints
combineItems→mergeConfirmedMatch: only called by exact/strong/weak-upgradecombineThree: alpha=a1+a2+1, beta=b1+b2, frequency=f1+f2+1Thompson Sampling (Isolated)
weakAlpha/weakBetaDecay & Staleness
conf < 0.3hard thresholdalpha ≤ 2 && age > 30 daysdecayWeakHits,applyConfidenceDecay,capConfidencesSemantic Deduplication
deduplicateItems: LLM checks same-category pairs with cos ≥ 0.50dedupCheckedCacheLRU (1000 limit)pendingValidation
pendingValidation = truealpha += 1.0+syncConfidenceValidator (5 verdicts)
Injection Quality
dedupByCategory+scoreByRecency(conf×0.7 + exp(-age/90)×0.3)Bug Fixes
Deployment Results (2026-07-03)