feat: evaluation sets UI, MCP tools, and evaluator enhancements - #102

Merged

radu-mocanu merged 12 commits into

mainfrom

Mar 29, 2026

Commits on Mar 28, 2026

fix: broadcast running status immediately when eval run starts

radu-mocanu
and
claude
committed
b9641f6
fix: stop adding empty criteria when attaching evaluators to eval sets

radu-mocanu
and
claude
committed
458bf60
feat: add LLM model selection for evaluators and expose full evaluator schemas

radu-mocanu
and
claude
committed
16ece57
feat: add Models popover in status bar to browse available LLM models

radu-mocanu
and
claude
committed
51476ff
feat: add eval MCP tools for listing and running evaluation sets

radu-mocanu
and
claude
committed
4419061
feat: per-item evaluator management in eval set detail

radu-mocanu
and
claude
committed
45552e4
feat: dynamic evaluator config fields from schema + evaluators column

radu-mocanu
and
claude
committed
4092f72
feat: dynamic criteria editing and evaluator config summary per eval item

radu-mocanu
and
claude
committed
b5c45af
feat: make eval items fully editable with add/edit/delete support

radu-mocanu
and
claude
committed
477bcbb
feat: inline-editable eval item fields with click-to-edit UX

radu-mocanu
and
claude
committed
a3a1a3c
fix: normalize evaluator scores from 0-100 to 0-1 scale

radu-mocanu
and
claude
committed
cab4939

Commits on Mar 29, 2026

feat: custom evaluator scaffolding via UI, MCP, and Claude Code skill

radu-mocanu
and
claude
committed
e0b2743