Skip to content

Actions: braintrustdata/autoevals

Actions

Run pnpm evals

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
eval.yaml
264 workflow runs
264 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
fix: allow npm consumers to install the package (#216) Run pnpm evals #485: Commit 9546b28 pushed by AbhiPrasad
1m 5s main
main
1m 5s
fix(python): preserve explicit token limits for Responses API Run pnpm evals #484: Pull request #222 synchronize by kingsleyli920
Action required kingsleyli920:codex/responses-token-limit
kingsleyli920:codex/responses-token-limit
Action required
fix(python): preserve explicit token limits for Responses API Run pnpm evals #483: Pull request #222 opened by kingsleyli920
Action required kingsleyli920:codex/responses-token-limit
kingsleyli920:codex/responses-token-limit
Action required
fix(python): honor ValidJSON schemas across scorer call paths Run pnpm evals #482: Pull request #221 opened by JianYan11
Action required JianYan11:fix/python-validjson-schema
JianYan11:fix/python-validjson-schema
Action required
fix: return ExactMatch mismatches for non-JSON primitives Run pnpm evals #481: Pull request #220 opened by Bortlesboat
Action required Bortlesboat:fix/exact-match-non-json-values
Bortlesboat:fix/exact-match-non-json-values
Action required
fix: allow npm consumers to install the package Run pnpm evals #480: Pull request #216 opened by SiluPanda
23s SiluPanda:fix/npm-consumer-install
SiluPanda:fix/npm-consumer-install
23s
fix: do not crash isWrapped on plain OpenAI-compatible clients Run pnpm evals #479: Pull request #214 opened by BetterAndBetterII
30d 0h 0m 43s BetterAndBetterII:fix/iswrapped-plain-client
BetterAndBetterII:fix/iswrapped-plain-client
30d 0h 0m 43s
fix: isolate embedding cache by model and prefix Run pnpm evals #478: Pull request #213 opened by original4422
30d 0h 4m 5s original4422:fix/embedding-cache-configuration
original4422:fix/embedding-cache-configuration
30d 0h 4m 5s
fix(json): stop a skipped sub-score being averaged as a mismatch Run pnpm evals #477: Pull request #210 opened by arthi-arumugam-git
30d 0h 3m 24s arthi-arumugam-git:fix/json-diff-skipped-scores
arthi-arumugam-git:fix/json-diff-skipped-scores
30d 0h 3m 24s
fix: AnswerRelevancy silently ignores embedding_model (both sync and async) Run pnpm evals #476: Pull request #209 opened by spacesheepinternet
30d 0h 4m 9s spacesheepinternet:fix/answer-relevancy-embedding-model
spacesheepinternet:fix/answer-relevancy-embedding-model
30d 0h 4m 9s
feat: Add Agent Behavior scorer for Python and TypeScript Run pnpm evals #475: Pull request #208 synchronize by AbhiPrasad
1m 5s abhi-feat-add-agent-behavior-scorer
abhi-feat-add-agent-behavior-scorer
1m 5s
feat: Add Agent Behavior scorer for Python and TypeScript Run pnpm evals #474: Pull request #208 synchronize by AbhiPrasad
1m 36s abhi-feat-add-agent-behavior-scorer
abhi-feat-add-agent-behavior-scorer
1m 36s
feat: Add Agent Behavior scorer for Python and TypeScript Run pnpm evals #473: Pull request #208 opened by AbhiPrasad
1m 28s abhi-feat-add-agent-behavior-scorer
abhi-feat-add-agent-behavior-scorer
1m 28s
Use shared workflow for JS+PY release (#204) Run pnpm evals #472: Commit b0e1055 pushed by delner
1m 18s main
main
1m 18s
Use shared workflow for JS+PY release Run pnpm evals #471: Pull request #204 synchronize by delner
1m 1s ci/release_shared_action
ci/release_shared_action
1m 1s
Use shared workflow for JS+PY release Run pnpm evals #470: Pull request #204 synchronize by delner
1m 25s ci/release_shared_action
ci/release_shared_action
1m 25s
Use shared workflow for JS+PY release Run pnpm evals #469: Pull request #204 synchronize by delner
1m 25s ci/release_shared_action
ci/release_shared_action
1m 25s
Use shared workflow for JS+PY release Run pnpm evals #468: Pull request #204 synchronize by delner
1m 21s ci/release_shared_action
ci/release_shared_action
1m 21s
Use shared workflow for JS+PY release Run pnpm evals #467: Pull request #204 synchronize by delner
1m 15s ci/release_shared_action
ci/release_shared_action
1m 15s
Use shared workflow for JS+PY release Run pnpm evals #466: Pull request #204 synchronize by delner
1m 16s ci/release_shared_action
ci/release_shared_action
1m 16s
Use shared workflow for JS+PY release Run pnpm evals #465: Pull request #204 synchronize by delner
1m 19s ci/release_shared_action
ci/release_shared_action
1m 19s
Use shared workflow for JS+PY release Run pnpm evals #464: Pull request #204 synchronize by delner
1m 10s ci/release_shared_action
ci/release_shared_action
1m 10s
Use shared workflow for JS+PY release Run pnpm evals #463: Pull request #204 synchronize by delner
1m 16s ci/release_shared_action
ci/release_shared_action
1m 16s
Use shared workflow for JS+PY release Run pnpm evals #462: Pull request #204 synchronize by delner
1m 18s ci/release_shared_action
ci/release_shared_action
1m 18s
Use shared workflow for JS+PY release Run pnpm evals #461: Pull request #204 synchronize by delner
1m 14s ci/release_shared_action
ci/release_shared_action
1m 14s