All pull requests

Pull requests

• fix(python): preserve explicit token limits for Responses API

  #222·Kingsley_Li (kingsleyli920) opened Sep 13, 2026·

  ·
  4

• fix(python): honor ValidJSON schemas across scorer call paths

  #221·JianYan (JianYan11) opened Sep 10, 2026·

  ·

• fix: return ExactMatch mismatches for non-JSON primitives

  #220·Andrew Barnes (Bortlesboat) opened Sep 8, 2026·

  ·

• fix: do not crash isWrapped on plain OpenAI-compatible clients

  #214·Yuzhong Zhang (BetterAndBetterII) opened Aug 25, 2026·

  ·
  1

• fix: isolate embedding cache by model and prefix

  #213·Daniel Peng (original4422) opened Aug 19, 2026·

  ·
  1

  2

• fix(json): stop a skipped sub-score being averaged as a mismatch

  #210·Arthi Arumugam (arthi-arumugam-git) opened Aug 2, 2026·

  ·
  2

• fix: AnswerRelevancy silently ignores embedding_model (both sync and async)

  #209·Rehan (spacesheepinternet) opened Jul 31, 2026·

  ·
  1

• feat: Add Agent Behavior scorer for Python and TypeScript

  #208·Abhijeet Prasad (AbhiPrasad) opened Jul 29, 2026Member·

  ·
  4

  

• docs: add ExactMatch score example

  #188·Rul1an (Rul1an) opened Apr 25, 2026Contributor·

  ·
  1

• fix: ContextPrecision now scores by position of relevant context (clo…

  #178·Nishtha Nabya (NishthaNabya) opened Mar 17, 2026·

  ·
  1

• Use embedding_model parameter in AnswerRelevancy sync runner instead of model

  #167·Christian Görner (cgoer) opened Jan 15, 2026·

  ·

• Bump js-yaml from 4.1.0 to 4.1.1 in the npm_and_yarn group across 1 directory

  dependenciesjavascript
  #151·dependabot[bot] opened Nov 17, 2025Bot·

  ·
  1

• Zod v4

  #147·Ankur Goyal (ankrgyl) opened Sep 15, 2025Contributor·

  ·
  1

• Switch to gpt-5-mini as the default

  #142·Ankur Goyal (ankrgyl) opened Aug 8, 2025Contributor·

  ·
  1

• Remove the dependency on braintrust core.

  #139·Matt Perpick (clutchski) opened May 14, 2025Contributor·

  ·
  2

• Remove default max tokens (512)

  #120·Ankur Goyal (ankrgyl) opened Mar 1, 2025Contributor·

  ·
  2

• fix: adding header and query to oai - Python

  #104·Chibi Vikramathithan (Chibionos) opened Dec 18, 2024·

  ·
  1

• Try gpt-4o-mini

  #78·Ankur Goyal (ankrgyl) opened Jul 18, 2024Contributor·

  ·
  1

• (FEAT) allow setting base url for openai v1.0.0+

  #32·Ishaan Jaff (ishaan-jaff) opened Nov 14, 2023·

  ·
  7