Upstream: ggml-org#28478
A streaming tool request returns HTTP 400 with logprobs, while the equivalent n_probs request succeeds and includes probabilities.
Environment: current main 465e49b9, Linux aarch64, Gemma 4 12B Q4_K_M, CUDA.
{"messages":[{"role":"user","content":"Call get_weather for Singapore."}],"tools":[{"type":"function","function":{"name":"get_weather","parameters":{"type":"object","properties":{"location":{"type":"string"}},"required":["location"]}}}],"stream":true,"logprobs":true,"top_logprobs":2}Observed: HTTP 400, logprobs is not supported with tools + stream. Replacing the last two fields with "n_probs":2 returns HTTP 200, tool calls, and top_logprobs.
The explicit rejection was introduced in f5cd27b7 and runs before top_logprobs is converted to n_probs.
Upstream: ggml-org#28478
A streaming tool request returns HTTP 400 with
logprobs, while the equivalentn_probsrequest succeeds and includes probabilities.Environment: current main
465e49b9, Linux aarch64, Gemma 4 12B Q4_K_M, CUDA.{"messages":[{"role":"user","content":"Call get_weather for Singapore."}],"tools":[{"type":"function","function":{"name":"get_weather","parameters":{"type":"object","properties":{"location":{"type":"string"}},"required":["location"]}}}],"stream":true,"logprobs":true,"top_logprobs":2}Observed: HTTP 400,
logprobs is not supported with tools + stream. Replacing the last two fields with"n_probs":2returns HTTP 200, tool calls, andtop_logprobs.The explicit rejection was introduced in
f5cd27b7and runs beforetop_logprobsis converted ton_probs.