llama.cpp : bump version to 0.4.1

[ggerganov]

Overview

llama.cpp 0.4.1 adds Maple 20B-A1B, Tencent Hy 4, and Spark2.5 support, improves JSON schema handling, chat parsing, logging, and server child-process management, and updates ggml to v0.24.0.

API changes

• Changed llama_sampler_chain_n() to return int32_t instead of int (#28631).
• Added server_subproc and waiter for router child-process monitoring in server-common.h (#28555).

New models

• Added Maple 20B-A1B ternary MoE architecture (CPU) (#27000).
• Added Tencent Hy 4 (hy_v4) preview architecture support (#28127).
• Added Spark2.5 support (#27868).

Core changes

• Added Kimi-K3 recurrent-state rollback support (#28466).
• Fixed MTP context KV cache allocation for DeepSeek2, GLM-MoE, and related models (#28630).
• Fixed GDN normalization from max to rsqrt for affected Qwen/Kimi/GLM models (#28068).
• Fixed Granite parameter counts and Granite3 MoE unknown parameter counts (#28643, #28632).
• Fixed MIMO2 SWA pattern loading and incorrect get_key_or_arr uses (#28865, #28868).
• Added --fuse-qkv conversion flag to fuse Q/K/V tensors during HF-to-GGUF conversion (#22780).
• Wrote explicit recurrent_layers metadata for Qwen3-Next/Qwen3.5 conversion (#28208).
• Refactored JSON schema handling with a common_schema internal representation (#28736).
• Split specialized chat parsers into common/parsers (#27764).
• Added structured JSONL logging via --log-jsonl and LOG_JSON (#28437, #28586).
• Removed deprecated --mmap/--mlock/--direct-io args in favor of --load-mode (#28334).
• Made mmproj and draft devices default to the global --device selection (#28390).
• Disabled lazy tensor loading by default on iGPUs (#28326).
• Fixed speculative decoding after multimodal input and DFlash mtmd chunk decode (#28715, #28587).
• Fixed Jinja dot-property integer literals and null in membership (#28817, #28620).
• Improved grammar insert/move handling and max repetition threshold (#26885, #28469).
• Improved qwen3-coder complex-type parsing and typed content detection (#28742, #28511).
• Added PCH and unity build support to improve build times (#28091).
• Updated cpp-httplib to 0.56.0 (#28787).

Multi-modality changes

• Propagated video hash to bitmap IDs ({hash}+{frame}) for cache identification (#28601).
• Fixed DFlash speculative decoding failures on mtmd chunks (#28587).

Server changes

• Refactored server child-process handling into a single monitor thread (#28555).
• Fixed LRU hang on multiple requests for the same model (#28539).
• Allow model downloads when --models-max is already reached (#28530).
• Fixed context checkpoint eviction on prompts shorter than checkpoint_min_step (#28302).
• Fixed speculative decoding after image input (#28715).
• Frame router child state commands as whole lines (#28747).
• Enabled --reasoning-preserve by default (#28437).

UI changes

• Improved chat message rendering performance with lazy mounting and compositor-friendly animations (#28460).
• Added UI asset cache for faster builds (#28802).
• Embedded UI assets directly with CMake, removing the build-time helper (#28445).
• Fixed MCP image attachments not displayed in tool blocks (#28089).
• Export conversations from the database instead of the cached store (#27432).

ggml changes

• Bumped ggml from v0.23.0 to v0.24.0 (release).

Version 0.24.0 focuses on expanding backend coverage and robustness, with a new precision-control API, major Vulkan/SYCL/Hexagon/OpenCL work, and numerous correctness and performance fixes across CPU, CUDA, Metal, and other backends.