feat: batch a request's chunks through turbo in one forward pass (~2x) - #161

Open

malammar wants to merge 4 commits into

devnen:mainfrom

malammar:upstream-pr/chunk-batching

Commits on Jul 25, 2026

fix: bound the voice conditioning cache to stop it exhausting VRAM

malammar
and
claude
committed

Commits on Jul 30, 2026

fix: make the voice cache LRU thread-safe

malammar
and
claude
committed
feat: batch a request's chunks through turbo in one forward pass

malammar
and
claude
committed
fix: close a conds race and an unguarded index in chunk batching

malammar
and
claude
committed