docs: explain local model context sizing - #913
Open
ousamabenyounes wants to merge 2 commits into
Open
Conversation
Contributor
Greptile SummaryThis documentation update explains local-model context sizing and management.
Confidence Score: 3/5The documentation should be corrected before merging because its custom 64k Ollama example can cause Strix to budget against a 200k fallback and compact too late. The newly recommended custom model name may not resolve through model metadata, while the documented configuration leaves Strix's 200k fallback unchanged despite configuring Ollama for only 65,536 tokens. Files Needing Attention: docs/llm-providers/local.mdx Important Files Changed
Prompt To Fix All With AIFix the following 1 code review issue. Work through them one at a time, proposing concise fixes.
---
### Issue 1 of 1
docs/llm-providers/local.mdx:61-65
**Fallback exceeds Ollama context**
When the custom `qwen3-vl-64k` name is not present in LiteLLM's model metadata, Strix budgets against its 200,000-token fallback rather than Ollama's 65,536-token window, delaying compaction until requests exceed the server limit and produce context-overflow or lost-state behavior.
```suggestion
```bash
ollama create qwen3-vl-64k -f Modelfile
export STRIX_LLM="ollama/qwen3-vl-64k"
export LLM_API_BASE="http://localhost:11434"
export STRIX_CONTEXT_FALLBACK_TOKENS="65536"
```
```
Reviews (1): Last reviewed commit: "docs: explain local model context sizing" | Re-trigger Greptile |
Contributor
Author
|
Fixed Greptile feedback in Change:
Validation:
|
ousamabenyounes
force-pushed
the
docs/issue-286-local-context
branch
from
July 27, 2026 20:37
b2e7441 to
88c9465
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Validation
git diff --check-> passedCloses #286