Skip to content

docs : decode MoE look-ahead expert prefetch design - #125

Open
ddvnguyen wants to merge 4 commits into
baseline-flash-nextfrom
docs/moe-lookahead-design
Open

ddvnguyen wants to merge 4 commits into
baseline-flash-nextfrom
docs/moe-lookahead-design

Conversation

@ddvnguyen

Copy link
Copy Markdown
Owner

Design note only, no code. Preview of the decode look-ahead expert prefetch port (colibri PILOT + FreeToken cache/overlap), the two proposed halves (consumer stub + graph-level producer P1), invariants, and the validation plan.

Please review the approach and scope before I implement.

@ddvnguyen
ddvnguyen force-pushed the docs/moe-lookahead-design branch from 47e60bf to 6523a8e Compare September 13, 2026 14:12
@ddvnguyen
ddvnguyen changed the base branch from feat/763-reconcile-qwen4exp-mtp to baseline-flash-next September 13, 2026 14:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant