Skip to content

Run M.O.G.-SEC-27B-1M-CTX on Modal: fp8 KV cache + deployment - #1

Open
Jackson57279 wants to merge 2 commits into
mainfrom
feat/modal-deploy-fp8-kv
Open

Run M.O.G.-SEC-27B-1M-CTX on Modal: fp8 KV cache + deployment#1
Jackson57279 wants to merge 2 commits into
mainfrom
feat/modal-deploy-fp8-kv

feat(kvcache): decouple KV cache dtype from compute dtype; Modal depl…

3f81bba
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar