Skip to content

ggml-cuda: GEMM weight row padding + one-time K-padded f16 dequant for prefill#57

Draft
roberteg16 wants to merge 3 commits into
gfx11from
rogarcia.cuda-gemm-pad-prefill-dequant
Draft

ggml-cuda: GEMM weight row padding + one-time K-padded f16 dequant for prefill#57
roberteg16 wants to merge 3 commits into
gfx11from
rogarcia.cuda-gemm-pad-prefill-dequant

ggml-cuda: build the prefill-dequant f16 shadow at load time

4f74777
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar