ggml-cuda: add dequant-float matvec (mmvdq) for Q4_K/Q5_K/Q6_K on RDN…#61
Open
Annieren wants to merge 1 commit into
Open
ggml-cuda: add dequant-float matvec (mmvdq) for Q4_K/Q5_K/Q6_K on RDN…#61Annieren wants to merge 1 commit into
Annieren wants to merge 1 commit into
