cuda(quant): Q2_K CPU dequant + Q3_K / Q4_1 / Q5_1 CPU+CUDA dequant - #161

cuda(quant): Q2_K CPU dequant + Q3_K / Q4_1 / Q5_1 CPU+CUDA dequant#161

jamesburton wants to merge 3 commits into

kkokosa:mainkkokosa/dotLLM:mainfrom

jamesburton:issue/156-q2k-cpu-q3k-q41-q51-dequantjamesburton/dotLLM:issue/156-q2k-cpu-q3k-q41-q51-dequantCopy head branch name to clipboard