Converter: per-tensor-type mixed precision (int8 for shared/o_proj/kv_b_proj, int4 rest) - #243
Closed
woolcoxm wants to merge 1 commit into
Closed
Converter: per-tensor-type mixed precision (int8 for shared/o_proj/kv_b_proj, int4 rest)#243woolcoxm wants to merge 1 commit into
woolcoxm wants to merge 1 commit into
