Any plans to upstream maple arch? a 128 group size ternay quant would be nice too, but we can live with q2_0 for now. Oh yea I saw your weights, did you try converting to q2_0 ?
Any plans to upstream maple arch?
a 128 group size ternay quant would be nice too, but we can live with q2_0 for now.
Oh yea I saw your weights, did you try converting to q2_0 ?