Smoothquant for Phi2 and Qwen2 - #22

Open

ponytaill wants to merge 2 commits into

AniZpZ:mainfrom

ponytaill:smoothquant_phi2_qwen2

Commits on May 18, 2024

Added Smoothquant support for Phi2 and Qwen2 models, and added ppl_eval.py to test results more easily (there were a few issues here that prevented me from using eval_model.py in examples)
ponytaill
committed
1e5e4cc
Added Smoothquant support for Phi2 and Qwen2 models, and added ppl_eval.py to test results more easily (there were a few issues here that prevented me from using eval_model.py in examples)
ponytaill
committed
fd3e1d9