- I executed the following command:
python examples/basic_quant_mix.py --model_path /model/Qwen/qwen2-7b-instruct --quant_file /export_model/quantquik4/qwen2-7b-instruct --w_bit 4
Traceback (most recent call last):
File "/new_code/QComplier/src/examples/basic_quant_mix.py", line 7, in
from mixquant import AutoForCausalLM
ModuleNotFoundError: No module named 'mixquant'
pip install mixquant
ERROR: Could not find a version that satisfies the requirement mixquant (from versions: none)
ERROR: No matching distribution found for mixquant
How do you install mixquant?
python examples/basic_quant_mix.py --model_path /model/Qwen/qwen2-7b-instruct --quant_file /export_model/quantquik4/qwen2-7b-instruct --w_bit 4Traceback (most recent call last):
File "/new_code/QComplier/src/examples/basic_quant_mix.py", line 7, in
from mixquant import AutoForCausalLM
ModuleNotFoundError: No module named 'mixquant'
pip install mixquantERROR: Could not find a version that satisfies the requirement mixquant (from versions: none)
ERROR: No matching distribution found for mixquant
How do you install mixquant?