Skip to content

Examples.torch.quantize ERROR #4095

Description

@bqFirst

Issue Description:

When I run python -m Examples.torch.quantize, I get the following error:

RuntimeError: Failed to run QuantizeDequantize since quantization parameters are not initialized. Please initialize the quantization parameters using compute_encodings().

After I call compute_encodings() before _prefill_inputs, the problem disappears.

Is this a bug?

Metadata

Metadata

Labels

aimet-torchNew feature or bug fix for AIMET PyTorchllm

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions