Skip to content

run lpbq demo Qwen2.5-0.5B-Instruct convert qnn cpp crash #4091

Description

@guxiangtao

python3 -m Examples.onnx.quantize --model-id /model/Qwen2.5-0.5B-Instruct --recipe "lpbq_seqmse" --export-path "./onnx_lpbq" --seqmse-num-batches 1 --calib-num-batches 1
${QNN_SDK_ROOT}/bin/x86_64-linux-clang/qnn-onnx-converter --input_network onnx_lpbq/model_cl4096.onnx --quantization_overrides onnx_lpbq/model_cl4096.encodings --input_list raw/input_list.txt

part log:
the flag --use_dynamic_16_bit weights to honour the override.
442939.0ms [ INFO ] Freeing graphsInfo
442939.1ms [WARNING] Profile Logger with name = defaultKey doesn't exist! Returning nullptr
442956.8ms [ INFO ] [QNN_CPU] QnnContext Free start
443688.2ms [ INFO ] [QNN_CPU] QnnContext Free end
443671.4ms [WARNING] Profile Logger with name = defaultKey doesn't exist!
443689.1ms [ INFO ] [QNN_CPU] QnnBackend Free start
443689.3ms [ INFO ] [QNN_CPU] QnnBackend Free end
2026-04-14 08:33:15,453 - 278 - INFO - Saving QNN Model...
2026-04-14 08:33:16,216 - 273 - ERROR - Encountered Error: map::at: key not found
Traceback (most recent call last):
File "qnn_sdk_v2.42.0_auto_lnx/bin/x86_64-linux-clang/qnn-onnx-converter", line 80, in main
backend.save(optimized_graph)
File "qnn_sdk_v2.42.0_auto_lnx/lib/python/qti/aisw/converters/backend/ir_to_qnn.py", line 705, in save
self.save_to_cpp(ir_graph)
File "qnn_sdk_v2.42.0_auto_lnx/lib/python/qti/aisw/converters/backend/ir_to_qnn.py", line 614, in save_to_cpp
raise e
File "qnn_sdk_v2.42.0_auto_lnx/lib/python/qti/aisw/converters/backend/ir_to_qnn.py", line 579, in save_to_cpp
self.model.serialize(ir_graph, self)
IndexError: map::at: key not found

Metadata

Metadata

Labels

aimet-onnxNew feature or bug fix for AIMET ONNXdocumentationImprovements or additions to documentationllm

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions