Skip to content

Fail to Export InternVL3 AWQ Checkpoints #162

Open
Open
Fail to Export InternVL3 AWQ Checkpoints#162
Labels
bugSomething isn't working

Description

@FABallemand
FABallemand
opened on Aug 5, 2026

Describe the bug

Exporting the officially supported InternVL3 AWQ VLM checkpoints fails. The Hugging Face checkpoints contain only .bin weight files and no .safetensors files. During export, TensorRT Edge-LLM attempts to load .safetensors and fails with:

XX:XX:XX  INFO      tensorrt_edgellm.scripts.export: Loading safetensors weights ...
XX:XX:XX  ERROR     tensorrt_edgellm.scripts.export: No safetensors files found in /root/.cache/huggingface/hub/models--OpenGVLab--InternVL3-XXX/snapshots/xxx

I reproduced this with all InternVL3 models listed in the TensorRT Edge-LLM 0.9.1 Supported Models documentation:

  • InternVL3-1B-AWQ -> ❌ export
  • InternVL3-2B-AWQ -> ❌ export
  • InternVL3-8B-AWQ -> ❌ export
  • InternVL3-14B-AWQ -> ❌ export

Steps/Code to reproduce bug

Installation method:
As described in TensorRT Edge-LLM on Jetson, I used an NVIDIA Jetson Thor as both the host and target device. I installed TensorRT Edge-LLM v0.9.1 by following the Installation Guide. The installation completed successfully without any issues.

$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Wed_Jul_16_07:31:19_PM_PDT_2025
Cuda compilation tools, release 13.0, V13.0.48
Build cuda_13.0.r13.0/compiler.36260728_0

$ nvidia-smi
Mon Jul 27 08:52:49 2026
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 580.00                 Driver Version: 580.00         CUDA Version: 13.0     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA Thor                    Off |   00000000:01:00.0 Off |                  N/A |
| N/A   36C  N/A               3W /  N/A  | Not Supported          |      0%      Default |
|                                         |                        |             Disabled |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A           15507      G   /usr/lib/xorg/Xorg                       92MiB |
|    0   N/A  N/A           15707      G   /usr/bin/gnome-shell                     55MiB |
+-----------------------------------------------------------------------------------------+

$ python3 --version
Python 3.12.3

$ cat /etc/nv_tegra_release
# R38 (release), REVISION: 4.0, GCID: 43443517, BOARD: generic, EABI: aarch64, DATE: Wed Dec 31 00:15:19 UTC 2025
# KERNEL_VARIANT: oot
TARGET_USERSPACE_LIB_DIR=nvidia
TARGET_USERSPACE_LIB_DIR_PATH=usr/lib/aarch64-linux-gnu/nvidia
INSTALL_TYPE=

Export command used:
I use the following command to export models:

tensorrt-edgellm-export path/to/model_name model_name/onnx

For instance:

tensorrt-edgellm-export OpenGVLab/InternVL3-1B-AWQ InternVL3-1B-AWQ/onnx
Details 
08:34:34  INFO      tensorrt_edgellm.scripts.export: Downloading OpenGVLab/InternVL3-1B-AWQ from Hugging Face Hub ...
08:34:34  INFO      httpx: HTTP Request: GET https://huggingface.co/api/models/OpenGVLab/InternVL3-1B-AWQ/revision/main "HTTP/1.1 200 OK"

Fetching 19 files:   0%|          | 0/19 [00:00<?, ?it/s]
Fetching 19 files: 100%|██████████| 19/19 [00:00<00:00, 6966.67it/s]
08:34:34  INFO      tensorrt_edgellm.scripts.export: ============================================================
08:34:34  INFO      tensorrt_edgellm.scripts.export: Model type    : internvl_chat
08:34:34  INFO      tensorrt_edgellm.scripts.export: Checkpoint    : /root/.cache/huggingface/hub/models--OpenGVLab--InternVL3-1B-AWQ/snapshots/d323c423ab714aac211522751b6cd96dc9dbeab3
08:34:34  INFO      tensorrt_edgellm.scripts.export: Output dir    : InternVL3-1B-AWQ/onnx
08:34:34  INFO      tensorrt_edgellm.scripts.export:   thinker        : yes
08:34:34  INFO      tensorrt_edgellm.scripts.export:   mtp_draft      : no
08:34:34  INFO      tensorrt_edgellm.scripts.export:   mtp_draft      : no
08:34:34  INFO      tensorrt_edgellm.scripts.export:   dflash_draft   : no
08:34:34  INFO      tensorrt_edgellm.scripts.export:   talker         : no
08:34:34  INFO      tensorrt_edgellm.scripts.export:   code_predictor : no
08:34:34  INFO      tensorrt_edgellm.scripts.export:   visual         : yes
08:34:34  INFO      tensorrt_edgellm.scripts.export:   audio          : no
08:34:34  INFO      tensorrt_edgellm.scripts.export:   code2wav       : no
08:34:34  INFO      tensorrt_edgellm.scripts.export:   action         : no
08:34:34  INFO      tensorrt_edgellm.scripts.export: FP8 embedding : no
08:34:34  INFO      tensorrt_edgellm.scripts.export: MTP capable   : no
08:34:34  INFO      tensorrt_edgellm.scripts.export: MTP export    : no
08:34:34  INFO      tensorrt_edgellm.scripts.export: Gemma4 MTP    : no
08:34:34  INFO      tensorrt_edgellm.scripts.export: DFlash base   : no
08:34:34  INFO      tensorrt_edgellm.scripts.export: DFlash draft  : no
08:34:34  INFO      tensorrt_edgellm.scripts.export: Reduced vocab : no
08:34:34  INFO      tensorrt_edgellm.scripts.export: External weights: no
08:34:34  INFO      tensorrt_edgellm.scripts.export: TP size       : 1
08:34:34  INFO      tensorrt_edgellm.scripts.export: ============================================================
08:34:34  INFO      tensorrt_edgellm.scripts.export: [LLM] Loading checkpoint from /root/.cache/huggingface/hub/models--OpenGVLab--InternVL3-1B-AWQ/snapshots/d323c423ab714aac211522751b6cd96dc9dbeab3
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:34  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:36  INFO      tensorrt_edgellm.checkpoint.loader: Stripping key prefix 'language_model.' from checkpoint keys (inserting '')
08:34:36  INFO      tensorrt_edgellm.checkpoint.loader: Loaded 627 tensors, skipped 346 from /root/.cache/huggingface/hub/models--OpenGVLab--InternVL3-1B-AWQ/snapshots/d323c423ab714aac211522751b6cd96dc9dbeab3
08:34:41  INFO      tensorrt_edgellm.checkpoint.repacking: Repacked GPTQ weights
08:34:41  INFO      tensorrt_edgellm.scripts.export: [LLM] Exporting to InternVL3-1B-AWQ/onnx/llm/model.onnx
08:34:41  INFO      tensorrt_edgellm.onnx.export: Exporting ONNX to InternVL3-1B-AWQ/onnx/llm/model.onnx (opset 24, dynamo) ...
/usr/lib/python3.12/contextlib.py:144: UserWarning: The tensor attribute self._model.model.last_pre_norm_hidden_states was assigned during export. Such attributes must be registered as buffers using the `register_buffer` API (https://pytorch.org/docs/stable/generated/torch.nn.Module.html#torch.nn.Module.register_buffer).
  next(self.gen)
/usr/lib/python3.12/copyreg.py:99: FutureWarning: `isinstance(treespec, LeafSpec)` is deprecated, use `isinstance(treespec, TreeSpec) and treespec.is_leaf()` instead.
  return cls.__new__(cls, *args)
08:34:50  INFO      onnx_ir.passes.common.unused_removal: No unused functions to remove
08:34:50  INFO      onnx_ir.passes.common.unused_removal: Removed 169 unused nodes
08:34:50  INFO      onnx_ir.passes.common.unused_removal: No unused functions to remove
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'node_Shape_0' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'node_Shape_1' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'node__to_copy' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_4' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'node_add_79' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_12' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_20' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_28' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_36' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_44' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_52' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_60' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_68' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_76' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_84' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_92' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_100' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_108' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_116' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_124' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_132' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_140' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_148' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_156' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_164' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_172' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_180' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_188' because it is graph input to preserve graph signature
08:34:50  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n1' because it is graph input to preserve graph signature
08:34:51  INFO      onnx_ir.passes.common.unused_removal: Removed 124 unused nodes
08:34:51  INFO      onnxscript.rewriter: Applied 48 of general pattern rewrite rules.
08:34:51  INFO      onnx_ir.passes.common.unused_removal: No unused functions to remove
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'node_Shape_0' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'node_Shape_1' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'node__to_copy' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_4' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'node_add_79' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_12' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_20' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_28' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_36' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_44' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_52' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_60' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_68' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_76' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_84' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_92' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_100' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_108' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_116' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_124' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_132' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_140' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_148' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_156' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_164' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_172' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_180' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n0_188' because it is graph input to preserve graph signature
08:34:51  INFO      onnxscript.optimizer._constant_folding: Skipping constant folding for node 'n1' because it is graph input to preserve graph signature
08:34:51  INFO      onnx_ir.passes.common.unused_removal: Removed 48 unused nodes
08:34:51  INFO      onnx_ir.passes.common.unused_removal: No unused functions to remove
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_15' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_20' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_29' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_34' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_43' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_48' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_57' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_62' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_71' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_76' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_85' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_90' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_99' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_104' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_113' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_118' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_127' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_132' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_141' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_146' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_155' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_160' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_169' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_174' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_183' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_188' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_197' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_202' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_211' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_216' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_225' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_230' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_239' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_244' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_253' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_258' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_267' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_272' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_281' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_286' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_295' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_300' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_309' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_314' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_323' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_328' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_337' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_342' with existing initializer 'val_5'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_13' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_18' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_25' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_27' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_32' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_39' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_41' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_46' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_53' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_55' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_60' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_67' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_69' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_74' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_81' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_83' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_88' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_95' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_97' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_102' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_109' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_111' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_116' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_123' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_125' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_130' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_137' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_139' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_144' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_151' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_153' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_158' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_165' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_167' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_172' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_179' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_181' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_186' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_193' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_195' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_200' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_207' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_209' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_214' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_221' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_223' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_228' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_235' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_237' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_242' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_249' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_251' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_256' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_263' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_265' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_270' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_277' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_279' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_284' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_291' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_293' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_298' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_305' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_307' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_312' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_319' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_321' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_326' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_333' with existing initializer 'val_11'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_335' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'val_340' with existing initializer 'val_2'
08:34:51  INFO      onnx_ir.passes.common.initializer_deduplication: Replaced initializer 'axes' with existing initializer 'val_5'
/workspace/TensorRT-Edge-LLM/host_venv/lib/python3.12/site-packages/torch/onnx/_internal/exporter/_onnx_program.py:486: UserWarning: # The axis name: batch will not be used, since it shares the same shape constraints with another axis: batch.
  rename_mapping = _dynamic_shapes.create_rename_mapping(
/workspace/TensorRT-Edge-LLM/host_venv/lib/python3.12/site-packages/torch/onnx/_internal/exporter/_onnx_program.py:486: UserWarning: # The axis name: past_len will not be used, since it shares the same shape constraints with another axis: past_len.
  rename_mapping = _dynamic_shapes.create_rename_mapping(
08:34:56  INFO      tensorrt_edgellm.onnx.export: Export complete: InternVL3-1B-AWQ/onnx/llm/model.onnx
08:34:56  INFO      tensorrt_edgellm.checkpoint.checkpoint_utils: Wrote config.json to /workspace/tensorrt-edgellm-workspace/VLM/InternVL3-1B-AWQ/onnx/llm
08:34:56  INFO      tensorrt_edgellm.checkpoint.checkpoint_utils: Wrote embedding.safetensors ([151674, 896])
08:34:56  INFO      tensorrt_edgellm.checkpoint.checkpoint_utils: Copied tokenizer.json
08:34:56  INFO      tensorrt_edgellm.checkpoint.checkpoint_utils: Copied tokenizer_config.json
08:34:56  INFO      tensorrt_edgellm.checkpoint.checkpoint_utils: Copied special_tokens_map.json
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:56  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
[transformers] The tokenizer you are loading from '/root/.cache/huggingface/hub/models--OpenGVLab--InternVL3-1B-AWQ/snapshots/d323c423ab714aac211522751b6cd96dc9dbeab3' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v2
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 12
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_config is None. Initializing the InternVisionConfig with default values.
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: llm_config is None. Initializing the LlamaConfig config with default values (`LlamaConfig`).
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: vision_select_layer: -1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: ps_version: v1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: min_dynamic_patch: 1
08:34:57  INFO      transformers_modules.d323c423ab714aac211522751b6cd96dc9dbeab3.a40a8077023874e9.configuration_internvl_chat: max_dynamic_patch: 6
08:34:57  INFO      tensorrt_edgellm.chat_template: Chat template saved to /workspace/tensorrt-edgellm-workspace/VLM/InternVL3-1B-AWQ/onnx/llm/processed_chat_template.json
08:34:57  INFO      tensorrt_edgellm.scripts.export: [LLM] Patched multimodal token IDs: image_token_id=151655
08:34:57  INFO      tensorrt_edgellm.scripts.export: [LLM] Done: InternVL3-1B-AWQ/onnx/llm/model.onnx
08:34:57  INFO      tensorrt_edgellm.scripts.export: Loading safetensors weights ...
08:34:57  ERROR     tensorrt_edgellm.scripts.export: No safetensors files found in /root/.cache/huggingface/hub/models--OpenGVLab--InternVL3-1B-AWQ/snapshots/d323c423ab714aac211522751b6cd96dc9dbeab3
[torch.onnx] Obtain model graph for `_Wrapper([...]` with `torch.export.export(..., strict=False)`...
[torch.onnx] Obtain model graph for `_Wrapper([...]` with `torch.export.export(..., strict=False)`... ✅
[torch.onnx] Run decompositions...
[torch.onnx] Run decompositions... ✅
[torch.onnx] Translate the graph into ONNX...
[torch.onnx] Translate the graph into ONNX... ✅
[torch.onnx] Optimize the ONNX graph...
[torch.onnx] Optimize the ONNX graph... ✅

System information (Nvidia Jetson Thor)

  • Container used: nvcr.io/nvidia/pytorch:25.12-py3
  • OS: Ubuntu 24.04.3 LTS
  • CPU architecture: aarch64
  • GPU name: Nvidia Jetson T5000
  • GPU memory size: 128 GB
  • Number of GPUs: 1
  • Library versions:
    • Python: 3.12.3
    • TensorRT Edge-LLM version: 0.9.1
    • CUDA: 13.1
    • PyTorch: 2.12.0+cu130
    • Transformers: 5.9.0
    • ModelOpt: 0.44.0
    • ONNX: 1.19.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions