Inference QWen3 with PyTorch

This repo provides a simple example of how to run inference with the QWen3 model using PyTorch.

Usage:

Clone the repo:

git clone https://github.com/fengwang/qwen3-torch

Download model weights from huggingface.co:

cd qwen3-torch
git clone https://huggingface.co/Qwen/Qwen3-4B-Thinking-2507

Make sure you have the required packages installed:

• PyTorch
• Safetensors
• Tokenizers
• jinja2

Run the example inference script:

python3 qwen3_torch.py