Skip to content

Latest commit

 

History

History
27 lines (21 loc) · 1.21 KB

File metadata and controls

27 lines (21 loc) · 1.21 KB

Prerequisites

Hardware

Target model Params VRAM required Minimum GPU
Gemma 3 27B-IT 27B ~55 GB 1×A100 80 GB
Mistral Small 3.1 24B 24B ~48 GB 1×A100 80 GB
Qwen 2.5 32B-IT 32B ~64 GB 1×A100 80 GB
Llama 3.1 70B-IT 70B ~140 GB 2×H100 80 GB
Qwen3-235B-A22B (data gen only) 235B MoE ~240 GB (fp8) 2×H200

Software

Accounts