Alibaba (Qwen)
Qwen3-32B
32.8 B params · 40960 context · Open weights
Released 2025-04-27
Details
API pricing
No hosted API price verified. Open-weight models can be self-hosted.
Running it locally
Memory needed for 32.762 B parameters at 8,192 tokens of context. Architecture not recorded, so a flat 1.0 GB KV allowance is used. Estimates, not measurements.
| Format | Weights | KV cache | Overhead | Total |
|---|---|---|---|---|
| Q4 K_M | 20.0 GB | 1.0 GB | 1.5 GB | 22.5 GB |
| Q6 K | 26.9 GB | 1.0 GB | 1.8 GB | 29.7 GB |
| Q8 0 | 34.8 GB | 1.0 GB | 2.2 GB | 38.1 GB |
| FP16 | 65.5 GB | 1.0 GB | 3.8 GB | 70.3 GB |
Catalogued hardware that fits at Q4
- NVIDIA GeForce RTX 5090comfortable
- NVIDIA RTX PRO 4500 Blackwellcomfortable
- NVIDIA GeForce RTX 4090tight
- NVIDIA RTX PRO 4000 Blackwelltight
- AMD Radeon RX 7900 XTXtight
- GMKtec EVO-X3 (Ryzen AI Max+ 395)comfortable
- Beelink GTR9 Pro (Ryzen AI Max+ 395)comfortable
- OneXPlayer OneXStation i1comfortable
- Beelink GTi15 Ultra (Core Ultra 9 285H)comfortable
- Minisforum MS-02 Ultracomfortable
- Beelink SEi14 (Core Ultra 9 185H)comfortable
- Beelink SER9 Pro (Ryzen AI 9 HX 370)tight
- Framework Desktopcomfortable
- Apple Mac mini (M5 Pro)comfortable
- Apple Mac mini (M6)tight
- ASUS NUC 14 Procomfortable
- ASUS NUC 15 Procomfortable
Mini PCs reserve 8.0 GB for the operating system. “Comfortable” keeps at least 10% memory spare.
Benchmarks
No benchmarks for this model yet
We only publish results we can evidence, so there is nothing here yet and we have not filled the gap with estimates. Here is how we will test and label results.