Home / Models / Magistral Small
Magistral Small
24B parameters · native context 40,960 · mistral
Estimated VRAM requirement
Weight memory uses parameter count × bits per weight, plus a quantization overhead factor. KV cache uses standard GQA formulas. Values are calculated estimates, not measured allocations.
| Quantization | Estimated weights | 2K total | 4K total | 8K total | 16K total | 32K total | 40K total |
|---|---|---|---|---|---|---|---|
| FP16 | 44.8 GB | 49.4 GB | 49.7 GB | 50.4 GB | 51.6 GB | 54.1 GB | 55.4 GB |
| Q8 | 25.2 GB | 28.3 GB | 28.6 GB | 29.2 GB | 30.5 GB | 33.0 GB | 34.2 GB |
| Q6 | 19.6 GB | 22.3 GB | 22.6 GB | 23.2 GB | 24.4 GB | 26.9 GB | 28.2 GB |
| Q5 | 16.6 GB | 19.0 GB | 19.3 GB | 19.9 GB | 21.2 GB | 23.7 GB | 24.9 GB |
| Q4 | 13.8 GB | 16.0 GB | 16.3 GB | 16.9 GB | 18.2 GB | 20.7 GB | 21.9 GB |
| Q3 | 11.0 GB | 13.0 GB | 13.3 GB | 13.9 GB | 15.2 GB | 17.7 GB | 18.9 GB |
Find a GPU for this model
Run at the quantization and context selected below. Defaults are Q4 and 8K when you do not change the controls. Results are full-VRAM fits only — not a speed ranking.
- Run at
- Q4 · 8K context
- Required VRAM
- 16.9 GB
No fresh matched Amazon price is currently available for a full-VRAM fit. See compatible GPUs · Workstations · Rent a server · Buy vs rent.
Lowest-cost full-VRAM option
Sorted by lowest current Amazon price among GPUs that fit entirely in VRAM. This is not a performance ranking.
No compatible GPU currently has a fresh Amazon price.
More VRAM headroom
Sorted by leftover usable VRAM after the calculated requirement. Headroom is not tokens/sec.
NVIDIA B200 192 GB
- GPU VRAM
- 192 GB advertised
- Required VRAM
- 16.9 GB
- Usable GPU VRAM
- 172.8 GB
- VRAM headroom
- 155.9 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA H200 141 GB
- GPU VRAM
- 141 GB advertised
- Required VRAM
- 16.9 GB
- Usable GPU VRAM
- 126.9 GB
- VRAM headroom
- 110.0 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA GH200 96 GB
- GPU VRAM
- 96 GB advertised
- Required VRAM
- 16.9 GB
- Usable GPU VRAM
- 86.4 GB
- VRAM headroom
- 69.5 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
Other compatible GPUs
NVIDIA RTX 4500 24 GB
- GPU VRAM
- 24 GB advertised
- Required VRAM
- 16.9 GB
- Usable GPU VRAM
- 21.6 GB
- VRAM headroom
- 4.7 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA RTX 3090 24 GB
- GPU VRAM
- 24 GB advertised
- Required VRAM
- 16.9 GB
- Usable GPU VRAM
- 21.6 GB
- VRAM headroom
- 4.7 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 18 mapped · 9 Amazon-matched
- Amazon
- Check price on Amazon
NVIDIA RTX 5000 32 GB
- GPU VRAM
- 32 GB advertised
- Required VRAM
- 16.9 GB
- Usable GPU VRAM
- 28.8 GB
- VRAM headroom
- 11.9 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 1 Amazon-matched
- Amazon
- Check price on Amazon
Compatible GPUs
Status is a calculated memory fit against usable VRAM (advertised × 0.9). Open a GPU to see product SKUs and Amazon listings.
Compare GPUs for this model
Published chip comparisons where both GPUs fully fit this model at Q4 / 8K. Opens with this model preselected; that query is not indexed.
Sources
Model specifications: official repository mistralai/Magistral-Small-2506 · revision main. Compatibility: RigForAI calculator v1.0.0 (estimated VRAM). GPU products: Icecat. Amazon is a separate affiliate match and is not used as a spec source.