Home / Models / Mixtral 8x7B Instruct
Mixtral 8x7B Instruct
47B parameters · 13B active · native context 32,768 · mixtral
Estimated VRAM requirement
Weight memory uses parameter count × bits per weight, plus a quantization overhead factor. KV cache uses standard GQA formulas. Values are calculated estimates, not measured allocations.
| Quantization | Estimated weights | 2K total | 4K total | 8K total | 16K total | 32K total |
|---|---|---|---|---|---|---|
| FP16 | 88.7 GB | 96.8 GB | 97.1 GB | 97.6 GB | 98.6 GB | 100.6 GB |
| Q8 | 49.9 GB | 54.9 GB | 55.2 GB | 55.7 GB | 56.7 GB | 58.7 GB |
| Q6 | 38.9 GB | 43.0 GB | 43.2 GB | 43.7 GB | 44.7 GB | 46.7 GB |
| Q5 | 32.9 GB | 36.5 GB | 36.8 GB | 37.3 GB | 38.3 GB | 40.3 GB |
| Q4 | 27.4 GB | 30.6 GB | 30.8 GB | 31.3 GB | 32.3 GB | 34.3 GB |
| Q3 | 21.9 GB | 24.6 GB | 24.9 GB | 25.4 GB | 26.4 GB | 28.4 GB |
Find a GPU for this model
Run at the quantization and context selected below. Defaults are Q4 and 8K when you do not change the controls. Results are full-VRAM fits only — not a speed ranking.
- Run at
- Q4 · 8K context
- Required VRAM
- 31.3 GB
Lowest-cost full-VRAM option
Sorted by lowest current Amazon price among GPUs that fit entirely in VRAM. This is not a performance ranking.
No compatible GPU currently has a fresh Amazon price.
More VRAM headroom
Sorted by leftover usable VRAM after the calculated requirement. Headroom is not tokens/sec.
NVIDIA RTX 6000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 31.3 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 11.9 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 0 Amazon-matched
- Amazon
- Check price on Amazon
NVIDIA RTX 8000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 31.3 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 11.9 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA RTX A6000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 31.3 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 11.9 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 0 Amazon-matched
- Amazon
- Check availability
Compatible GPUs
Status is a calculated memory fit against usable VRAM (advertised × 0.9). Open a GPU to see product SKUs and Amazon listings.
Sources
Model specifications: official repository mistralai/Mixtral-8x7B-Instruct-v0.1 · revision main. Compatibility: RigForAI calculator v1.0.0 (estimated VRAM). GPU products: Icecat. Amazon is a separate affiliate match and is not used as a spec source.