Home / Models / Mixtral 8x7B Instruct / NVIDIA RTX 3080 10 GB
Can Mixtral 8x7B Instruct run on NVIDIA RTX 3080 10 GB?
Can it run? Yes, with CPU/RAM offload. Full GPU fit? No.
Can it run?
- Can it run?
- Yes, with CPU/RAM offload. This is not equivalent to full-GPU inference.
- Full GPU fit?
- No
- Model
- Mixtral 8x7B Instruct · 47B
- GPU
- NVIDIA RTX 3080 10 GB · 10 GB advertised
Memory calculation
Breakdown for Q4 at 8K context, batch size 1. Calculator v1.0.0.
| Model weights | 27.4 GB |
|---|---|
| KV cache | 1.0 GB |
| Runtime reserve | 1.9 GB |
| Safety margin | 1.1 GB |
| Required (estimated) | 31.3 GB |
| GPU usable VRAM | 9.0 GB |
Result: DOES NOT FIT
Quantization table
| Quantization | 2K | 4K | 8K | 16K | 32K |
|---|---|---|---|---|---|
| BF16 | No | No | No | No | No |
| FP16 | No | No | No | No | No |
| Q3 | Offload | Offload | Offload | Offload | Offload |
| Q4 | No | No | No | No | No |
| Q5 | No | No | No | No | No |
| Q6 | No | No | No | No | No |
| Q8 | No | No | No | No | No |
What fits entirely in VRAM?
No calculated full-VRAM fit at the evaluated quantizations and context lengths.
What requires RAM offload?
Weights may run with CPU/RAM offload. That is not equivalent to full-GPU inference. RigForAI does not estimate tokens/sec in this release.
Available graphics cards
These SKUs use this GPU chip. Amazon CTAs appear only for EXACT/HIGH matches. Absence of a price does not change the compatibility result above.
ASUS TUF Gaming TUF-RTX3080-O10G-GAMING NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$1589.00
Check price on Amazon
MSI VENTUS GeForce RTX 3080 3X 10G OC NVIDIA 10 GB GDDR6X
10 GB · Amazon EXACT
$825.00
Check price on Amazon
GIGABYTE GeForce RTX 3080 VISION OC 10G NVIDIA 10 GB GDDR6X
10 GB · Amazon EXACT
$798.00
Check price on Amazon
MSI GAMING RTX 3080 X TRIO 10G graphics card NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$898.00
Check price on Amazon
GIGABYTE AORUS GV-N3080AORUS X-10GD graphics card NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$1249.00
Check price on Amazon
MSI GAMING RTX 3080 Z TRIO 10G LHR graphics card NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$785.00
Check price on Amazon
MSI SUPRIM GeForce RTX 3080 X 10G NVIDIA 10 GB GDDR6X
10 GB · Amazon EXACT
$865.00
Check price on Amazon
GIGABYTE EAGLE GV-N3080EAGLE OC-10GD graphics card NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$995.00
Check price on Amazon
MSI VENTUS GeForce RTX 3080 3X Plus 10G OC LHR NVIDIA 10 GB GDDR6X
10 GB · Amazon EXACT
$759.00
Check price on Amazon
GIGABYTE AORUS GeForce RTX™ 3080 XTREME WATERFORCE WB 10G NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$639.22
Check price on Amazon
MSI SUPRIM RTX 3080 X 10G LHR graphics card NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$699.99
Check price on Amazon
GIGABYTE AORUS GV-N3080AORUS M-10GD graphics card NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$1369.00
Check price on Amazon
ASUS ROG -STRIX-RTX3080-O10G-V2-GAMING NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$1299.00
Check price on Amazon
GIGABYTE GAMING RTX 3080 BOX NVIDIA GeForce RTX 3080 10 GB GDDR6X
10 GB · Amazon EXACT
$1552.99
Check price on Amazon
Sources
Model: official config mistralai/Mixtral-8x7B-Instruct-v0.1 (main). GPU/product specs: Icecat. Compatibility: RigForAI calculator v1.0.0 estimated VRAM · Q8 at 8K: DOES_NOT_FIT. Amazon: affiliate commerce match, not a spec source.