Home / Models / Phi-3 Medium 4K Instruct / NVIDIA RTX 4060 8 GB
Can Phi-3 Medium 4K Instruct run on NVIDIA RTX 4060 8 GB?
Can it run? Yes, with CPU/RAM offload. Full GPU fit? No.
Can it run?
- Can it run?
- Yes, with CPU/RAM offload. This is not equivalent to full-GPU inference.
- Full GPU fit?
- No
- Model
- Phi-3 Medium 4K Instruct · 14B
- GPU
- NVIDIA RTX 4060 8 GB · 8 GB advertised
Memory calculation
Breakdown for Q4 at 4K context, batch size 1. Calculator v1.0.0.
| Model weights | 8.2 GB |
|---|---|
| KV cache | 0.8 GB |
| Runtime reserve | 0.9 GB |
| Safety margin | 0.5 GB |
| Required (estimated) | 10.4 GB |
| GPU usable VRAM | 7.2 GB |
Result: CPU RAM OFFLOAD REQUIRED
Quantization table
| Quantization | 2K | 4K |
|---|---|---|
| BF16 | No | No |
| FP16 | No | No |
| Q3 | Offload | Offload |
| Q4 | Offload | Offload |
| Q5 | Offload | Offload |
| Q6 | Offload | Offload |
| Q8 | Offload | Offload |
What fits entirely in VRAM?
No calculated full-VRAM fit at the evaluated quantizations and context lengths.
What requires RAM offload?
Weights may run with CPU/RAM offload. That is not equivalent to full-GPU inference. RigForAI does not estimate tokens/sec in this release.
Available graphics cards
These SKUs use this GPU chip. Amazon CTAs appear only for EXACT/HIGH matches. Absence of a price does not change the compatibility result above.
GIGABYTE GeForce RTX 4060 WINDFORCE OC 8G NVIDIA 8 GB GDDR6
8 GB · Amazon EXACT
$499.88
Check price on Amazon
GIGABYTE EAGLE GeForce RTX 4060 OC 8G NVIDIA 8 GB GDDR6
8 GB · Amazon EXACT
$695.00
Check price on Amazon
ASUS Dual -RTX4060-O8G-EVO NVIDIA GeForce RTX 4060 8 GB GDDR6
8 GB · Amazon EXACT
$387.22
Check price on Amazon
ASUS Dual -RTX4060-O8G NVIDIA GeForce RTX 4060 8 GB GDDR6
8 GB · Amazon EXACT
$569.99
Check price on Amazon
ASUS Dual -RTX4060-O8G-WHITE NVIDIA GeForce RTX 4060 8 GB GDDR6
8 GB · Amazon EXACT
$383.22
Check price on Amazon
MSI VENTUS GeForce RTX 4060 2X WHITE 8G OC NVIDIA 8 GB GDDR6
8 GB · Amazon EXACT
$389.99
Check price on Amazon
ASUS ProArt -RTX4060-O8G NVIDIA GeForce RTX 4060 8 GB GDDR6
8 GB · Amazon EXACT
Check price on Amazon
GIGABYTE GeForce RTX 4060 OC Low Profile 8G NVIDIA 8 GB GDDR6
8 GB · Amazon EXACT
Check price on Amazon
MSI GAMING GEFORCE RTX 4060 X 8G graphics card NVIDIA 8 GB GDDR6
8 GB · Amazon EXACT
Check price on Amazon
GIGABYTE AERO GeForce RTX 4060 OC 8G NVIDIA 8 GB GDDR6
8 GB · Amazon unmatched
MSI VENTUS GEFORCE RTX 4060 2X BLACK 8G OC graphics card NVIDIA 8 GB GDDR6
8 GB · Amazon unmatched
Sources
Model: official config microsoft/Phi-3-medium-4k-instruct (main). GPU/product specs: Icecat. Compatibility: RigForAI calculator v1.0.0 estimated VRAM · Q8 at 4K: CPU_RAM_OFFLOAD_REQUIRED. Amazon: affiliate commerce match, not a spec source.