Home / Find a GPU
Deterministic VRAM fit · not a benchmark
Find a GPU for your AI model
Choose a model, quantization and context size. The calculator returns GPUs that can hold the estimated memory entirely in VRAM, then maps those chips to real product SKUs and Amazon listings. This does not rank speed.
I already have a GPU — see which models it can run · Compare value metrics · GPUs under a budget · Build a PC · Workstations · Rent a server · Buy vs rent
Assumptions used
- Model
- Code Llama 7B Instruct
- Quantization
- Q4 (default for this form)
- Context
- 8K (default for this form)
- Required VRAM
- 9.0 GB
75 canonical GPUs fit entirely in VRAM under these assumptions.
Cheapest GPU for Code Llama 7B Instruct · Open value explorer · Build a PC · Workstations · Rent a server · Buy vs rent
Lowest-cost full-VRAM option
Sorted by lowest current Amazon price among GPUs that fit entirely in VRAM. This is not a performance ranking.
NVIDIA
NVIDIA Tesla K40 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 1 Amazon-matched
- Amazon
- $268.96 current Amazon price
NVIDIA
NVIDIA RTX 3060 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 28 mapped · 14 Amazon-matched
- Amazon
- $319.99 current Amazon price
NVIDIA
NVIDIA Quadro P5000 16 GB
- GPU VRAM
- 16 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 14.4 GB
- VRAM headroom
- 5.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 5 mapped · 3 Amazon-matched
- Amazon
- $330.99 current Amazon price
NVIDIA
NVIDIA RTX 3080 Ti 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 13 mapped · 7 Amazon-matched
- Amazon
- $584.99 current Amazon price
NVIDIA
NVIDIA RTX 5000 16 GB
- GPU VRAM
- 16 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 14.4 GB
- VRAM headroom
- 5.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 1 Amazon-matched
- Amazon
- $596.99 current Amazon price
AMD
AMD Radeon RX 7600 XT 16 GB
- GPU VRAM
- 16 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 14.4 GB
- VRAM headroom
- 5.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 3 mapped · 1 Amazon-matched
- Amazon
- $599.00 current Amazon price
AMD
AMD Radeon RX 7700 XT 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 3 mapped · 1 Amazon-matched
- Amazon
- $628.00 current Amazon price
AMD
AMD Radeon RX 6800 16 GB
- GPU VRAM
- 16 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 14.4 GB
- VRAM headroom
- 5.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 5 mapped · 3 Amazon-matched
- Amazon
- $629.99 current Amazon price
NVIDIA
NVIDIA Quadro P6000 24 GB
- GPU VRAM
- 24 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 21.6 GB
- VRAM headroom
- 12.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 3 mapped · 2 Amazon-matched
- Amazon
- $646.96 current Amazon price
NVIDIA
NVIDIA RTX A2000 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 3 mapped · 1 Amazon-matched
- Amazon
- $661.92 current Amazon price
NVIDIA
NVIDIA RTX 4070 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 18 mapped · 9 Amazon-matched
- Amazon
- $669.22 current Amazon price
NVIDIA
NVIDIA RTX 2060 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 4 mapped · 1 Amazon-matched
- Amazon
- $695.00 current Amazon price
More VRAM headroom
Sorted by leftover usable VRAM after the calculated requirement. Headroom is not tokens/sec.
NVIDIA
NVIDIA B200 192 GB
- GPU VRAM
- 192 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 172.8 GB
- VRAM headroom
- 163.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA H200 141 GB
- GPU VRAM
- 141 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 126.9 GB
- VRAM headroom
- 117.9 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA GH200 96 GB
- GPU VRAM
- 96 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 86.4 GB
- VRAM headroom
- 77.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX PRO 6000 Blackwell 96 GB
- GPU VRAM
- 96 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 86.4 GB
- VRAM headroom
- 77.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA H100 NVL 94 GB
- GPU VRAM
- 94 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 84.6 GB
- VRAM headroom
- 75.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA H100 80 GB
- GPU VRAM
- 80 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 72.0 GB
- VRAM headroom
- 63.0 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA A100 80 GB
- GPU VRAM
- 80 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 72.0 GB
- VRAM headroom
- 63.0 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX 8000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 34.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX A6000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 34.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX 6000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 34.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 1 Amazon-matched
- Amazon
- $20888.00 current Amazon price
NVIDIA
NVIDIA L40S 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 34.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA L40 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 34.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
Other compatible GPUs
NVIDIA
NVIDIA GTX 1080 Ti 11 GB
- GPU VRAM
- 11 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 9.9 GB
- VRAM headroom
- 0.9 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 16 mapped · 2 Amazon-matched
- Amazon
- Check price on Amazon
NVIDIA
NVIDIA RTX 4500 24 GB
- GPU VRAM
- 24 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 21.6 GB
- VRAM headroom
- 12.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX 3090 24 GB
- GPU VRAM
- 24 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 21.6 GB
- VRAM headroom
- 12.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 18 mapped · 9 Amazon-matched
- Amazon
- $1347.22 current Amazon price
NVIDIA
NVIDIA RTX 4070 Ti 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 17 mapped · 10 Amazon-matched
- Amazon
- $777.00 current Amazon price
NVIDIA
NVIDIA RTX 5000 32 GB
- GPU VRAM
- 32 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 28.8 GB
- VRAM headroom
- 19.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 1 Amazon-matched
- Amazon
- $4479.96 current Amazon price
NVIDIA
NVIDIA RTX 5070 Ti 16 GB
- GPU VRAM
- 16 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 14.4 GB
- VRAM headroom
- 5.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 9 mapped · 9 Amazon-matched
- Amazon
- $1049.99 current Amazon price
NVIDIA
NVIDIA RTX 5070 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 9 mapped · 9 Amazon-matched
- Amazon
- $799.99 current Amazon price
NVIDIA
NVIDIA Quadro K6000 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA Tesla K40C 12 GB
- GPU VRAM
- 12 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 10.8 GB
- VRAM headroom
- 1.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA Tesla K80 24 GB
- GPU VRAM
- 24 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 21.6 GB
- VRAM headroom
- 12.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA Quadro M6000 24 GB
- GPU VRAM
- 24 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 21.6 GB
- VRAM headroom
- 12.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 1 Amazon-matched
- Amazon
- $3498.02 current Amazon price
NVIDIA
NVIDIA Tesla M60 16 GB
- GPU VRAM
- 16 GB advertised
- Required VRAM
- 9.0 GB
- Usable GPU VRAM
- 14.4 GB
- VRAM headroom
- 5.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 0 Amazon-matched
- Amazon
- Check availability
Compare two of these GPUs
Opens the comparison for the same model, quantization and context. Does not change the buying ranking above.