Home / Find a GPU
Deterministic VRAM fit · not a benchmark
Find a GPU for your AI model
Choose a model, quantization and context size. The calculator returns GPUs that can hold the estimated memory entirely in VRAM, then maps those chips to real product SKUs and Amazon listings. This does not rank speed.
I already have a GPU — see which models it can run · Compare value metrics · GPUs under a budget · Build a PC · Workstations · Rent a server · Buy vs rent
Assumptions used
- Model
- Code Llama 34B Instruct
- Quantization
- Q4 (default for this form)
- Context
- 8K (default for this form)
- Required VRAM
- 23.6 GB
18 canonical GPUs fit entirely in VRAM under these assumptions.
Cheapest GPU for Code Llama 34B Instruct · Open value explorer · Build a PC · Workstations · Rent a server · Buy vs rent
Lowest-cost full-VRAM option
Sorted by lowest current Amazon price among GPUs that fit entirely in VRAM. This is not a performance ranking.
NVIDIA
NVIDIA RTX 5000 32 GB
- GPU VRAM
- 32 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 28.8 GB
- VRAM headroom
- 5.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 1 Amazon-matched
- Amazon
- $4479.96 current Amazon price
NVIDIA
NVIDIA RTX 5090 32 GB
- GPU VRAM
- 32 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 28.8 GB
- VRAM headroom
- 5.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 8 mapped · 8 Amazon-matched
- Amazon
- $4699.99 current Amazon price
NVIDIA
NVIDIA RTX 6000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 1 Amazon-matched
- Amazon
- $20888.00 current Amazon price
More VRAM headroom
Sorted by leftover usable VRAM after the calculated requirement. Headroom is not tokens/sec.
NVIDIA
NVIDIA B200 192 GB
- GPU VRAM
- 192 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 172.8 GB
- VRAM headroom
- 149.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA H200 141 GB
- GPU VRAM
- 141 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 126.9 GB
- VRAM headroom
- 103.3 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA GH200 96 GB
- GPU VRAM
- 96 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 86.4 GB
- VRAM headroom
- 62.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX PRO 6000 Blackwell 96 GB
- GPU VRAM
- 96 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 86.4 GB
- VRAM headroom
- 62.8 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA H100 NVL 94 GB
- GPU VRAM
- 94 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 84.6 GB
- VRAM headroom
- 61.0 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA H100 80 GB
- GPU VRAM
- 80 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 72.0 GB
- VRAM headroom
- 48.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA A100 80 GB
- GPU VRAM
- 80 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 72.0 GB
- VRAM headroom
- 48.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX 8000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX A6000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX 6000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 1 Amazon-matched
- Amazon
- $20888.00 current Amazon price
NVIDIA
NVIDIA L40S 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA L40 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
Other compatible GPUs
NVIDIA
NVIDIA Tesla M10 32 GB
- GPU VRAM
- 32 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 28.8 GB
- VRAM headroom
- 5.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA Quadro GV100 32 GB
- GPU VRAM
- 32 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 28.8 GB
- VRAM headroom
- 5.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 1 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA RTX A6000 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 2 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA A100 40 GB
- GPU VRAM
- 40 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 36.0 GB
- VRAM headroom
- 12.4 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA L40S 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA L40 48 GB
- GPU VRAM
- 48 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 43.2 GB
- VRAM headroom
- 19.6 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
NVIDIA
NVIDIA Tesla V100S 32 GB
- GPU VRAM
- 32 GB advertised
- Required VRAM
- 23.6 GB
- Usable GPU VRAM
- 28.8 GB
- VRAM headroom
- 5.2 GB — leftover usable memory after the calculated requirement, not a speed ranking
- Compatible
- Yes — fits entirely in VRAM
- Product SKUs
- 0 mapped · 0 Amazon-matched
- Amazon
- Check availability
Compare two of these GPUs
Opens the comparison for the same model, quantization and context. Does not change the buying ranking above.