Home / Models / OLMo 2 32B Instruct / NVIDIA GTX 1660 SUPER 6 GB
Can OLMo 2 32B Instruct run on NVIDIA GTX 1660 SUPER 6 GB?
No. Estimated memory for OLMo 2 32B Instruct exceeds NVIDIA GTX 1660 SUPER 6 GB, including the modeled offload allowance.
Can it run?
- Can it run?
- No (calculated estimate).
- Full GPU fit?
- No
- Model
- OLMo 2 32B Instruct · 32B
- GPU
- NVIDIA GTX 1660 SUPER 6 GB · 6 GB advertised
What else can NVIDIA GTX 1660 SUPER 6 GB run? · Find other GPUs for OLMo 2 32B Instruct · See 2× multi-GPU options
Memory calculation
Breakdown for Q4 at 4K context, batch size 1. Calculator v1.0.0.
| Model weights | 18.9 GB |
|---|---|
| KV cache | 1.0 GB |
| Runtime reserve | 1.4 GB |
| Safety margin | 0.8 GB |
| Required (estimated) | 22.2 GB |
| GPU usable VRAM | 5.4 GB |
Result: DOES NOT FIT
Quantization table
| Quantization | 2K | 4K |
|---|---|---|
| BF16 | No | No |
| FP16 | No | No |
| Q3 | No | No |
| Q4 | No | No |
| Q5 | No | No |
| Q6 | No | No |
| Q8 | No | No |
What fits entirely in VRAM?
No calculated full-VRAM fit at the evaluated quantizations and context lengths.
What requires RAM offload?
Offload is shown only when the model does not fully fit in usable VRAM but stays within the modeled offload allowance.
Performance
No llama.cpp performance result is published for this pair yet. Memory fit above is unchanged. How performance is calculated
Available graphics cards
These SKUs use this GPU chip. Amazon CTAs appear only for EXACT/HIGH matches. Absence of a price does not change the compatibility result above.
MSI VENTUS GeForce GTX 1660 SUPER XS OC NVIDIA 6 GB GDDR6
6 GB · Amazon EXACT
Check price on Amazon
ASUS TUF Gaming TUF-GTX1660S-O6G-GAMING NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon EXACT
Check price on Amazon
ASUS Dual -GTX1660S-O6G-EVO NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon EXACT
Check price on Amazon
GIGABYTE GV-N166SOC-6GD graphics card NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon EXACT
Check price on Amazon
ASUS Phoenix PH-GTX1660S-O6G NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon EXACT
Check price on Amazon
GIGABYTE GAMING GV-N166SGAMING OC-6GD graphics card NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon EXACT
Check price on Amazon
ASUS ROG -STRIX-GTX1660S-A6G-GAMING graphics card NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon EXACT
Check price on AmazonASUS TUF Gaming TUF-GTX1660S-6G-GAMING NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon unmatched
ASUS ROG GTX1660S-O6G-GAMING NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon unmatched
ASUS TUF Gaming TUF-3-GTX1660S-O6G-GAMING NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon unmatched
ASUS Dual -GTX1660S-O6G-MINI NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon unmatched
ASUS PH-GTX1660S-6G NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon unmatched
ASUS Dual -GTX1660S-6G-EVO NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon unmatched
ASUS Phoenix PH-GTX1660S-O6G NVIDIA GeForce GTX 1660 SUPER 6 GB GDDR6
6 GB · Amazon unmatched
Sources
Model: official config allenai/OLMo-2-0325-32B-Instruct (main). GPU/product specs: Icecat. Compatibility: RigForAI calculator v1.0.0 estimated VRAM · Q8 at 4K: DOES_NOT_FIT. Amazon: affiliate commerce match, not a spec source.