Home / Models / Yi 1.5 34B Chat / NVIDIA RTX 2060 6 GB

Calculated memory fit · not a benchmark

Can Yi 1.5 34B Chat run on NVIDIA RTX 2060 6 GB?

No. Estimated memory for Yi 1.5 34B Chat exceeds NVIDIA RTX 2060 6 GB, including the modeled offload allowance.

Can it run?

Can it run?
No (calculated estimate).
Full GPU fit?
No
Model
Yi 1.5 34B Chat · 34B
GPU
NVIDIA RTX 2060 6 GB · 6 GB advertised

Memory calculation

Breakdown for Q4 at 4K context, batch size 1. Calculator v1.0.0.

Model weights20.2 GB
KV cache0.9 GB
Runtime reserve1.5 GB
Safety margin0.9 GB
Required (estimated)23.5 GB
GPU usable VRAM5.4 GB

Result: DOES NOT FIT

Quantization table

Quantization2K4K
BF16NoNo
FP16NoNo
Q3NoNo
Q4NoNo
Q5NoNo
Q6NoNo
Q8NoNo

What fits entirely in VRAM?

No calculated full-VRAM fit at the evaluated quantizations and context lengths.

What requires RAM offload?

Offload is shown only when the model does not fully fit in usable VRAM but stays within the modeled offload allowance.

Available graphics cards

These SKUs use this GPU chip. Amazon CTAs appear only for EXACT/HIGH matches. Absence of a price does not change the compatibility result above.

Check price on Amazon

GIGABYTE

GIGABYTE GeForce RTX 2060 WINDFORCE OC 6G

6 GB · Amazon unmatched

Check availability
MSI

MSI GAMING GeForce RTX 2060 Z 6G

6 GB · Amazon unmatched

Check availability
MSI

MSI VENTUS GeForce RTX 2060 XS 6G OC

6 GB · Amazon unmatched

Check availability
ASUS

ASUS Dual -RTX2060-O6G NVIDIA GeForce RTX 2060 6 GB GDDR6

6 GB · Amazon unmatched

Check availability
MSI

MSI VENTUS GeForce RTX 2060 6G OC

6 GB · Amazon unmatched

Check availability
GIGABYTE

GIGABYTE Geforce RTX 2060 MINI ITX OC 6G

6 GB · Amazon unmatched

Check availability

Sources

Model: official config 01-ai/Yi-1.5-34B-Chat (main). GPU/product specs: Icecat. Compatibility: RigForAI calculator v1.0.0 estimated VRAM · Q8 at 4K: DOES_NOT_FIT. Amazon: affiliate commerce match, not a spec source.