Home / Models / Mistral Small 3.2 24B Instruct / NVIDIA RTX 4060 Ti 16 GB

Calculated memory fit · performance is a separate section

Can Mistral Small 3.2 24B Instruct run on NVIDIA RTX 4060 Ti 16 GB?

Yes. Calculated memory fit: Mistral Small 3.2 24B Instruct can run entirely in this GPU’s usable VRAM at one or more supported quantizations.

Can it run?

Can it run?: Yes, full GPU fit (calculated estimate).
Full GPU fit?: Yes
Model: Mistral Small 3.2 24B Instruct · 24B
GPU: NVIDIA RTX 4060 Ti 16 GB · 16 GB advertised

What else can NVIDIA RTX 4060 Ti 16 GB run? · Find other GPUs for Mistral Small 3.2 24B Instruct

Memory calculation

Breakdown for Q4 at 8K context, batch size 1. Calculator v1.0.0.

Model weights	14.1 GB
KV cache	1.3 GB
Runtime reserve	1.2 GB
Safety margin	0.7 GB
Required (estimated)	17.2 GB
GPU usable VRAM	14.4 GB

Result: CPU RAM OFFLOAD REQUIRED

Quantization table

Quantization	2K	4K	8K	16K	32K	64K	128K
BF16	No	No	No	No	No	No	No
FP16	No	No	No	No	No	No	No
Q3	Fits	Fits	Fits	Limited context	Limited context	Limited context	Limited context
Q4	Offload	Offload	Offload	Offload	Offload	Offload	Offload
Q5	Offload	Offload	Offload	Offload	Offload	Offload	Offload
Q6	Offload	Offload	Offload	Offload	Offload	Offload	Offload
Q8	Offload	Offload	Offload	Offload	Offload	Offload	Offload

What fits entirely in VRAM?

Q3 at 2K context
Q3 at 4K context
Q3 at 8K context

What requires RAM offload?

Offload is shown only when the model does not fully fit in usable VRAM but stays within the modeled offload allowance.

Performance

No llama.cpp performance result is published for this pair yet. Memory fit above is unchanged. How performance is calculated

Available graphics cards

These SKUs use this GPU chip. Amazon CTAs appear only for EXACT/HIGH matches. Absence of a price does not change the compatibility result above.

Check price on Amazon

MSI

MSI GAMING GEFORCE RTX 4060 Ti X SLIM 16G graphics card NVIDIA 16 GB GDDR6

16 GB · Amazon EXACT

$1364.00

Check price on Amazon

GIGABYTE

GIGABYTE AERO GeForce RTX 4060 Ti OC NVIDIA 16 GB GDDR6

16 GB · Amazon EXACT

$1439.22

Check price on Amazon

MSI

MSI VENTUS GEFORCE RTX 4060 TI 2X BLACK 16G OC graphics card NVIDIA 16 GB GDDR6

16 GB · Amazon EXACT

Check price on Amazon

MSI

MSI VENTUS GEFORCE RTX 4060 TI 3X 16G OC graphics card NVIDIA 16 GB GDDR6

16 GB · Amazon EXACT

Check price on Amazon

ASUS

ASUS Dual -RTX4060TI-A16G NVIDIA GeForce RTX 4060 Ti 16 GB GDDR6

16 GB · Amazon EXACT

Check price on Amazon

ASUS

ASUS ProArt -RTX4060TI-O16G NVIDIA GeForce RTX 4060 Ti 16 GB GDDR6

16 GB · Amazon unmatched

Check availability

ASUS

ASUS Dual -RTX4060TI-O16G NVIDIA GeForce RTX 4060 Ti 16 GB GDDR6

16 GB · Amazon unmatched

Check availability

GIGABYTE

GIGABYTE GAMING GeForce RTX 4060 Ti OC 16G NVIDIA 16 GB GDDR6

16 GB · Amazon unmatched

Check availability

MSI

MSI GAMING GEFORCE RTX 4060 TI X 16G graphics card NVIDIA 16 GB GDDR6

16 GB · Amazon unmatched

Check availability

MSI

MSI GAMING GeForce RTX 4060 Ti X SLIM WHITE 16G NVIDIA 16 GB GDDR6

16 GB · Amazon unmatched

Check availability

GIGABYTE

GIGABYTE GeForce RTX 4060 Ti WINDFORCE OC 16G Graphics Card - 16GB GDDR6, 128bit, PCI-E 4.0, 2565MHz Core Clock, 2 x DisplayPort 1.4a, 2 x HDMI 2.1a, NVIDIA DLSS 3, GV-N406TWF2OC-16GD

16 GB · Amazon unmatched

Check availability

Sources

Model: official config mistralai/Mistral-Small-3.2-24B-Instruct-2506 (main). GPU/product specs: Icecat. Compatibility: RigForAI calculator v1.0.0 estimated VRAM · Q8 at 8K: CPU_RAM_OFFLOAD_REQUIRED. Amazon: affiliate commerce match, not a spec source.