Home / Multi-GPU
llama.cpp · homogeneous 2–4 GPUs · not a PC builder
Can this model run across multiple GPUs?
Phase 8 answers memory feasibility for identical cards under llama.cpp. Default split is layer (pipeline parallel: each GPU owns a slice of layers; KV stays with those layers). This is not 2 × VRAM = pool, and it is not a complete PC build.
Cheapest current GPU-only multi-GPU configuration in RigForAI
Homogeneous llama.cpp layer configs that fully fit, among cards with a fresh matched Amazon offer. Cost = GPU count × current per-card price. This is not a complete build and does not prove that N units are in stock.
No fully fitting priced multi-GPU configuration in the current Amazon cache — every published GPU already fully fits this workload on one card, so dual-GPU is not required.
Query combinations are not indexed. Source: llama.cpp multi-GPU documentation.