Home / Multi-GPU

llama.cpp · homogeneous 2–4 GPUs · not a PC builder

Can this model run across multiple GPUs?

Phase 8 answers memory feasibility for identical cards under llama.cpp. Default split is layer (pipeline parallel: each GPU owns a slice of layers; KV stays with those layers). This is not 2 × VRAM = pool, and it is not a complete PC build.

Cheapest current GPU-only multi-GPU configuration in RigForAI

Homogeneous llama.cpp layer configs that fully fit, among cards with a fresh matched Amazon offer. Cost = GPU count × current per-card price. This is not a complete build and does not prove that N units are in stock.

No fully fitting priced multi-GPU configuration in the current Amazon cache.

Feasible — current price unavailable

Query combinations are not indexed. Source: llama.cpp multi-GPU documentation.