Home / Servers / 8× NVIDIA H100 80 GB

Canonical hardware · not a commercial offer

8× NVIDIA H100 80 GB

2015 GB system RAM · Platinum 8480+

Hardware

GPU
NVIDIA H100 80 GB
GPU count
8
VRAM per GPU
80 GB advertised
Aggregate VRAM
640.0 GB advertised
System RAM
2015 GB
CPU
Platinum 8480+
Storage
2 × 960 GB NVME
Network
15360 public

AI memory capability

Default catalog below is Q4 at 8K. Statuses reuse Phase 2 (1 GPU) or Phase 8 (2–4 identical GPUs). GPU counts above 4 are not modeled. Public wording is memory-capable, not serving throughput.

Memory-capable at Q4/8K: 0 published models

Serving performance

Measured vLLM serving results for this GPU identity (8× NVIDIA H100 80 GB), not a specific rental host. Tensor parallel size is stored explicitly and is not assumed equal to GPU count. Request rate is separate from concurrency; this corpus is closed-loop / max-concurrency.

No measured vLLM serving rows map to this GPU count yet.

Current rental offers

ProviderLocationPriceStock
Vultr$16074/month · $0 setupNot listed as availableProvider

Want to own the hardware? Build a PC · Prefer a prebuilt? Workstations