Home / Servers / 8× NVIDIA A100 80 GB
Canonical hardware · not a commercial offer
8× NVIDIA A100 80 GB
2048 GB system RAM · Platinum 8480+
Hardware
- GPU
- NVIDIA A100 80 GB
- GPU count
- 8
- VRAM per GPU
- 80 GB advertised
- Aggregate VRAM
- 640.0 GB advertised
- System RAM
- 2048 GB
- CPU
- Platinum 8480+
- Storage
- 4 × 960 GB NVME
- Network
- 15360 public
AI memory capability
Default catalog below is Q4 at 8K. Statuses reuse Phase 2 (1 GPU) or Phase 8 (2–4 identical GPUs). GPU counts above 4 are not modeled. Public wording is memory-capable, not serving throughput.
Memory-capable at Q4/8K: 0 published models
Serving performance
Measured vLLM serving results for this GPU identity (8× NVIDIA A100 80 GB), not a specific rental host. Tensor parallel size is stored explicitly and is not assumed equal to GPU count. Request rate is separate from concurrency; this corpus is closed-loop / max-concurrency.
No measured vLLM serving rows map to this GPU count yet.
Current rental offers
| Provider | Location | Price | Stock | |
|---|---|---|---|---|
| Vultr | US | $15053/month · $0 setup | Listed as available | Provider |
| Vultr | DE | $15053/month · $0 setup | Listed as available | Provider |
Want to own the hardware? Build a PC · Prefer a prebuilt? Workstations