8× NVIDIA RTX 5080 16 GB

Hardware

GPU

NVIDIA RTX 5080 16 GB

GPU count

8

VRAM per GPU

16.0 GB advertised

Aggregate VRAM

128.0 GB advertised

System RAM

252 GB

CPU

AMD EPYC 7502 32-Core Processor

Storage

1386.4 GB SSD

Network

861.1 down · 933 up

AI memory capability

Default catalog below is Q4 at 8K. Statuses reuse Phase 2 (1 GPU) or Phase 8 (2–4 identical GPUs). GPU counts above 4 are not modeled. Public wording is memory-capable, not serving throughput.

Memory-capable at Q4/8K: 0 published models

Serving performance

Measured vLLM serving results for this GPU identity (8× NVIDIA RTX 5080 16 GB), not a specific rental host. Tensor parallel size is stored explicitly and is not assumed equal to GPU count. Request rate is separate from concurrency; this corpus is closed-loop / max-concurrency.

No measured vLLM serving rows map to this GPU count yet.

Current rental offers

No fresh rental offers for this configuration right now. Historical snapshots are retained.