Home / Servers / 8× NVIDIA L40S 48 GB
Canonical hardware · not a commercial offer
8× NVIDIA L40S 48 GB
2048 GB system RAM · Gold 6448H
Hardware
- GPU
- NVIDIA L40S 48 GB
- GPU count
- 8
- VRAM per GPU
- 48 GB advertised
- Aggregate VRAM
- 384.0 GB advertised
- System RAM
- 2048 GB
- CPU
- Gold 6448H
- Storage
- 2 × 480 GB SSD
- Network
- 15360 public
AI memory capability
Default catalog below is Q4 at 8K. Statuses reuse Phase 2 (1 GPU) or Phase 8 (2–4 identical GPUs). GPU counts above 4 are not modeled. Public wording is memory-capable, not serving throughput.
Memory-capable at Q4/8K: 0 published models
Serving performance
Measured vLLM serving results for this GPU identity (8× NVIDIA L40S 48 GB), not a specific rental host. Tensor parallel size is stored explicitly and is not assumed equal to GPU count. Request rate is separate from concurrency; this corpus is closed-loop / max-concurrency.
No measured vLLM serving rows map to this GPU count yet.
Current rental offers
| Provider | Location | Price | Stock | |
|---|---|---|---|---|
| Vultr | — | $12000/month · $0 setup | Not listed as available | Provider |
Want to own the hardware? Build a PC · Prefer a prebuilt? Workstations