Building a 4x R9700 setup for a 10 person startup
Just wanted to share a build I am doing for a client.
Key points
- 4x AMD Radeon R9700 AI Pro 32gb(128gb total VRAM)
- 1600W PSU(GPUs are undervolted and under 210w each)
- Engine: using a fork of Radiance to serve Qwen 3.8 Next flash/27b and DSV4 Flash
- 900 t/s - 80t/s aggregate decode(range: 4k - 128k context each)
Sources (1)
- [1]Building a 4x R9700 setup for a 10 person startupr/LocalLLaMA (top, daily) · Oct 11, 12:20 AM
Just wanted to share a build I am doing for a client.
4x AMD Radeon R9700 AI Pro 32gb(128gb total VRAM)
Extractive summary: sentences quoted from the sources.