Blazing Local Inference: Hitting 176 t/s Decode and 6,450 t/s Prefill with Dual R9700s and Radiance

The local LLM hardware landscape moves fast, but every so often a combination of specialized software and consumer-adjacent hardware shifts the baseline of what is possible at home. A recent build shared on the r/LocalLLaMA community showcases eye-watering performance: 176 tokens/second decode and…










