Head to head
RTX 4090 vs Radeon RX 7900 XTX
Both hold 24 GB, so capacity is a wash. The RTX 4090 has more bandwidth at 1008 GB/s, which decides how fast tokens come out once a model fits.
| Model (Q4_K_M, 8K) | RTX 4090 | tok/s | Radeon RX 7900 XTX | tok/s |
|---|---|---|---|---|
| Llama 3.1 8B | Runs comfortably | 116 | Runs comfortably | 105 |
| Llama 3.1 70B | Won't fit | 1.60 | Won't fit | 1.52 |
| Llama 3.2 3B | Runs comfortably | 254 | Runs comfortably | 230 |
| Llama 3.2 1B | Runs comfortably | 669 | Runs comfortably | 609 |
| Llama 4 Scout 109B-A17B | Won't fit | 5.18 | Won't fit | 4.91 |
| Qwen3 8B | Runs comfortably | 112 | Runs comfortably | 101 |
| Qwen3 14B | Runs comfortably | 65.5 | Runs comfortably | 59.3 |
| Qwen3 32B | Fits, but tight | 30.5 | Fits, but tight | 27.6 |
| Qwen3 4B | Runs comfortably | 202 | Runs comfortably | 183 |
| Qwen3 30B-A3B | Runs comfortably | 118 | Runs comfortably | 112 |
| Qwen3 235B-A22B | Won't fit | 3.23 | Won't fit | 3.07 |
| Qwen2.5-Coder 32B | Fits, but tight | 30.5 | Fits, but tight | 27.6 |
| Qwen2.5 7B | Runs comfortably | 128 | Runs comfortably | 116 |
| Qwen2.5 72B | Won't fit | 1.53 | Won't fit | 1.44 |
| Gemma 3 4B | Runs comfortably | 215 | Runs comfortably | 196 |
| Gemma 3 12B | Runs comfortably | 78.5 | Runs comfortably | 71.1 |
Specifications
| RTX 4090 | Radeon RX 7900 XTX | |
|---|---|---|
| Memory | 24 GB | 24 GB |
| Bandwidth | 1008 GB/s | 960 GB/s |
| FP16 compute | 165 TFLOPS | 123 TFLOPS |
| Launch price | $1,599 | $999 |
| Architecture | Ada | RDNA3 |