Head to head
RTX 4090 vs RTX 4070 Ti Super
The RTX 4090 holds more — 24 GB against 16 GB — which decides what you can load at all. The RTX 4090 has more bandwidth at 1008 GB/s, which decides how fast tokens come out once a model fits.
| Model (Q4_K_M, 8K) | RTX 4090 | tok/s | RTX 4070 Ti Super | tok/s |
|---|---|---|---|---|
| Llama 3.1 8B | Runs comfortably | 116 | Runs comfortably | 77.6 |
| Llama 3.1 70B | Won't fit | 1.60 | Won't fit | 1.22 |
| Llama 3.2 3B | Runs comfortably | 254 | Runs comfortably | 172 |
| Llama 3.2 1B | Runs comfortably | 669 | Runs comfortably | 456 |
| Llama 4 Scout 109B-A17B | Won't fit | 5.18 | Won't fit | 4.42 |
| Qwen3 8B | Runs comfortably | 112 | Runs comfortably | 75.1 |
| Qwen3 14B | Runs comfortably | 65.5 | Runs comfortably | 43.9 |
| Qwen3 32B | Fits, but tight | 30.5 | Won't fit | 4.34 |
| Qwen3 4B | Runs comfortably | 202 | Runs comfortably | 137 |
| Qwen3 30B-A3B | Runs comfortably | 118 | Won't fit | 40.2 |
| Qwen3 235B-A22B | Won't fit | 3.23 | Won't fit | 3.05 |
| Qwen2.5-Coder 32B | Fits, but tight | 30.5 | Won't fit | 4.34 |
| Qwen2.5 7B | Runs comfortably | 128 | Runs comfortably | 86.3 |
| Qwen2.5 72B | Won't fit | 1.53 | Won't fit | 1.18 |
| Gemma 3 4B | Runs comfortably | 215 | Runs comfortably | 146 |
| Gemma 3 12B | Runs comfortably | 78.5 | Runs comfortably | 52.7 |
Specifications
| RTX 4090 | RTX 4070 Ti Super | |
|---|---|---|
| Memory | 24 GB | 16 GB |
| Bandwidth | 1008 GB/s | 672 GB/s |
| FP16 compute | 165 TFLOPS | 88 TFLOPS |
| Launch price | $1,599 | $799 |
| Architecture | Ada | Ada |