Head to head

RTX 4090 vs RTX 4060 Ti 16GB

The RTX 4090 holds more — 24 GB against 16 GB — which decides what you can load at all. The RTX 4090 has more bandwidth at 1008 GB/s, which decides how fast tokens come out once a model fits.

Model (Q4_K_M, 8K)RTX 4090tok/sRTX 4060 Ti 16GBtok/s
Llama 3.1 8B Runs comfortably 116 Runs comfortably 33.6
Llama 3.1 70B Won't fit 1.60 Won't fit 1.17
Llama 3.2 3B Runs comfortably 254 Runs comfortably 74.8
Llama 3.2 1B Runs comfortably 669 Runs comfortably 200
Llama 4 Scout 109B-A17B Won't fit 5.18 Won't fit 4.28
Qwen3 8B Runs comfortably 112 Runs comfortably 32.5
Qwen3 14B Runs comfortably 65.5 Runs comfortably 18.9
Qwen3 32B Fits, but tight 30.5 Won't fit 3.71
Qwen3 4B Runs comfortably 202 Runs comfortably 59.6
Qwen3 30B-A3B Runs comfortably 118 Won't fit 32.0
Qwen3 235B-A22B Won't fit 3.23 Won't fit 3.01
Qwen2.5-Coder 32B Fits, but tight 30.5 Won't fit 3.71
Qwen2.5 7B Runs comfortably 128 Runs comfortably 37.3
Qwen2.5 72B Won't fit 1.53 Won't fit 1.13
Gemma 3 4B Runs comfortably 215 Runs comfortably 63.6
Gemma 3 12B Runs comfortably 78.5 Runs comfortably 22.8

Specifications

RTX 4090RTX 4060 Ti 16GB
Memory24 GB16 GB
Bandwidth1008 GB/s288 GB/s
FP16 compute165 TFLOPS44 TFLOPS
Launch price$1,599$499
ArchitectureAdaAda