What can a Tesla P40 24GB run?
24GB · 346 GB/s · 250W · $150
The thrift-shop datacenter relic — noisy and fanless-by-default, but 24 GB for the price of a steak.
Runs great21
Comfortable headroom — daily-driver territory.
| Model | Quant | Est. speed | Max context |
|---|---|---|---|
| deepseek moe 16b chat | FP16 | Infinity tok/s | — |
| qwen2 7b instruct | FP16 | Infinity tok/s | — |
| Qwen3-0.6B | FP16 | 173 tok/s | 33k |
| GPT-OSS-20B | Q5_K_M | 84 tok/s | 48k |
| Gemma-3n-E4B | FP16 | 77 tok/s | 131k |
| SmolLM2-1.7B | FP16 | 63 tok/s | 8k |
| Llama-3.2-3B | FP16 | 33 tok/s | 131k |
| Phi-4-mini | FP16 | 28 tok/s | 131k |
| Mistral-7B-Instruct | Q8_0 | 28 tok/s | 33k |
| Gemma-3-4B | FP16 | 28 tok/s | 131k |
| Qwen3-4B | FP16 | 27 tok/s | 33k |
| DeepSeek-R1-Distill-Qwen-7B | Q8_0 | 27 tok/s | 122k |
| Qwen2.5-Coder-7B | Q8_0 | 27 tok/s | 122k |
| Llama-3.1-8B | Q8_0 | 25 tok/s | 118k |
| Qwen3-8B | Q8_0 | 25 tok/s | 33k |
| Phi-4-14B | Q6_K | 18 tok/s | 16k |
| DeepSeek-R1-Distill-Qwen-14B | Q6_K | 18 tok/s | 73k |
| Codestral-22B | Q4_K_M | 16 tok/s | 33k |
| Mistral-Small-24B | MLX 4-bit | 16 tok/s | 55k |
| Gemma-3-12B | Q8_0 | 16 tok/s | 63k |
| Qwen3-14B | Q6_K | 15 tok/s | 33k |
Tight squeeze9
It fits, but close the browser tabs and mind the context.
| Model | Quant | Est. speed | Max context |
|---|---|---|---|
| Qwen3-30B-A3B | Q4_K_M | 107 tok/s | 21k |
| Qwen3-Coder-30B-A3B | Q4_K_M | 107 tok/s | 21k |
| Gemma-3-27B | Q5_K_M | 11 tok/s | 17k |
| Qwen3.8 | Q5_K_M | 11 tok/s | 17k |
| Qwen3.8 27B | Q5_K_M | 11 tok/s | 17k |
| qwen35 27B | Q5_K_M | 11 tok/s | 16k |
| DeepSeek-R1-Distill-Qwen-32B | Q4_K_M | 11 tok/s | 12k |
| GLM-4-32B | Q4_K_M | 11 tok/s | 12k |
| Qwen3-32B | Q4_K_M | 11 tok/s | 13k |
Measured on this card0
Everything here was benchmarked on this exact card by someone who owns one — the tables above are our arithmetic; these numbers came off real machines.
Nobody has measured anything on this card yet. Paste a benchmark — it takes one keystroke and no form.