Best hardware for Devstral Small 2 24B
24B parameters · mistral family : per-quant VRAM needs, the used-GPU configs that fit, and how buying compares with renting cloud GPUs. Hardware costs sum the cheapest listings that passed our trust screen, one per card the config needs (screened, not guaranteed). Eligible purchases are covered by the eBay Money Back Guarantee if an item never arrives or doesn't match its description.
Q4_K_M
Minimum VRAM: 17.02 GB (file 14.3 GB + context/runtime headroom at 8k ctx; see methodology).
Cheapest fitting cloud offer: Vast.ai $0.122/hr (rtx-3090 class, on-demand) · cloud prices checked 2026-08-02.
| Config | Total VRAM | Cheapest screened hw cost | Est. watts | Tokens/sec | Breakeven vs cloud | Verdict |
|---|---|---|---|---|---|---|
| 1× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 24 GB | $270
report
400 feedback (100%) · no returns · listed 4 days | 325 W | – | 25 mo | Renting wins at 40 h/mo |
| 2× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 48 GB | $550 2 screened listings: $270 + $280 + shipping unknown on 1 of 2 listings
report
400 feedback (100%) · no returns · listed 4 days | 575 W | – | 125 mo | Renting wins at 40 h/mo |
| 1× NVIDIA TITAN RTX | 24 GB | $850
report
12,733 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 355 W | – | 74 mo | Renting wins at 40 h/mo |
| 1× AMD Radeon RX 7900 XTX | 24 GB | $898
report
2,597 feedback (99.6%) · Top Rated seller · returns accepted · listed 2 days | 430 W | – | 141 mo | Renting wins at 40 h/mo |
| 4× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 96 GB | $1,140 4 screened listings: $270 + $280 + $290 + $300 + shipping unknown on 2 of 4 listings
report
400 feedback (100%) · no returns · listed 4 days | 1075 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 3090 | 24 GB | $1,180
report
164,757 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 425 W | – | 162 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3090 Ti | 24 GB | $1,350
report
5,792 feedback (99.8%) · Top Rated seller · returns accepted · listed 2 days | 525 W | – | 288 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A5000 | 24 GB | $2,140
report
39,358 feedback (99.7%) · Top Rated seller · returns accepted · listed 22 days | 305 W | – | 242 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 3090 | 48 GB | $2,405 2 screened listings: $1,180 + $1,225 + shipping unknown on 1 of 2 listings
report
164,757 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 775 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 4090 | 24 GB | $2,499
report
4,692 feedback (99.9%) · Top Rated seller · returns accepted · listed 15 days | 525 W | – | 495 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A6000 | 48 GB | $3,520
report
164,767 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 375 W | – | 370 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5090 | 32 GB | $4,200
report
470 feedback (100%) · Top Rated seller · returns accepted · listed 22 days | 650 W | – | 1,838 mo | Renting wins at 40 h/mo |
| 4× NVIDIA GeForce RTX 3090 | 96 GB | $4,890 4 screened listings: $1,180 + $1,225 + $1,240 + $1,245 + shipping unknown on 1 of 4 listings
report
164,757 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 1475 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA GeForce RTX 4090 | 48 GB | $4,999 2 screened listings: $2,499 + $2,500
report
4,692 feedback (99.9%) · Top Rated seller · returns accepted · listed 15 days | 975 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA RTX A6000 | 96 GB | $7,140 2 screened listings: $3,520 + $3,620
report
164,767 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 675 W | – | 3,410 mo | Renting wins at 40 h/mo |
Fits, but not currently buyable as a set: 2× NVIDIA RTX A5000 (48 GB) needs 2 screened cards and the market has 1; 4× NVIDIA RTX A5000 (96 GB) needs 4 screened cards and the market has 1. We price a multi-card build from that many separate listings, so it stays unpriced until they exist.
- Configs without a screened purchase option are hidden until listings clear the trust screen (a multi-day survival window on eBay).
- Multi-card costs are the sum of that many separate screened listings; the cheapest listing counted twice is not a price anyone can pay. Prices exclude the PSU, board and case a multi-card build usually also needs.
- Tokens/sec: benchmarks coming; every number will be source-linked. We never publish unattributed performance figures.
- Breakeven and verdict use default assumptions (40 h/mo, $0.16/kWh, 24-month horizon, resale at 65% of median ask); adjust them in the calculator. Hardware links are screened, not guaranteed.
Run your own numbers for Devstral Small 2 24B (Q4_K_M) in the buy-vs-rent calculator →
Q8_0
Minimum VRAM: 28.36 GB (file 25.1 GB + context/runtime headroom at 8k ctx; see methodology).
Cheapest fitting cloud offer: Vast.ai $0.308/hr (rtx-5090 class, on-demand) · cloud prices checked 2026-08-02.
| Config | Total VRAM | Cheapest screened hw cost | Est. watts | Tokens/sec | Breakeven vs cloud | Verdict |
|---|---|---|---|---|---|---|
| 2× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 48 GB | $550 2 screened listings: $270 + $280 + shipping unknown on 1 of 2 listings
report
400 feedback (100%) · no returns · listed 4 days | 575 W | – | 18 mo | Buying wins by month 18 |
| 4× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 96 GB | $1,140 4 screened listings: $270 + $280 + $290 + $300 + shipping unknown on 2 of 4 listings
report
400 feedback (100%) · no returns · listed 4 days | 1075 W | – | 63 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 3090 | 48 GB | $2,405 2 screened listings: $1,180 + $1,225 + shipping unknown on 1 of 2 listings
report
164,757 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 775 W | – | 101 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A6000 | 48 GB | $3,520
report
164,767 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 375 W | – | 93 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5090 | 32 GB | $4,200
report
470 feedback (100%) · Top Rated seller · returns accepted · listed 22 days | 650 W | – | 164 mo | Renting wins at 40 h/mo |
| 4× NVIDIA GeForce RTX 3090 | 96 GB | $4,890 4 screened listings: $1,180 + $1,225 + $1,240 + $1,245 + shipping unknown on 1 of 4 listings
report
164,757 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 1475 W | – | 546 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 4090 | 48 GB | $4,999 2 screened listings: $2,499 + $2,500
report
4,692 feedback (99.9%) · Top Rated seller · returns accepted · listed 15 days | 975 W | – | 249 mo | Renting wins at 40 h/mo |
| 2× NVIDIA RTX A6000 | 96 GB | $7,140 2 screened listings: $3,520 + $3,620
report
164,767 feedback (99.6%) · Top Rated seller · returns accepted · listed 22 days | 675 W | – | 242 mo | Renting wins at 40 h/mo |
Fits, but not currently buyable as a set: 2× NVIDIA RTX A5000 (48 GB) needs 2 screened cards and the market has 1; 4× NVIDIA RTX A5000 (96 GB) needs 4 screened cards and the market has 1. We price a multi-card build from that many separate listings, so it stays unpriced until they exist.
- Configs without a screened purchase option are hidden until listings clear the trust screen (a multi-day survival window on eBay).
- Multi-card costs are the sum of that many separate screened listings; the cheapest listing counted twice is not a price anyone can pay. Prices exclude the PSU, board and case a multi-card build usually also needs.
- Tokens/sec: benchmarks coming; every number will be source-linked. We never publish unattributed performance figures.
- Breakeven and verdict use default assumptions (40 h/mo, $0.16/kWh, 24-month horizon, resale at 65% of median ask); adjust them in the calculator. Hardware links are screened, not guaranteed.
Run your own numbers for Devstral Small 2 24B (Q8_0) in the buy-vs-rent calculator →