Hardware pour l'IA locale
Les machines capables de faire tourner des modèles d'IA en local ou on-premises : cartes graphiques, mini-PC à mémoire unifiée, stations IA, Apple Silicon, PC à NPU et serveurs. Chaque fiche détaille mémoire, bande passante, performances mesurées en tok/s, prix et consommation.
Hardware pour l'IA locale
48 machines comparées (mémoire, bande passante, consommation, prix et vitesse de génération mesurée sur Llama 3.1 8B Q4), classées par catégorie.
Cartes graphiques
| Machine | Géné. 8B | Mémoire | Bande passante | TDP | Prix |
|---|---|---|---|---|---|
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 103 tok/s | 96 Go | 1 792 Go/s | 600 W | 11 830 $ |
| NVIDIA A100 80 Go PCIe | n.d. | 80 Go | 1 935 Go/s | 300 W | 4 800 $ |
| NVIDIA H100 PCIe 80 Go | n.d. | 80 Go | 2 000 Go/s | 350 W | 28 000 $ |
| NVIDIA RTX 6000 Ada Generation | 121 tok/s | 48 Go | 960 Go/s | 300 W | 6 800 $ |
| NVIDIA RTX A6000 | n.d. | 48 Go | 768 Go/s | 300 W | 4 650 $ |
| AMD Radeon AI PRO R9700 | 77 tok/s | 32 Go | 640 Go/s | 300 W | 1 299 $ |
| NVIDIA GeForce RTX 5090 | 175 tok/s | 32 Go | 1 792 Go/s | 575 W | 2 999 $ |
| AMD Radeon RX 7900 XTX | 96 tok/s | 24 Go | 960 Go/s | 355 W | 930 $ |
| NVIDIA GeForce RTX 3090 | 96 tok/s | 24 Go | 936 Go/s | 350 W | 1 050 $ |
| NVIDIA GeForce RTX 3090 Ti | 110 tok/s | 24 Go | 1 008 Go/s | 450 W | 1 240 $ |
| NVIDIA GeForce RTX 4090 | 120 tok/s | 24 Go | 1 008 Go/s | 450 W | 1 599 $ |
| AMD Radeon RX 9070 XT | 55 tok/s | 16 Go | 640 Go/s | 304 W | 599 $ |
| Intel Arc A770 16 Go | 39 tok/s | 16 Go | 560 Go/s | 225 W | 349 $ |
| NVIDIA GeForce RTX 4060 Ti 16 Go | 34 tok/s | 16 Go | 288 Go/s | 165 W | 499 $ |
| NVIDIA GeForce RTX 4070 Ti SUPER | 72 tok/s | 16 Go | 672 Go/s | 285 W | 799 $ |
| NVIDIA GeForce RTX 4080 SUPER | 79 tok/s | 16 Go | 736 Go/s | 320 W | 999 $ |
| NVIDIA GeForce RTX 5060 Ti 16 Go | 59 tok/s | 16 Go | 448 Go/s | 180 W | 429 $ |
| NVIDIA GeForce RTX 5070 Ti | 88 tok/s | 16 Go | 896 Go/s | 300 W | 749 $ |
| NVIDIA GeForce RTX 5080 | 95 tok/s | 16 Go | 960 Go/s | 360 W | 999 $ |
| Intel Arc B580 | 35 tok/s | 12 Go | 456 Go/s | 190 W | 249 $ |
Mini-PC mémoire unifiée
| Machine | Géné. 8B | Mémoire | Bande passante | TDP | Prix |
|---|---|---|---|---|---|
| Beelink GTR9 Pro (Ryzen AI Max+ 395) | n.d. | 128 Go | 256 Go/s | 140 W | 1 999 $ |
| Framework Desktop (Ryzen AI Max+ 395) | n.d. | 128 Go | 256 Go/s | 120 W | 1 999 $ |
| GMKtec EVO-X2 (Ryzen AI Max+ 395) | n.d. | 128 Go | 256 Go/s | 120 W | 2 000 $ |
| HP Z2 Mini G1a (Ryzen AI Max+ PRO 395) | n.d. | 128 Go | 273 Go/s | n.d. | 3 343 $ |
| Minisforum MS-S1 MAX (Ryzen AI Max+ 395) | n.d. | 128 Go | 256 Go/s | 140 W | 2 199 $ |
Stations IA
| Machine | Géné. 8B | Mémoire | Bande passante | TDP | Prix |
|---|---|---|---|---|---|
| NVIDIA DGX Station (GB300 Grace Blackwell Ultra) | n.d. | 748 Go | n.d. | 1 600 W | n.d. |
| ASUS Ascent GX10 | 40 tok/s | 128 Go | 273 Go/s | 240 W | 2 999 $ |
| NVIDIA DGX Spark | 38 tok/s | 128 Go | 273 Go/s | 240 W | 4 699 $ |
| NVIDIA Jetson AGX Thor (Developer Kit) | n.d. | 128 Go | 273 Go/s | 130 W | 3 499 $ |
| NVIDIA Jetson AGX Orin 64 Go (Developer Kit) | n.d. | 64 Go | 205 Go/s | 60 W | 1 999 $ |
Apple Silicon
| Machine | Géné. 8B | Mémoire | Bande passante | TDP | Prix |
|---|---|---|---|---|---|
| Apple Mac Studio (M3 Ultra) | 105 tok/s | 512 Go | 819 Go/s | 270 W | 3 999 $ |
| Apple Mac Studio (M2 Ultra) | n.d. | 192 Go | 800 Go/s | 370 W | 3 999 $ |
| Apple Mac Studio (M1 Ultra) | n.d. | 128 Go | 800 Go/s | 370 W | 3 999 $ |
| Apple Mac Studio (M4 Max) | 75 tok/s | 128 Go | 546 Go/s | 160 W | 3 499 $ |
| Apple MacBook Pro 16" (M3 Max) | n.d. | 128 Go | 400 Go/s | n.d. | 3 999 $ |
| Apple MacBook Pro 16" (M4 Max) | n.d. | 128 Go | 546 Go/s | n.d. | 3 999 $ |
| Apple MacBook Pro 16" (M5 Max) | n.d. | 128 Go | 614 Go/s | n.d. | 3 899 $ |
| Apple Mac mini (M4 Pro) | 40 tok/s | 64 Go | 273 Go/s | 100 W | 1 999 $ |
| Apple MacBook Pro 14" (M1 Max) | n.d. | 64 Go | 400 Go/s | n.d. | 3 499 $ |
| Apple MacBook Pro 14" (M4 Pro) | n.d. | 48 Go | 273 Go/s | n.d. | 1 999 $ |
| Apple Mac mini (M4) | n.d. | 32 Go | 120 Go/s | n.d. | 999 $ |
| Apple MacBook Air 13" (M5) | n.d. | 32 Go | 153 Go/s | n.d. | 1 499 $ |
PC à NPU
| Machine | Géné. 8B | Mémoire | Bande passante | TDP | Prix |
|---|---|---|---|---|---|
| PC portable Intel Core Ultra 7 258V (Lunar Lake) | 18 tok/s | 32 Go | 136 Go/s | 28 W | 1 299 $ |
| PC portable Snapdragon X Elite (Copilot+) | 20 tok/s | 32 Go | 135 Go/s | 23 W | 1 399 $ |
Serveurs & accélérateurs
| Machine | Géné. 8B | Mémoire | Bande passante | TDP | Prix |
|---|---|---|---|---|---|
| Workstation CPU-only AMD Threadripper PRO (512 Go) | n.d. | 512 Go | 204 Go/s | 280 W | n.d. |
| Serveur CPU-only AMD EPYC 9004 (ex. EPYC 9334) | 28 tok/s | 384 Go | 461 Go/s | 210 W | n.d. |
| tinygrad tinybox green v2 (4× RTX 5090) | n.d. | 128 Go | 1 792 Go/s | 2 800 W | n.d. |
| Tenstorrent Blackhole p150a | n.d. | 32 Go | 512 Go/s | 300 W | 1 399 $ |