Hardware pour l'IA locale
Les machines capables de faire tourner des modèles d'IA en local ou on-premises : cartes graphiques, mini-PC à mémoire unifiée, stations IA, Apple Silicon, PC à NPU et serveurs. Chaque fiche détaille mémoire, bande passante, performances mesurées en tok/s, prix et consommation.
Hardware pour l'IA locale
48 machines comparées (mémoire, bande passante, consommation, prix et vitesse de génération mesurée sur Llama 3.1 8B Q4), classées par catégorie.
| Catégorie | Machine | Mémoire | Bande passante | TDP | Prix | Géné. 8B |
|---|---|---|---|---|---|---|
| Cartes graphiques | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | 96 Go | 1 792 Go/s | 600 W | 11 830 $ | 103 tok/s |
| NVIDIA A100 80 Go PCIe | 80 Go | 1 935 Go/s | 300 W | 4 800 $ | n.d. | |
| NVIDIA H100 PCIe 80 Go | 80 Go | 2 000 Go/s | 350 W | 28 000 $ | n.d. | |
| NVIDIA RTX 6000 Ada Generation | 48 Go | 960 Go/s | 300 W | 6 800 $ | 121 tok/s | |
| NVIDIA RTX A6000 | 48 Go | 768 Go/s | 300 W | 4 650 $ | n.d. | |
| AMD Radeon AI PRO R9700 | 32 Go | 640 Go/s | 300 W | 1 299 $ | 77 tok/s | |
| NVIDIA GeForce RTX 5090 | 32 Go | 1 792 Go/s | 575 W | 2 999 $ | 175 tok/s | |
| AMD Radeon RX 7900 XTX | 24 Go | 960 Go/s | 355 W | 930 $ | 96 tok/s | |
| NVIDIA GeForce RTX 3090 | 24 Go | 936 Go/s | 350 W | 1 050 $ | 96 tok/s | |
| NVIDIA GeForce RTX 3090 Ti | 24 Go | 1 008 Go/s | 450 W | 1 240 $ | 110 tok/s | |
| NVIDIA GeForce RTX 4090 | 24 Go | 1 008 Go/s | 450 W | 1 599 $ | 120 tok/s | |
| AMD Radeon RX 9070 XT | 16 Go | 640 Go/s | 304 W | 599 $ | 55 tok/s | |
| Intel Arc A770 16 Go | 16 Go | 560 Go/s | 225 W | 349 $ | 39 tok/s | |
| NVIDIA GeForce RTX 4060 Ti 16 Go | 16 Go | 288 Go/s | 165 W | 499 $ | 34 tok/s | |
| NVIDIA GeForce RTX 4070 Ti SUPER | 16 Go | 672 Go/s | 285 W | 799 $ | 72 tok/s | |
| NVIDIA GeForce RTX 4080 SUPER | 16 Go | 736 Go/s | 320 W | 999 $ | 79 tok/s | |
| NVIDIA GeForce RTX 5060 Ti 16 Go | 16 Go | 448 Go/s | 180 W | 429 $ | 59 tok/s | |
| NVIDIA GeForce RTX 5070 Ti | 16 Go | 896 Go/s | 300 W | 749 $ | 88 tok/s | |
| NVIDIA GeForce RTX 5080 | 16 Go | 960 Go/s | 360 W | 999 $ | 95 tok/s | |
| Intel Arc B580 | 12 Go | 456 Go/s | 190 W | 249 $ | 35 tok/s | |
| Mini-PC mémoire unifiée | Beelink GTR9 Pro (Ryzen AI Max+ 395) | 128 Go | 256 Go/s | 140 W | 1 999 $ | n.d. |
| Framework Desktop (Ryzen AI Max+ 395) | 128 Go | 256 Go/s | 120 W | 1 999 $ | n.d. | |
| GMKtec EVO-X2 (Ryzen AI Max+ 395) | 128 Go | 256 Go/s | 120 W | 2 000 $ | n.d. | |
| HP Z2 Mini G1a (Ryzen AI Max+ PRO 395) | 128 Go | 273 Go/s | n.d. | 3 343 $ | n.d. | |
| Minisforum MS-S1 MAX (Ryzen AI Max+ 395) | 128 Go | 256 Go/s | 140 W | 2 199 $ | n.d. | |
| Stations IA | NVIDIA DGX Station (GB300 Grace Blackwell Ultra) | 748 Go | n.d. | 1 600 W | n.d. | n.d. |
| ASUS Ascent GX10 | 128 Go | 273 Go/s | 240 W | 2 999 $ | 40 tok/s | |
| NVIDIA DGX Spark | 128 Go | 273 Go/s | 240 W | 4 699 $ | 38 tok/s | |
| NVIDIA Jetson AGX Thor (Developer Kit) | 128 Go | 273 Go/s | 130 W | 3 499 $ | n.d. | |
| NVIDIA Jetson AGX Orin 64 Go (Developer Kit) | 64 Go | 205 Go/s | 60 W | 1 999 $ | n.d. | |
| Apple Silicon | Apple Mac Studio (M3 Ultra) | 512 Go | 819 Go/s | 270 W | 3 999 $ | 105 tok/s |
| Apple Mac Studio (M2 Ultra) | 192 Go | 800 Go/s | 370 W | 3 999 $ | n.d. | |
| Apple Mac Studio (M1 Ultra) | 128 Go | 800 Go/s | 370 W | 3 999 $ | n.d. | |
| Apple Mac Studio (M4 Max) | 128 Go | 546 Go/s | 160 W | 3 499 $ | 75 tok/s | |
| Apple MacBook Pro 16" (M3 Max) | 128 Go | 400 Go/s | n.d. | 3 999 $ | n.d. | |
| Apple MacBook Pro 16" (M4 Max) | 128 Go | 546 Go/s | n.d. | 3 999 $ | n.d. | |
| Apple MacBook Pro 16" (M5 Max) | 128 Go | 614 Go/s | n.d. | 3 899 $ | n.d. | |
| Apple Mac mini (M4 Pro) | 64 Go | 273 Go/s | 100 W | 1 999 $ | 40 tok/s | |
| Apple MacBook Pro 14" (M1 Max) | 64 Go | 400 Go/s | n.d. | 3 499 $ | n.d. | |
| Apple MacBook Pro 14" (M4 Pro) | 48 Go | 273 Go/s | n.d. | 1 999 $ | n.d. | |
| Apple Mac mini (M4) | 32 Go | 120 Go/s | n.d. | 999 $ | n.d. | |
| Apple MacBook Air 13" (M5) | 32 Go | 153 Go/s | n.d. | 1 499 $ | n.d. | |
| PC à NPU | PC portable Intel Core Ultra 7 258V (Lunar Lake) | 32 Go | 136 Go/s | 28 W | 1 299 $ | 18 tok/s |
| PC portable Snapdragon X Elite (Copilot+) | 32 Go | 135 Go/s | 23 W | 1 399 $ | 20 tok/s | |
| Serveurs & accélérateurs | Workstation CPU-only AMD Threadripper PRO (512 Go) | 512 Go | 204 Go/s | 280 W | n.d. | n.d. |
| Serveur CPU-only AMD EPYC 9004 (ex. EPYC 9334) | 384 Go | 461 Go/s | 210 W | n.d. | 28 tok/s | |
| tinygrad tinybox green v2 (4× RTX 5090) | 128 Go | 1 792 Go/s | 2 800 W | n.d. | n.d. | |
| Tenstorrent Blackhole p150a | 32 Go | 512 Go/s | 300 W | 1 399 $ | n.d. |