| Radeon 8060S 96GB |
96 GBUnified RAM |
256 GB/s |
yes |
33 tok/s4-bit quantization |
| DGX Spark |
128 GBUnified RAM |
273 GB/s |
yes |
35 tok/s4-bit quantization |
| M5 Max |
128 GBUnified RAM |
614 GB/s |
no |
74 tok/s4-bit quantization |
| M3 Ultra |
96 GBUnified RAM |
819 GB/s |
no |
96 tok/s4-bit quantization |
| M5 Ultra |
256 GBUnified RAM |
1200 GB/s |
no |
132 tok/s4-bit quantization |
| RTX PRO 6000 |
96 GBGPU VRAM |
1792 GB/s |
yes |
179 tok/s4-bit quantization |
| DGX H200 |
1128 GBGPU HBM3e |
4800 GB/s |
yes |
331 tok/s4-bit quantization |
| DGX Station |
748 GBCoherent Memory |
7100 GB/s |
yes |
395 tok/s4-bit quantization |
| ET900N G3 |
748 GBCoherent Memory |
7100 GB/s |
yes |
395 tok/s4-bit quantization |
| DGX B200 |
1440 GBGPU HBM3e |
8000 GB/s |
yes |
414 tok/s4-bit quantization |
| GB200 NVL72 |
13400 GBGPU HBM3e |
8000 GB/s |
yes |
414 tok/s4-bit quantization |
| GB300 NVL72 |
20000 GBGPU HBM3e |
8000 GB/s |
yes |
414 tok/s4-bit quantization |