| Model profile | ||
|---|---|---|
| Model | Size | Approximate size |
| Nemotron 3.5 BoltModel source: provider262,144 tokens max native context | 74Bactive 9B | 44.4 GB4-bit quantization |
| Compatible hardware Estimated speeds, not benchmark results: calculated from memory bandwidth and model size. Real results can differ significantly because there is no precise formula for deriving LLM generation speed from hardware specifications alone. | ||||
|---|---|---|---|---|
| Hardware | Memory | Bandwidth | vLLM | Estimated generation |
| Radeon 8060S 96GB | 96 GBUnified RAM | 256 GB/s | yes | 19 tok/s4-bit quantization |
| DGX Spark | 128 GBUnified RAM | 273 GB/s | yes | 20 tok/s4-bit quantization |
| M5 Pro | 64 GBUnified RAM | 307 GB/s | no | 23 tok/s4-bit quantization |
| M5 Max | 128 GBUnified RAM | 614 GB/s | no | 44 tok/s4-bit quantization |
| M3 Ultra | 96 GBUnified RAM | 819 GB/s | no | 58 tok/s4-bit quantization |
| M5 Ultra | 256 GBUnified RAM | 1200 GB/s | no | 81 tok/s4-bit quantization |
| RTX PRO 6000 | 96 GBGPU VRAM | 1792 GB/s | yes | 115 tok/s4-bit quantization |
| DGX H200 | 1128 GBGPU HBM3e | 4800 GB/s | yes | 239 tok/s4-bit quantization |
| DGX Station | 748 GBCoherent Memory | 7100 GB/s | yes | 302 tok/s4-bit quantization |
| ET900N G3 | 748 GBCoherent Memory | 7100 GB/s | yes | 302 tok/s4-bit quantization |
| DGX B200 | 1440 GBGPU HBM3e | 8000 GB/s | yes | 321 tok/s4-bit quantization |
| GB200 NVL72 | 13400 GBGPU HBM3e | 8000 GB/s | yes | 321 tok/s4-bit quantization |
| GB300 NVL72 | 20000 GBGPU HBM3e | 8000 GB/s | yes | 321 tok/s4-bit quantization |
Tests NVIDIA-Nemotron-3.5-Bolt-E4B-4GB using the Raramuri Runners Test, Yakisoba Teppan HTML Simulation, logical puzzles, science reasoning, scheduling tasks, and baby names in 82 languages.
Evaluates Nvidia's Nemotron Bolt, tuned for 24GB cards, testing image understanding, everyday tasks, coding difficulty levels, and comparing against Qwen Flash.
Tests NVIDIA Nemotron 3.5 Bolt on coding and agentic work, comparing performance against Qwen3.8-27B, Qwen3.8-Flash-Next, and Strata Coder.
Locally installed NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB is tested on agentic tasks including bug fixing, vision self-fix, mind games, headline translation, and circuit reasoning.