Granite 4.2 8B

Model profile
Model	Size	Approximate size
Granite 4.2 8BModel source: provider131,072 tokens max native context	8B	4.8 GB4-bit quantization

Compatible hardware Estimated speeds, not benchmark results: calculated from memory bandwidth and model size. Real results can differ significantly because there is no precise formula for deriving LLM generation speed from hardware specifications alone.
Hardware	Memory	Bandwidth	vLLM	Estimated generation
DDR4 16GB Computer	16 GBRAM	51.2 GB/s	no	5 tok/s4-bit quantization
DDR5 16GB Computer	16 GBRAM	89.6 GB/s	no	10 tok/s4-bit quantization
DDR5 32GB Computer	32 GBRAM	89.6 GB/s	no	10 tok/s4-bit quantization
Mac mini M4	24 GBUnified RAM	120 GB/s	no	13 tok/s4-bit quantization
RTX 2000 Ada	16 GBGPU VRAM	224 GB/s	yes	25 tok/s4-bit quantization
Radeon 8060S 96GB	96 GBUnified RAM	256 GB/s	yes	28 tok/s4-bit quantization
M4 Pro	24 GBUnified RAM	273 GB/s	no	30 tok/s4-bit quantization
DGX Spark	128 GBUnified RAM	273 GB/s	yes	30 tok/s4-bit quantization
RTX 4060 Ti 16GB	16 GBGPU VRAM	288 GB/s	yes	32 tok/s4-bit quantization
M5 Pro	64 GBUnified RAM	307 GB/s	no	34 tok/s4-bit quantization
RTX 3060 12GB	12 GBGPU VRAM	360 GB/s	yes	40 tok/s4-bit quantization
RTX 5060 Ti 16GB	16 GBGPU VRAM	448 GB/s	yes	49 tok/s4-bit quantization
M5 Max	128 GBUnified RAM	614 GB/s	no	66 tok/s4-bit quantization
M3 Ultra	96 GBUnified RAM	819 GB/s	no	87 tok/s4-bit quantization
RTX 5080	16 GBGPU VRAM	960 GB/s	yes	101 tok/s4-bit quantization
RTX 3090 Ti	24 GBGPU VRAM	1008 GB/s	yes	106 tok/s4-bit quantization
M5 Ultra	256 GBUnified RAM	1200 GB/s	no	124 tok/s4-bit quantization
RTX 5090	32 GBGPU VRAM	1792 GB/s	yes	177 tok/s4-bit quantization
RTX PRO 6000	96 GBGPU VRAM	1792 GB/s	yes	177 tok/s4-bit quantization
DGX H200	1128 GBGPU HBM3e	4800 GB/s	yes	389 tok/s4-bit quantization
DGX Station	748 GBCoherent Memory	7100 GB/s	yes	505 tok/s4-bit quantization
ET900N G3	748 GBCoherent Memory	7100 GB/s	yes	505 tok/s4-bit quantization
DGX B200	1440 GBGPU HBM3e	8000 GB/s	yes	543 tok/s4-bit quantization
GB200 NVL72	13400 GBGPU HBM3e	8000 GB/s	yes	543 tok/s4-bit quantization
GB300 NVL72	20000 GBGPU HBM3e	8000 GB/s	yes	543 tok/s4-bit quantization

3 videos found Showing 1-3

Video No place like localhost 2026-09-14

LLM Battle 8

Coding competition evaluating Ornith-1.5-9B, Spark-X2.5-4B, and IBM's Granite-4.2-8B on automating mundane, repetitive tasks using OpenCode GPU sidebar plugin and VoxCtrl.

Testing Ornith 1.5 9B Granite 4.2 8B Spark X2.5 4B

Video KGP Talkie 2026-08-29

IBM Granite 4.2 vs Qwen 3.8 27B vs Gemma 4 - Local LLM Benchmark

Benchmark IBM Granite 4.2, Qwen 3.8 27B, Gemma 4, and Ornith 1.5 on an RTX 5090, measuring KV cache cost, usable context, generation speed, coding, math, and tool calling via Python tests.

Testing Gemma 4 31B Qwen 3.8 27B Gemma 4 12B Ornith 1.5 9B Granite 4.2 8B Granite 4.2 30B RTX 5090

Video Fahd Mirza 2026-08-25

Granite 4.2 (3B vs 8B): IBM's New Reasoning Models, Tested Locally

Locally installs and tests Granite 4.2 generation in 3B and 8B variants using ibm-granite/granite-4.2-3b resources.

Testing Granite 4.2 3B Granite 4.2 8B

LLM model: Granite 4.2 8B

LLM Battle 8

IBM Granite 4.2 vs Qwen 3.8 27B vs Gemma 4 - Local LLM Benchmark

Granite 4.2 (3B vs 8B): IBM's New Reasoning Models, Tested Locally