Kolibri 1

Model profile
Model	Size	Approximate size
Kolibri 1Model source: provider1,048,576 tokens max native context	78Bactive 3.5B	46.8 GB4-bit quantization

Compatible hardware Estimated speeds, not benchmark results: calculated from memory bandwidth and model size. Real results can differ significantly because there is no precise formula for deriving LLM generation speed from hardware specifications alone.
Hardware	Memory	Bandwidth	vLLM	Estimated generation
Radeon 8060S 96GB	96 GBUnified RAM	256 GB/s	yes	48 tok/s4-bit quantization
DGX Spark	128 GBUnified RAM	273 GB/s	yes	51 tok/s4-bit quantization
M5 Pro	64 GBUnified RAM	307 GB/s	no	56 tok/s4-bit quantization
M5 Max	128 GBUnified RAM	614 GB/s	no	104 tok/s4-bit quantization
M3 Ultra	96 GBUnified RAM	819 GB/s	no	132 tok/s4-bit quantization
M5 Ultra	256 GBUnified RAM	1200 GB/s	no	177 tok/s4-bit quantization
RTX PRO 6000	96 GBGPU VRAM	1792 GB/s	yes	234 tok/s4-bit quantization
DGX H200	1128 GBGPU HBM3e	4800 GB/s	yes	395 tok/s4-bit quantization
DGX Station	748 GBCoherent Memory	7100 GB/s	yes	455 tok/s4-bit quantization
ET900N G3	748 GBCoherent Memory	7100 GB/s	yes	455 tok/s4-bit quantization
DGX B200	1440 GBGPU HBM3e	8000 GB/s	yes	472 tok/s4-bit quantization
GB200 NVL72	13400 GBGPU HBM3e	8000 GB/s	yes	472 tok/s4-bit quantization
GB300 NVL72	20000 GBGPU HBM3e	8000 GB/s	yes	472 tok/s4-bit quantization

1 video found Showing 1-1

LLM model: Kolibri 1