Ling 3.1 Flash

Model profile
Model	Size	Approximate size
Ling 3.1 FlashModel source: provider262,144 tokens max native context	560Bactive 25B	336 GB4-bit quantization

Compatible hardware Estimated speeds, not benchmark results: calculated from memory bandwidth and model size. Real results can differ significantly because there is no precise formula for deriving LLM generation speed from hardware specifications alone.
Hardware	Memory	Bandwidth	vLLM	Estimated generation
DGX H200	1128 GBGPU HBM3e	4800 GB/s	yes	111 tok/s4-bit quantization
DGX Station	748 GBCoherent Memory	7100 GB/s	yes	153 tok/s4-bit quantization
ET900N G3	748 GBCoherent Memory	7100 GB/s	yes	153 tok/s4-bit quantization
DGX B200	1440 GBGPU HBM3e	8000 GB/s	yes	167 tok/s4-bit quantization
GB200 NVL72	13400 GBGPU HBM3e	8000 GB/s	yes	167 tok/s4-bit quantization
GB300 NVL72	20000 GBGPU HBM3e	8000 GB/s	yes	167 tok/s4-bit quantization

2 videos found Showing 1-2

LLM model: Ling 3.1 Flash