LLM model: DeepSeek V4 Pro

Model profile
Model Size Approximate size
DeepSeek V4 ProModel source: provider1,048,576 tokens max native context 1600Bactive 49B 960 GB4-bit quantization
Compatible hardware Estimated speeds, not benchmark results: calculated from memory bandwidth and model size. Real results can differ significantly because there is no precise formula for deriving LLM generation speed from hardware specifications alone.
Hardware Memory Bandwidth vLLM Estimated generation
DGX H200 1128 GBGPU HBM3e 4800 GB/s yes 62 tok/s4-bit quantization
DGX B200 1440 GBGPU HBM3e 8000 GB/s yes 97 tok/s4-bit quantization
GB200 NVL72 13400 GBGPU HBM3e 8000 GB/s yes 97 tok/s4-bit quantization
GB300 NVL72 20000 GBGPU HBM3e 8000 GB/s yes 97 tok/s4-bit quantization
5 videos found Showing 1-5

Ai4Users.com

Copyright © 2026 Piotr Szawdyński. All rights reserved.