Model index / VRAM estimator
THE OPEN MODEL INDEX
Can I run it?
Estimate the memory needed to load a model from its size and weight precision.
Estimated VRAM 5.6 GB
A rough estimate only.
Formula: parameters (B) × bits ÷ 8 × 1.15 + 1 GB. This does not precisely calculate KV cache. Long contexts, multimodal components, expert offloading and runtimes change actual usage.