Mistral-7B-Instruct-v0.2 on GeForce RTX 5090

7.2B params · 32GB VRAM · 1790 GB/s

Quantization estimates computed in browser.