MiMo-V2-Flash
by XiaomiMiMo
310B params · text-generation · 643 likes · 485.7k downloads
MiMo-V2-Flash is a 310B parameter model. At Q4 quantization it requires 155GB of VRAM. It fits on M2 Ultra 192GB (2 tok/s) but performance may be limited.
Inference providers
| Provider | $/1M in | $/1M out | Throughput |
|---|---|---|---|
| Novita | 88 tok/s |
GPU compatibility
| GPU | VRAM | Q4 Decode | Verdict |
|---|---|---|---|
| M2 Ultra 192GB | 192GB | 2 tok/s | tight |