cogito-671b-v2.1
by deepcogito
671B params · text-generation · 28 likes · 102 downloads
cogito-671b-v2.1 is a 671B parameter model. At Q4 quantization it requires 336GB of VRAM. It requires a GPU with at least 336GB of VRAM.
Inference providers
| Provider | $/1M in | $/1M out | Throughput |
|---|---|---|---|
| Together AI | 77 tok/s | ||
| Fireworks | 48 tok/s |