K-EXAONE-236B-A23B
by LGAI-EXAONE
237B params · text-generation · 549 likes · 26.4k downloads
K-EXAONE-236B-A23B is a 237B parameter model. At Q4 quantization it requires 119GB of VRAM. It fits on H200 SXM 141 GB (29 tok/s), M2 Ultra 192GB (2 tok/s) but performance may be limited.
GPU compatibility
| GPU | VRAM | Q4 Decode | Verdict |
|---|---|---|---|
| H200 SXM 141 GB | 141GB | 29 tok/s | tight |
| M2 Ultra 192GB | 192GB | 2 tok/s | tight |