ERNIE-4.5-300B-A47B-Base-PT
by baidu
299B params · text-generation · 37 likes · 32 downloads
ERNIE-4.5-300B-A47B-Base-PT is a 299B parameter model. At Q4 quantization it requires 150GB of VRAM. It fits on M2 Ultra 192GB (2 tok/s) but performance may be limited.
Inference providers
| Provider | $/1M in | $/1M out | Throughput |
|---|---|---|---|
| Novita | 21 tok/s |
GPU compatibility
| GPU | VRAM | Q4 Decode | Verdict |
|---|---|---|---|
| M2 Ultra 192GB | 192GB | 2 tok/s | tight |