Llama-3.1-405B-Instruct

by meta-llama

406B params · text-generation · 592 likes · 170.4k downloads

Llama-3.1-405B-Instruct is a 406B parameter model. At Q4 quantization it requires 203GB of VRAM. It requires a GPU with at least 203GB of VRAM.