vram.run Models Hardware Providers Cloud State of Inference
API provider data is live · Hardware & cloud pricing curated 2026-02-23

Llama-3.1-405B

by meta-llama

405B params · text-generation · 965 likes · 555.8k downloads

Llama-3.1-405B is a 405B parameter model. At Q4 quantization it requires 202GB of VRAM. It requires a GPU with at least 202GB of VRAM.

Install CLI [email protected] Raw data · MIT · API data: live · HW/Cloud data: curated 2026-02-23 · v0.6.0