vram.run Models Hardware Providers Cloud State of Inference
API provider data is live · Hardware & cloud pricing curated 2026-02-23

Arc B580

Intel

12GB VRAM · 456 GB/s bandwidth · 27.3 FP16 TFLOPS · 190W TDP

The Arc B580 has 12GB of VRAM with 456 GB/s memory bandwidth and 27.3 TFLOPS FP16 compute. At Q4 quantization, it can comfortably run Gemma 3 4B (102 tok/s), Qwen 2.5 7B (54 tok/s), Llama 3.1 8B (51 tok/s). Models larger than ~20B parameters won't fit even at Q4. Electricity cost is approximately $21/month at 190W TDP.

What LLMs can you run?

ModelParamsQ4 WeightFitDecode
Gemma 3 4B4.0B2 GBcomfortable102 tok/s
Qwen 2.5 7B7.6B4 GBcomfortable54 tok/s
Llama 3.1 8B8.0B4 GBcomfortable51 tok/s
Mistral Small 24B24.0B12 GBwon't fit
Gemma 3 27B27.4B14 GBwon't fit
Qwen 2.5 Coder 32B32.5B16 GBwon't fit
Llama 3.3 70B70.6B35 GBwon't fit
Qwen 2.5 72B72.7B36 GBwon't fit
Llama 3.1 405B405B202 GBwon't fit
DeepSeek R1 671B671B336 GBwon't fit

Similar GPUs

GPUVRAMBWTFLOPSTDP
GeForce RTX 4070 GDDR612GB480 GB/s29.1200W
Radeon RX 6750 GRE 12 GB12GB432 GB/s26.4250W
Radeon RX 6750 XT12GB432 GB/s26.6250W
Radeon RX 7700 XT12GB432 GB/s70.3245W
Radeon RX 9070 GRE12GB432 GB/s68.6220W

Compare with another GPU

Select another GPU to compare specs and model performance side by side.

Install CLI [email protected] Raw data · MIT · API data: live · HW/Cloud data: curated 2026-02-23 · v0.6.0