vram.run Models Hardware Providers Cloud State of Inference
API provider data is live · Hardware & cloud pricing curated 2026-02-23

Llama-3.3-70B-Instruct

by meta-llama

text-generation · 2.7k likes · 587.4k downloads

Inference providers

Provider$/1M in$/1M outThroughput
Groq295 tok/s
Novita27 tok/s
SambaNova281 tok/s
Nscale16 tok/s
Hyperbolic72 tok/s
Together AI108 tok/s
Fireworks109 tok/s
Scaleway81 tok/s
OVHcloud30 tok/s
Install CLI [email protected] Raw data · MIT · API data: live · HW/Cloud data: curated 2026-02-23 · v0.6.0