Artificial Analysis
Independent benchmarking of model quality, speed and price across every provider.
why this verdict
Keep it — OpenAI has not replaced it
OpenAI's version overlaps, but does not finish the research job, so this one is still worth keeping open.
- A named launch, not a vibe named, unlinked
- Model providers publishing their own comparison pages and pricing calculators. OpenAI, August 5, 2025 — no announcement link recorded yet.
- How much of the job it covers not the job editorial call
- Parts of it. The job still needs the tool to get finished.
- Is there a free way to do it? yes
- 3 of 3 listed replacements have a usable free tier: LMArena, OpenRouter and Hugging Face.
- What the call is worth nothing to cancel
- No paid entry tier tracked, so there is no subscription to cancel.
- Threatened by
- OpenAI
- Since
- August 5, 2025
- List price
- free
- Per year
- —
The backstory
Artificial Analysis measures what buyers actually decide on: tokens per second, time to first token, cost per million tokens and quality scores, compared across every model and every host serving it. That last dimension is the useful one, since the same open model varies wildly in speed and price depending on who runs it. Vendor comparison pages exist, but nobody trusts them, and independence is the entire asset here.
Escape hatches
Human preference rankings rather than measured metrics
lmarena.ai open_in_newLive pricing and throughput across providers
openrouter.ai open_in_newOpen leaderboards maintained by the community
huggingface.co open_in_new3 of 3 replacements have a usable free tier.