Open source alternatives to Benchmark Heaven
200 open source apps like Benchmark Heaven, closest match first.
Top picks
- O
OpenRouter Model Price Comparison
LaunchOpenRouter Model Price Comparison is a web page that puts the AI models available on OpenRouter into one table, so you can compare what they cost. For each model it shows the provider, context length, input and output costs, image cost, sup
- L

LMRing
Launchlmring is a web app for comparing AI models side by side. You pick up to four models from more than 50 providers, including OpenAI, Anthropic, Google, Meta, Mistral and DeepSeek, then write one prompt and send it to all of them at once. Res
Open sourceSelf-hosted
- L
Litmux
LaunchTest your prompts across all major AI models, catch regressions, and find the cheapest model that passes your quality bar. Open source CLI.
Open source
- A
- G
Geo Aeo Tracker
LaunchOpen-source, local-first AI visibility intelligence dashboard. Track your brand across 6 AI models.
Open source
- F

Frugon
LaunchFrugon is a free, open-source command-line tool that estimates how much you could save on LLM bills. You give it the request logs your app already writes, in OpenAI or Anthropic-style JSONL, and it shows which calls a cheaper model could ha
Open source
More like Benchmark Heaven
About Benchmark Heaven
Benchmark Heaven
Model benchmarks & costs
Benchmark Heaven compares AI models on cost and capability, with benchmark results, charts and provider prices. It is the home of JevBench, a decision-model benchmark that measures accuracy, calibration, latency and cost. The site has a cost-versus-capability chart, a providers-per-model view, a provider explorer, a gateways list, and sections for EU and sovereign models and for image and audio benchmarks. A ranking table shows scores from several sources, including Artificial Analysis coding indexes and DesignArena Elo scores for full-stack and web app tasks. Visitors can filter out deprecated models, show one variant for reasoning models, and limit results to open-weights models. The site notes that evidence requirements, such as benchmark evidence and priced providers, appear above each table they apply to. It is marked as beta and work in progress. Models can be submitted for listing. The project publishes its API documentation and licence on GitHub.
- Price
- Open source
- Category
- AI
- Website
- benchmarkheaven.com



