Open source alternatives to ProgramBench
200 open source apps like ProgramBench, closest match first.
Top picks
- A
Appl
LaunchAPPL is a prompt programming language that extends Python. It lets you write natural language prompts directly inside Python programs, so a prompt sits next to the code that uses it and can be reused and modified like any other part of the
FreeOpen source
- E
Evalplus
LaunchEvalPlus is a framework for rigorous evaluation of code that large language models synthesize. It is used with the HumanEval and MBPP coding benchmarks and provides enhanced versions called HumanEval+ and MBPP+. The project also includes Ev
FreeOpen source
- W
- T
The Pair
LaunchOpen-source AI pair programming for desktop: a Mentor + Executor agent cross-check each other's code to catch AI hallucinations. Works with Claude Code, Codex, Gemini & opencode. macOS / Windows / Linux.
FreeOpen source
- A
Aacr Bench
LaunchAn Alibaba open-source multi-language benchmark for evaluating LLMs in repository-level automatic code review, featuring an AI-assisted and expert-verified dataset.
FreeOpen source
- A

aider
LaunchAider is a terminal-based AI pair programming tool. You run it in a project folder and ask, in plain language, for changes to existing code or for a new project, using LLMs such as Claude, GPT and DeepSeek, or local models. It builds a map
FreeOpen source
More like ProgramBench
Psters_AI_Workflow
An auto-documenting, model-agnostic AI workflow for any project, framework
Codex Chatgpt Bridge
A safe bridge for Codex and ChatGPT to hand off coding work, save tokens
System Prompts And Models Of AI Tools
FULL Augment Code, Claude Code, Cluely, CodeBuddy, Comet, Cursor, Devin AI
About ProgramBench
ProgramBench
ProgramBench evaluates whether language models can rebuild programs from scratch
ProgramBench evaluates whether language models can rebuild programs from scratch.
- Category
- AI
- Website
- programbench.com
