Skip to content
ProgramBench

Alternatives to ProgramBench

200 apps like ProgramBench, closest match first.

Top picks

  1. A

    Appl

    Launch

    APPL is a prompt programming language that extends Python. It lets you write natural language prompts directly inside Python programs, so a prompt sits next to the code that uses it and can be reused and modified like any other part of the

    FreeOpen source

  2. E

    Evalplus

    Launch

    EvalPlus is a framework for rigorous evaluation of code that large language models synthesize. It is used with the HumanEval and MBPP coding benchmarks and provides enhanced versions called HumanEval+ and MBPP+. The project also includes Ev

    FreeOpen source

  3. W

    WritingBench

    Launch

    WritingBench: A Comprehensive Benchmark for Generative Writing

    FreeOpen source

  4. T

    The Pair

    Launch

    Open-source AI pair programming for desktop: a Mentor + Executor agent cross-check each other's code to catch AI hallucinations. Works with Claude Code, Codex, Gemini & opencode. macOS / Windows / Linux.

    FreeOpen source

  5. A

    Aacr Bench

    Launch

    An Alibaba open-source multi-language benchmark for evaluating LLMs in repository-level automatic code review, featuring an AI-assisted and expert-verified dataset.

    FreeOpen source

  6. B

    BenchGen

    Launch

    BenchGen is an infrastructure platform for benchmarking AI agents. It runs agents inside interactive simulated environments, where they work through multi-step tasks with tool calls, data retrieval and a series of decisions. The platform re

More like ProgramBench

7
P

Pac-Bench

PacBench: how well a model and harness can recreate Pac-Man from a single prompt

Launch
8
A

aider

AI pair programming in your terminal, supporting multiple LLM providers

Launch
9
L

Language Model Builder

Build models. Understand AI

Launch
10
P

PromptScript

Prompt-as-Code for Enterprise AI

Launch
11
M

Machinist

Open source software factory infrastructure for advanced AI coding workflows

Launch
12
P

PMB

Local-first persistent memory for AI coding agents

Launch
13
G

Gem Team

Turn AI coding into an engineering process

Launch
14
Y

Your-source-to-prompt.html

Quickly and securely turn your code projects into LLM prompts

Launch
15
H

Harness Score

Your AI coding agent is only as reliable as the harness around it

Launch
16
B

Blog post

Setting a new state of the art on the SWE-bench coding benchmark

Launch
17
A

Antivibe

Learn what AI writes, not just accept it

Launch
18
P

Psters_AI_Workflow

An auto-documenting, model-agnostic AI workflow for any project, framework

Launch
19
P

Parsimony

An open-source benchmark of how much code AI models add

Launch
20
M

Meta_Kim

Governed execution layer for AI coding assistants: clarify intent

Launch
21
C

Claude Code Java

Reusable AI development infrastructure for Java projects

Launch
22
A

Auto Dev

AutoDev: the Multi-Agent coding development platform built on Kotlin

Launch
23
B

BitBuilder

Turning every engineer into a 10x engineer with AI

Launch
24
M

MirajeLabs

Analyze and fix AI-generated code errors

Launch
25
D

DeepSeek-Reasonix

A reliable coding agent for complex software engineering tasks

Launch
26
C

Codemap

a project brain for your AI

Launch
27
B

Bitloops

Give AI coding agents the context they need to ship production-quality software

Launch
28
B

bmad-build-auto

One iteration of an unattended development loop. Use when invoked by name

Get
29
R

Roboweb

Revolutionize programming

Launch
30
D

Devcodex

Intent-driven AI coding workflow runtime for consistent context, skills

Launch
31
L

LafTools

The next generation of a AI-based toolbox designed for programmers

Launch
32
A

ASSERT

Requirement-driven evaluation harness for AI agents and LLM applications

Launch
33
B

Boundary

The programming language for AI

Launch
34
C

Codex Chatgpt Bridge

A safe bridge for Codex and ChatGPT to hand off coding work, save tokens

Launch
35
O

Open Agent

Open-source AI agent that brings the power of open models directly into your

Launch
36
R

REX-codebase/fable-mode

Control plane for AI coding agents: time-locks writing

Get
37
S

System Prompts And Models Of AI Tools

FULL Augment Code, Claude Code, Cluely, CodeBuddy, Comet, Cursor, Devin AI

Launch
38
C

CodingIT

CodinIT.dev Demo | Open-source, AI app builder prototype 🌟 Star to support…

Launch
39
R

remember-interactive-programming

Micro-prompt that reinforces interactive programming workflows

Get
40
E

eval-driven-dev

Improve AI application with evaluation-driven development

Get
41
A

Auto Claude

Autonomous multi-session AI coding

Launch
42
R

Recurse ML

Find bugs in AI Generated Code

Launch
43
A

agent-eval

Benchmark CodeGraph retrieval quality on a real codebase

Get
44
A

Aide

AI-Native Developer Tools

Launch
45
D

deepeval

DeepEval evaluation workflow for AI agents and LLM applications

Get
46
S

Spec Kit ZH

Chinese-localized spec-driven development toolkit for Codex, Claude Code

Launch
47
C

ContribAI

Maintainer-governed agent for evidence-backed open-source contribution proposals

Launch
48
B

Buildt

Find, Generate & Replace Anything In Your Code

Launch
49
C

Cve Bench

CVE-Bench: A Benchmark for AI Agents’ Ability

Launch
50
K

kodwai

Agentic coding challenges you solve on your own machine with your own AI agent

Launch

About ProgramBench

P

ProgramBench

ProgramBench evaluates whether language models can rebuild programs from scratch

ProgramBench evaluates whether language models can rebuild programs from scratch.

Category
AI
Website
programbench.com