Skip to content
ProgramBench

Free alternatives to ProgramBench

200 free apps like ProgramBench, closest match first.

Top picks

  1. A

    Appl

    Launch

    APPL is a prompt programming language that extends Python. It lets you write natural language prompts directly inside Python programs, so a prompt sits next to the code that uses it and can be reused and modified like any other part of the

    FreeOpen source

  2. E

    Evalplus

    Launch

    EvalPlus is a framework for rigorous evaluation of code that large language models synthesize. It is used with the HumanEval and MBPP coding benchmarks and provides enhanced versions called HumanEval+ and MBPP+. The project also includes Ev

    FreeOpen source

  3. W

    WritingBench

    Launch

    WritingBench: A Comprehensive Benchmark for Generative Writing

    FreeOpen source

  4. T

    The Pair

    Launch

    Open-source AI pair programming for desktop: a Mentor + Executor agent cross-check each other's code to catch AI hallucinations. Works with Claude Code, Codex, Gemini & opencode. macOS / Windows / Linux.

    FreeOpen source

  5. A

    Aacr Bench

    Launch

    An Alibaba open-source multi-language benchmark for evaluating LLMs in repository-level automatic code review, featuring an AI-assisted and expert-verified dataset.

    FreeOpen source

  6. A

    aider

    Launch

    Aider is a terminal-based AI pair programming tool. You run it in a project folder and ask, in plain language, for changes to existing code or for a new project, using LLMs such as Claude, GPT and DeepSeek, or local models. It builds a map

    FreeOpen source

More like ProgramBench

7
L

Language Model Builder

Build models. Understand AI

Launch
8
P

PromptScript

Prompt-as-Code for Enterprise AI

Launch
9
M

Machinist

Open source software factory infrastructure for advanced AI coding workflows

Launch
10
P

PMB

Local-first persistent memory for AI coding agents

Launch
11
G

Gem Team

Turn AI coding into an engineering process

Launch
12
Y

Your-source-to-prompt.html

Quickly and securely turn your code projects into LLM prompts

Launch
13
H

Harness Score

Your AI coding agent is only as reliable as the harness around it

Launch
14
A

Antivibe

Learn what AI writes, not just accept it

Launch
15
P

Psters_AI_Workflow

An auto-documenting, model-agnostic AI workflow for any project, framework

Launch
16
M

Meta_Kim

Governed execution layer for AI coding assistants: clarify intent

Launch
17
C

Claude Code Java

Reusable AI development infrastructure for Java projects

Launch
18
A

Auto Dev

AutoDev: the Multi-Agent coding development platform built on Kotlin

Launch
19
B

BitBuilder

Turning every engineer into a 10x engineer with AI

Launch
20
D

DeepSeek-Reasonix

A reliable coding agent for complex software engineering tasks

Launch
21
C

Codemap

a project brain for your AI

Launch
22
B

Bitloops

Give AI coding agents the context they need to ship production-quality software

Launch
23
B

bmad-build-auto

One iteration of an unattended development loop. Use when invoked by name

Get
24
D

Devcodex

Intent-driven AI coding workflow runtime for consistent context, skills

Launch
25
L

LafTools

The next generation of a AI-based toolbox designed for programmers

Launch
26
A

ASSERT

Requirement-driven evaluation harness for AI agents and LLM applications

Launch
27
C

Codex Chatgpt Bridge

A safe bridge for Codex and ChatGPT to hand off coding work, save tokens

Launch
28
O

Open Agent

Open-source AI agent that brings the power of open models directly into your

Launch
29
S

System Prompts And Models Of AI Tools

FULL Augment Code, Claude Code, Cluely, CodeBuddy, Comet, Cursor, Devin AI

Launch
30
C

CodingIT

CodinIT.dev Demo | Open-source, AI app builder prototype 🌟 Star to support…

Launch
31
R

remember-interactive-programming

Micro-prompt that reinforces interactive programming workflows

Get
32
E

eval-driven-dev

Improve AI application with evaluation-driven development

Get
33
A

agent-eval

Benchmark CodeGraph retrieval quality on a real codebase

Get
34
D

deepeval

DeepEval evaluation workflow for AI agents and LLM applications

Get
35
S

Spec Kit ZH

Chinese-localized spec-driven development toolkit for Codex, Claude Code

Launch
36
C

ContribAI

Maintainer-governed agent for evidence-backed open-source contribution proposals

Launch
37
C

Cve Bench

CVE-Bench: A Benchmark for AI Agents’ Ability

Launch
38
1

1atatime

Ready-to-use prompts and workflows for developers using AI coding tools

Launch
39
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
40
P

Penelopa.ai

Continuous improvement for AI coding agents: Penelopa analyzes real Codex

Launch
41
A

ai-engineer

Implementing AI/ML features, integrating language models

Get
42
C

Codexmate

One dashboard for all your local AI coding agents

Launch
43
C

CLI Continues

resume any AI coding session in another tool

Launch
44
P

Promptulate

Lightweight Large language model automation

Launch
45
C

Codai

AI coding agent for your terminal

Launch
46
C

Codehamr

A minimal, local-first coding agent for the terminal

Launch
47
C

Codirigent

A Rust based terminal workspace for multiple AI coding CLIs in parallel

Launch
48
E

Empryo

AI coding harness for desktop, terminal and CI

Launch
49
A

AI Codex

Generate a compact codebase index for AI assistants

Launch
50
L

langsmith-evaluator

INVOKE THIS SKILL when building evaluation pipelines for LangSmith

Get

About ProgramBench

P

ProgramBench

ProgramBench evaluates whether language models can rebuild programs from scratch

ProgramBench evaluates whether language models can rebuild programs from scratch.

Category
AI
Website
programbench.com