Skip to content
DeepEval

Open source alternatives to DeepEval

200 open source apps like DeepEval, closest match first.

Top picks

  1. A

    ASSERT

    Launch

    ASSERT is an open-source evaluation harness for testing AI agents and LLM applications against requirements you write in plain language. You describe the behaviors that matter for your product, and ASSERT derives behavior categories, genera

    FreeOpen source

  2. L

    Langfuse

    Launch

    Trace, evaluate, and improve AI agents with one open platform. Use production data to understand behavior, collaborate on fixes, and ship better quality at lower cost and latency.

    Open sourceSelf-hosted

  3. A

    Agent Qa

    Launch

    Open-source self-improving QA agent for software teams. A test harness with memory. Write tests in natural language for web and mobile. agent-qa learns from every run, adapts to UI changes, and catches regressions before you ship.

    FreeOpen source

  4. L

    Litefuse

    Launch

    Ship reliable AI agents with evaluation-driven development. OpenTelemetry-native and Langfuse SDK compatible, powered by Apache Doris — lightweight deployment, 80% lower storage cost, built-in support for Claude Code, OpenClaw, and Hermes.

    FreeOpen source

  5. L

    LangWatch

    Launch

    LangWatch is a platform for testing, evaluating and observing AI agents and LLM applications. It runs simulations of realistic user scenarios against an agent, including red-teaming for safety and security gaps, and it lets you write scenar

    Open source

  6. H

    Harness Score

    Launch

    Your AI coding agent is only as reliable as the harness around it. Measure that harness in seconds with harness-score.

    FreeOpen source

More like DeepEval

7
P

Prompttools

Open-source tools for prompt testing and experimentation

Launch
8
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
9
O

Obot AI

Complete AI Governance Platform from Obot AI

Launch
10
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

Launch
11
B

Bitloops

Give AI coding agents the context they need to ship production-quality software

Launch
12
A

Aislop

Catch and fix the code-quality issues AI coding agents leave behind

Launch
13
A

agent-inspect

Local evidence debugger and trajectory-test toolkit

Launch
14
A

Agenta

Open-source LLMOps platform for prompt management, LLM evaluation

Launch
15
C

Continue

Open-source AI code assistant

Launch
16
O

OpenLIT: Zero code Agent Observability

Continuous feedback for testing, tracing & fixing AI agents

Launch
17
A

Axolotl

AI-powered QA agent for VS Code

Launch
18
P

Promptmap

a security scanner for custom LLM applications

Launch
19
T

Traceml

Engine for AI/ML/Data tracking, visualization, explainability, drift detection

Launch
20
B

BugTraceAI

Open-source, self-hosted web pentesting suite

Launch
21
A

AngusTester

AI-native software testing platform

Launch
22
L

Litmux

Unit tests for AI. Test prompts, compare models, save money

Launch
23
M

Manifest

A complete backend in a single YAML file

Launch
24
P

Psters_AI_Workflow

An auto-documenting, model-agnostic AI workflow for any project, framework

Launch
25
F

Finalrun Agent

AI QA Agent for mobile apps

Launch
26
D

DashClaw

Remote approvals, policy checks, and execution evidence for unattended AI agents

Launch
27
N

NeuralTrust

The Platform for AI and Agent Security

Launch
28
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
29
A

Abacus.AI

Platform that helps businesses integrate AI into their applications

Launch
30
I

Instrukt

Integrated AI environment in the terminal. Build, test and instruct agents

Launch
31
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
32
L

Loongsuite Pilot

Local-first telemetry collector for AI coding agents

Launch
33
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
34
A

Adrian

Open-source runtime AI agent security tool

Launch
35
O

Opik

Evaluate, test

Launch
36
S

Shippie

extendable code review and QA agent

Launch
37
Y

Your-source-to-prompt.html

Quickly and securely turn your code projects into LLM prompts

Launch
38
D

diffay

Multi-agent AI code review

Launch
39
M

MOVO

Turn DeepSeek Harness into a self-hosted enterprise Agent platform

Launch
40
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
41
M

MLFlow

Track, store, visualize, analyze

Launch
42
A

AI Manager

AI Manager desktop application for AI coding tools

Launch
43
P

Promptflow

Build high-quality LLM apps - from prototyping, testing to production…

Launch
44
G

Gem Team

Turn AI coding into an engineering process

Launch
45
L

LMRing

Open-source, self-hostable LLM arena

Launch
46
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
47
N

nanostack

A workflow harness that helps AI coding agents plan, review, test

Launch
48
A

AI LLM Comparison

A website where you can compare every AI Model

Launch
49
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
50
L

Langkit

An open-source toolkit for monitoring Large Language Models (LLMs)

Launch

About DeepEval

D

DeepEval

LLM 界的 Pytest。将评测集成到 CI/CD 流程中,支持 50+ 指标

Confident AI is the AI quality platform for enterprise teams to standardize AI evals and observability across the org — one consistent bar for how every team measures and monitors their AI.

Category
AI
Website
confident-ai.com