Skip to content
DeepEval

Free alternatives to DeepEval

200 free apps like DeepEval, closest match first.

Top picks

  1. A

    ai-evals

    Get

    ai-evals is an agent skill that helps a team build infrastructure for measuring, monitoring and improving AI product quality. It is based on insights from 11 guests and posts across Lenny's Podcast and Newsletter, and it aims to move teams

    Free

  2. A

    ASSERT

    Launch

    ASSERT is an open-source evaluation harness for testing AI agents and LLM applications against requirements you write in plain language. You describe the behaviors that matter for your product, and ASSERT derives behavior categories, genera

    FreeOpen source

  3. L

    llm-evaluation

    Get

    llm-evaluation is an agent skill from the wshobson/agents collection for designing evaluation strategies for LLM applications. It combines automated metrics, human feedback and benchmarking to measure how well an application performs. Autom

    Free

  4. E

    eval-driven-dev

    Get

    eval-driven-dev is an agent skill from the github/awesome-copilot collection for building an evaluation pipeline that tests a Python LLM application end to end. The pipeline runs the application the way a real user would, with real inputs,

    Free

  5. A

    Agent Qa

    Launch

    Open-source self-improving QA agent for software teams. A test harness with memory. Write tests in natural language for web and mobile. agent-qa learns from every run, adapts to UI changes, and catches regressions before you ship.

    FreeOpen source

  6. L

    Litefuse

    Launch

    Ship reliable AI agents with evaluation-driven development. OpenTelemetry-native and Langfuse SDK compatible, powered by Apache Doris — lightweight deployment, 80% lower storage cost, built-in support for Claude Code, OpenClaw, and Hermes.

    FreeOpen source

More like DeepEval

7
L

langsmith-evaluator

INVOKE THIS SKILL when building evaluation pipelines for LangSmith

Get
8
A

Autonoma

Open-source testing platform where AI agents navigate your app end-to-end

Launch
9
E

eval-audit

Audit an LLM eval pipeline and surface problems: missing error analysis

Get
10
A

AIQualityHQ

Free deterministic AI prompt quality checker

Launch
11
P

phoenix-evals

Build and run evaluators for AI/LLM applications using Phoenix

Get
12
A

agent-platform-eval-flywheel

Measures and improves the quality of AI models and agents on Google Cloud

Get
13
H

Harness Score

Your AI coding agent is only as reliable as the harness around it

Launch
14
P

Prompttools

Open-source tools for prompt testing and experimentation

Launch
15
H

health

Audits agent config, instruction drift, hooks or MCP, and AI maintainability

Get
16
O

Obot AI

Complete AI Governance Platform from Obot AI

Launch
17
P

promptfoo-evaluation

Configures and runs LLM evaluation using Promptfoo framework

Get
18
A

arize-evaluator

Handles LLM-as-judge

Get
19
K

Keywords AI

Free LLM dashboard

Launch
20
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

Launch
21
A

agents-optimize

Measuring or improving agent quality and performance

Get
22
O

observability-llm-obs

Answer questions about LLM and agentic-application behavior

Get
23
D

deepeval

DeepEval evaluation workflow for AI agents and LLM applications

Get
24
B

Bitloops

Give AI coding agents the context they need to ship production-quality software

Launch
25
A

Aislop

Catch and fix the code-quality issues AI coding agents leave behind

Launch
26
G

google-agents-cli-eval

Evaluate ADK agents with metrics, evalsets, and the iterative eval-fix loop

Get
27
A

agent-inspect

Local evidence debugger and trajectory-test toolkit

Launch
28
O

OpenLIT: Zero code Agent Observability

Continuous feedback for testing, tracing & fixing AI agents

Launch
29
A

AI Testing Tools

Find your next AI-powered testing tool and enhance your software testing process

Launch
30
L

LLM Readiness Check

Test your site's readiness for AI crawlers in 10 seconds

Launch
31
W

writing-evals

Scaffolds evaluation suites for the Axiom AI SDK

Get
32
A

Axolotl

AI-powered QA agent for VS Code

Launch
33
P

Promptmap

a security scanner for custom LLM applications

Launch
34
L

langsmith-online-eval-engineering

Iteratively inspect traces, interview the user

Get
35
T

Traceml

Engine for AI/ML/Data tracking, visualization, explainability, drift detection

Launch
36
B

BugTraceAI

Open-source, self-hosted web pentesting suite

Launch
37
A

AngusTester

AI-native software testing platform

Launch
38
L

Litmux

Unit tests for AI. Test prompts, compare models, save money

Launch
39
M

Manifest

A complete backend in a single YAML file

Launch
40
P

Psters_AI_Workflow

An auto-documenting, model-agnostic AI workflow for any project, framework

Launch
41
F

Finalrun Agent

AI QA Agent for mobile apps

Launch
42
Q

quality-playbook

Run a complete quality engineering audit on any codebase

Get
43
T

testing

Testing, QA, and quality gates

Get
44
A

ai-engineer

Build production-ready LLM applications, advanced RAG systems

Get
45
N

NeuralTrust

The Platform for AI and Agent Security

Launch
46
O

online-evals

Attach judges to config variations for automatic LLM-as-a-judge evaluation

Get
47
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
48
L

langchain4j-testing-strategies

Provides unit test, integration test

Get
49
S

SkaleAgents

Control plane for AI DevOps agents

Launch
50
A

Abacus.AI

Platform that helps businesses integrate AI into their applications

Launch

About DeepEval

D

DeepEval

LLM 界的 Pytest。将评测集成到 CI/CD 流程中,支持 50+ 指标

Confident AI is the AI quality platform for enterprise teams to standardize AI evals and observability across the org — one consistent bar for how every team measures and monitors their AI.

Category
AI
Website
confident-ai.com