Open source alternatives to DeepEval
200 open source apps like DeepEval, closest match first.
Top picks
- A
ASSERT
LaunchASSERT is an open-source evaluation harness for testing AI agents and LLM applications against requirements you write in plain language. You describe the behaviors that matter for your product, and ASSERT derives behavior categories, genera
FreeOpen source
- L

Langfuse
LaunchTrace, evaluate, and improve AI agents with one open platform. Use production data to understand behavior, collaborate on fixes, and ship better quality at lower cost and latency.
Open sourceSelf-hosted
- A
Agent Qa
LaunchOpen-source self-improving QA agent for software teams. A test harness with memory. Write tests in natural language for web and mobile. agent-qa learns from every run, adapts to UI changes, and catches regressions before you ship.
FreeOpen source
- L

Litefuse
LaunchShip reliable AI agents with evaluation-driven development. OpenTelemetry-native and Langfuse SDK compatible, powered by Apache Doris — lightweight deployment, 80% lower storage cost, built-in support for Claude Code, OpenClaw, and Hermes.
FreeOpen source
- L

LangWatch
LaunchLangWatch is a platform for testing, evaluating and observing AI agents and LLM applications. It runs simulations of realistic user scenarios against an agent, including red-teaming for safety and security gaps, and it lets you write scenar
Open source
- H
Harness Score
LaunchYour AI coding agent is only as reliable as the harness around it. Measure that harness in seconds with harness-score.
FreeOpen source
More like DeepEval
About DeepEval
DeepEval
LLM 界的 Pytest。将评测集成到 CI/CD 流程中,支持 50+ 指标
Confident AI is the AI quality platform for enterprise teams to standardize AI evals and observability across the org — one consistent bar for how every team measures and monitors their AI.
- Category
- AI
- Website
- confident-ai.com



