Open source alternatives to agent-eval

A

agent-eval

Head-to-head comparison of coding agents

agent-eval is an agent skill from ECC, Affaan Mustafa's open-source agentic engineering toolkit, listed on skills.sh. It compares coding agents such as Claude Code, Aider and Codex head to head on reproducible tasks defined in YAML, so choosing an agent or model rests on data. A skill is a SKILL.md file of instructions (sometimes with scripts and reference notes) that an AI agent loads only when a task calls for it, so the agent knows the steps to follow and what to avoid. It is free and open source.