
Description
agentic-eval is an agent skill from the github/awesome-copilot collection that teaches iterative evaluation and refinement, so an agent can assess and improve its own output instead of accepting the first draft. The loop runs generate, evaluate, critique, refine and output, and it repeats until the result meets the criteria. The skill describes three core patterns. Basic reflection is a self-critique loop in which the agent reviews its own work. The evaluator-optimizer pattern separates generation from evaluation, so one step produces the output and another judges it, which tends to catch errors that the author misses. Code-specific test-driven refinement uses tests as the evaluator, so changes are kept only when they pass. The skill says when the approach pays off: quality-critical generation such as code, reports and analysis that must be accurate, tasks with clear evaluation criteria where success can be defined, and content that must meet a style guide, compliance rules or formatting requirements. It is less useful when there is no way to judge the output, because a loop with no criteria just rewrites text. The patterns cost extra model calls, so the number of rounds should be bounded. The skill is installed with the skills CLI from the github/awesome-copilot repository. Its skills.sh page showed about 10.2K installs and passing results from three security audits at the time of the scan.…
Highlights
- Self-critique and reflection loops
- Separated generator and evaluator
- Test-driven refinement for code
- Use cases with clear evaluation criteria
- Bounded refinement rounds
- Installs with the skills CLI
Ratings & Reviews
No ratings yet
Be the first to rate agentic-eval.
People also visit

loop-design-check
Design a goal-oriented agent loop or review one for failure modes: spinning
agentic-eval FAQ
What is the loop?
Generate, evaluate, critique, refine, then output, repeating until the result meets the criteria.
What are the three patterns?
Basic reflection, an evaluator-optimizer that separates generation from evaluation, and test-driven refinement for code.
When is it worth using?
For quality-critical output with clear criteria, such as code, reports and content that must follow a style or compliance standard.
What is the cost?
Extra model calls for each round, so the skill's approach is to bound the number of rounds.
How do I install it?
Run npx skills add https://github.com/github/awesome-copilot --skill agentic-eval.
What security audits does it have?
skills.sh lists three audits: Gen Agent Trust Hub Pass, Socket Pass and Snyk Pass.
What are the best agentic-eval alternatives?
Popular alternatives to agentic-eval include eval-harness, loop-design-check and microsoft-foundry. See all agentic-eval alternatives










