Skip to content
A

agentic-eval

Iterative evaluation and refinement patterns

by githubFree

Launch
#1874in AI Skills
0In stores

Description

agentic-eval is an agent skill from the github/awesome-copilot collection that teaches iterative evaluation and refinement, so an agent can…

Highlights

  • Self-critique and reflection loops
  • Separated generator and evaluator
  • Test-driven refinement for code
  • Use cases with clear evaluation criteria
  • Bounded refinement rounds
  • Installs with the skills CLI

Ratings & Reviews

No ratings yet

Be the first to rate agentic-eval.

People also visit

E

eval-harness

Eval-driven development (EDD) framework for AI coding sessions

AI Skills
Launch
L

loop-design-check

Design a goal-oriented agent loop or review one for failure modes: spinning

AI Skills
Launch
M

microsoft-foundry

End-to-end deployment, evaluation

AI Skills
Launch
E

eval-harness-first

Build the evaluation harness that gates every fine-tuning run

AI Skills
Launch
E

evaluation-methodology

PluginEval quality methodology, covering dimensions, rubrics

AI Skills
Launch
I

implementing-agent-modes

Guidelines to create/update a new mode for PostHog AI agent

AI Skills
Launch

agentic-eval FAQ

What is the loop?

Generate, evaluate, critique, refine, then output, repeating until the result meets the criteria.

What are the three patterns?

Basic reflection, an evaluator-optimizer that separates generation from evaluation, and test-driven refinement for code.

When is it worth using?

For quality-critical output with clear criteria, such as code, reports and content that must follow a style or compliance standard.

What is the cost?

Extra model calls for each round, so the skill's approach is to bound the number of rounds.

How do I install it?

Run npx skills add https://github.com/github/awesome-copilot --skill agentic-eval.

What security audits does it have?

skills.sh lists three audits: Gen Agent Trust Hub Pass, Socket Pass and Snyk Pass.

What are the best agentic-eval alternatives?

Popular alternatives to agentic-eval include eval-harness, loop-design-check and microsoft-foundry. See all agentic-eval alternatives

Developer Stuff

Badges