Open source alternatives to agent-eval
24 open source AI Skills apps to use instead, best rated first.
Top picks
- G
github-ops
Launchgithub-ops is an agent skill from the ECC collection by affaan-m, listed on skills.sh. It manages a GitHub repository with a focus on community health, CI reliability and the experience of contributors. It covers triaging issues by classify
Open source
- O
opensource-pipeline
Launchopensource-pipeline is an agent skill from the ECC collection by affaan-m, listed on skills.sh. It prepares a private project for safe public release through a three-stage pipeline. The fork stage strips secrets from a copy. The sanitise st
Open source
- A
andrej-karpathy-skills
Launchandrej-karpathy-skills is a single CLAUDE.md file from the multica-ai project that is meant to improve how Claude Code behaves on coding tasks. It is derived from Andrej Karpathy's public observations about LLM coding pitfalls. The file dis
Open source
- M
microsoft/markitdown
Launchmarkitdown-mcp is the MCP server package for MarkItDown, Microsoft's tool for converting many file formats to Markdown for language models. It is a lightweight server that runs over stdio, Streamable HTTP or SSE, and exposes one tool, conve
Open source
- O
od-contribute
Launchod-contribute is an agent skill in the OpenDesign project that provides a guided, one-click contribution flow to the OpenDesign repository, written so that people without a coding background can send a real pull request. It is locked to the
Open source
- G
github-deep-research
Launchgithub-deep-research is an agent skill from the DeerFlow project that researches a single GitHub repository in several rounds and writes a report in Markdown. It is for requests that need more than a README summary, such as a comprehensive
Open source
More AI Skills apps
modelcontextprotocol/server-memory
Knowledge graph-based persistent memory for maintaining context
netdata/netdata#Netdata
Discovery, exploration, reporting and root cause analysis over Netdata metrics
Learn Claude Code
by shareAI-lab - A really interesting analysis of how coding agents like Claude
About agent-eval
agent-eval
Benchmark CodeGraph retrieval quality on a real codebase
agent-eval is a benchmark skill for CodeGraph, the code intelligence tool. It measures how much CodeGraph helps an agent compared with plain grep and file reading, for a chosen CodeGraph version on a chosen real-world repository. It runs the harness in the repository's scripts/agent-eval folder, so the comparison is made the same way each time. The skill is for maintainers who need evidence before they claim that a CodeGraph change improves retrieval, and for developers who want to decide whether CodeGraph is worth using on their own codebase. It can be started with the agent-eval command or by asking for a quality audit of CodeGraph. The prerequisites are tmux 3 or newer, a logged-in claude command-line client, and node and git on macOS or Linux, and it must be run from the CodeGraph repository root. Because the benchmark starts agent sessions and reads a real repository, it takes time and uses model usage, so pick the repository and version on purpose. The skill's security audit shows a warning from Gen Agent Trust Hub and passes Socket and Snyk on skills.sh. It has about 1,700 installs. Install it with npx skills add https://github.com/colbymchenry/codegraph --skill agent-eval.
- Price
- Free
- Made by
- colbymchenry
- Category
- AI Skills
- Website
- github.com/colbymchenry/codegraph/agent-eval