Skip to content
agent-eval

Self-hosted alternatives to agent-eval

5 self-hosted AI Skills apps to use instead, best rated first.

Top picks

  1. C

    claude-to-deerflow

    Launch

    claude-to-deerflow is an agent skill that lets an assistant send messages and questions to a running DeerFlow instance through its HTTP API. DeerFlow is an AI agent platform built on LangGraph that orchestrates sub-agents for research, code

    Self-hosted

  2. O

    open-notebook

    Launch

    open-notebook is an agent skill for organising research with Open Notebook, a self-hosted alternative to NotebookLM. It arranges sources, notes and AI conversations into research notebooks. Sources can be PDFs, web pages, audio, video and O

    Self-hosted

  3. R

    Reactive Resume

    Launch

    Reactive Resume is a free and open-source resume builder for writing resumes and cover letters, checking the work, and tracking job applications. You create a free account, import an existing resume or start from scratch, and see the finish

    Open sourceSelf-hosted

  4. S

    self-hosted-funnel-launch

    Launch

    Self-hosted funnel launch is an agent skill that takes a funnel from an empty install to published on infrastructure you control, using the Autonnel funnel builder, which is licensed Apache-2.0. The result covers a landing page, checkout, a

    Self-hosted

  5. G

    get-convex/convex-backend

    Launch

    Convex is an open-source reactive database for web app developers. It combines a database, a place to write server functions in pure TypeScript, and client libraries that keep the app's data live, so screens update as the data changes. Beca

    Self-hosted

About agent-eval

A

agent-eval

Benchmark CodeGraph retrieval quality on a real codebase

agent-eval is a benchmark skill for CodeGraph, the code intelligence tool. It measures how much CodeGraph helps an agent compared with plain grep and file reading, for a chosen CodeGraph version on a chosen real-world repository. It runs the harness in the repository's scripts/agent-eval folder, so the comparison is made the same way each time. The skill is for maintainers who need evidence before they claim that a CodeGraph change improves retrieval, and for developers who want to decide whether CodeGraph is worth using on their own codebase. It can be started with the agent-eval command or by asking for a quality audit of CodeGraph. The prerequisites are tmux 3 or newer, a logged-in claude command-line client, and node and git on macOS or Linux, and it must be run from the CodeGraph repository root. Because the benchmark starts agent sessions and reads a real repository, it takes time and uses model usage, so pick the repository and version on purpose. The skill's security audit shows a warning from Gen Agent Trust Hub and passes Socket and Snyk on skills.sh. It has about 1,700 installs. Install it with npx skills add https://github.com/colbymchenry/codegraph --skill agent-eval.

Price
Free
Made by
colbymchenry
Category
AI Skills
Website
github.com/colbymchenry/codegraph/agent-eval