Skip to content
agent-platform-eval-flywheel

Self-hosted alternatives to agent-platform-eval-flywheel

5 self-hosted AI Skills apps to use instead, best rated first.

Top picks

  1. C

    claude-to-deerflow

    Launch

    claude-to-deerflow is an agent skill that lets an assistant send messages and questions to a running DeerFlow instance through its HTTP API. DeerFlow is an AI agent platform built on LangGraph that orchestrates sub-agents for research, code

    Self-hosted

  2. O

    open-notebook

    Launch

    open-notebook is an agent skill for organising research with Open Notebook, a self-hosted alternative to NotebookLM. It arranges sources, notes and AI conversations into research notebooks. Sources can be PDFs, web pages, audio, video and O

    Self-hosted

  3. R

    Reactive Resume

    Launch

    Reactive Resume is a free and open-source resume builder for writing resumes and cover letters, checking the work, and tracking job applications. You create a free account, import an existing resume or start from scratch, and see the finish

    Open sourceSelf-hosted

  4. S

    self-hosted-funnel-launch

    Launch

    Self-hosted funnel launch is an agent skill that takes a funnel from an empty install to published on infrastructure you control, using the Autonnel funnel builder, which is licensed Apache-2.0. The result covers a landing page, checkout, a

    Self-hosted

  5. G

    get-convex/convex-backend

    Launch

    Convex is an open-source reactive database for web app developers. It combines a database, a place to write server functions in pure TypeScript, and client libraries that keep the app's data live, so screens update as the data changes. Beca

    Self-hosted

About agent-platform-eval-flywheel

A

agent-platform-eval-flywheel

Measures and improves the quality of AI models and agents on Google Cloud

Agent Platform eval flywheel is an agent skill for measuring and improving the quality of generative AI models and agents on Google Cloud. It uses the Agent Platform GenAI Evaluation SDK, through client.evals.evaluate(), and follows what the skill calls the Eval Quality Flywheel, a loop in which you evaluate, read the results, change the system and evaluate again. The skill covers creating evaluation datasets from session traces, from pandas DataFrames or by synthetic generation, selecting and configuring evaluation metrics and writing custom ones, and analyzing rubric verdicts, loss patterns and clusters of failures. Based on the results, it suggests concrete code or prompt changes. It can also evaluate a model served on an Agent Platform endpoint, a bring-your-own model, or a Model-as-a-Service model by ID, and it will deploy the model first when needed, using the deployment reference and the endpoint and MaaS evaluation scripts it includes. The skill is useful for teams that want an evidence-based way to tell whether a model or agent change made things better or worse. It is published by Google on skills.sh under the google skills repository, and the listing shows Gen Agent Trust Hub, Socket and Snyk all passing.

Price
Free
Made by
google
Category
AI Skills
Website
github.com/google/skills/agent-platform-eval-flywheel