Self-hosted alternatives to agent-platform-eval-flywheel
5 self-hosted AI Skills apps to use instead, best rated first.
Top picks
- C

claude-to-deerflow
Launchclaude-to-deerflow is an agent skill that lets an assistant send messages and questions to a running DeerFlow instance through its HTTP API. DeerFlow is an AI agent platform built on LangGraph that orchestrates sub-agents for research, code
Self-hosted
- O

open-notebook
Launchopen-notebook is an agent skill for organising research with Open Notebook, a self-hosted alternative to NotebookLM. It arranges sources, notes and AI conversations into research notebooks. Sources can be PDFs, web pages, audio, video and O
Self-hosted
- R

Reactive Resume
LaunchReactive Resume is a free and open-source resume builder for writing resumes and cover letters, checking the work, and tracking job applications. You create a free account, import an existing resume or start from scratch, and see the finish
Open sourceSelf-hosted
- S

self-hosted-funnel-launch
LaunchSelf-hosted funnel launch is an agent skill that takes a funnel from an empty install to published on infrastructure you control, using the Autonnel funnel builder, which is licensed Apache-2.0. The result covers a landing page, checkout, a
Self-hosted
- G

get-convex/convex-backend
LaunchConvex is an open-source reactive database for web app developers. It combines a database, a place to write server functions in pure TypeScript, and client libraries that keep the app's data live, so screens update as the data changes. Beca
Self-hosted
About agent-platform-eval-flywheel

agent-platform-eval-flywheel
Measures and improves the quality of AI models and agents on Google Cloud
Agent Platform eval flywheel is an agent skill for measuring and improving the quality of generative AI models and agents on Google Cloud. It uses the Agent Platform GenAI Evaluation SDK, through client.evals.evaluate(), and follows what the skill calls the Eval Quality Flywheel, a loop in which you evaluate, read the results, change the system and evaluate again. The skill covers creating evaluation datasets from session traces, from pandas DataFrames or by synthetic generation, selecting and configuring evaluation metrics and writing custom ones, and analyzing rubric verdicts, loss patterns and clusters of failures. Based on the results, it suggests concrete code or prompt changes. It can also evaluate a model served on an Agent Platform endpoint, a bring-your-own model, or a Model-as-a-Service model by ID, and it will deploy the model first when needed, using the deployment reference and the endpoint and MaaS evaluation scripts it includes. The skill is useful for teams that want an evidence-based way to tell whether a model or agent change made things better or worse. It is published by Google on skills.sh under the google skills repository, and the listing shows Gen Agent Trust Hub, Socket and Snyk all passing.
- Price
- Free
- Made by
- Category
- AI Skills
- Website
- github.com/google/skills/agent-platform-eval-flywheel