Open source alternatives to agent-platform-eval-flywheel
24 open source AI Skills apps to use instead, best rated first.
Top picks
- G
github-ops
Launchgithub-ops is an agent skill from the ECC collection by affaan-m, listed on skills.sh. It manages a GitHub repository with a focus on community health, CI reliability and the experience of contributors. It covers triaging issues by classify
Open source
- O
opensource-pipeline
Launchopensource-pipeline is an agent skill from the ECC collection by affaan-m, listed on skills.sh. It prepares a private project for safe public release through a three-stage pipeline. The fork stage strips secrets from a copy. The sanitise st
Open source
- A
andrej-karpathy-skills
Launchandrej-karpathy-skills is a single CLAUDE.md file from the multica-ai project that is meant to improve how Claude Code behaves on coding tasks. It is derived from Andrej Karpathy's public observations about LLM coding pitfalls. The file dis
Open source
- M
microsoft/markitdown
Launchmarkitdown-mcp is the MCP server package for MarkItDown, Microsoft's tool for converting many file formats to Markdown for language models. It is a lightweight server that runs over stdio, Streamable HTTP or SSE, and exposes one tool, conve
Open source
- O
od-contribute
Launchod-contribute is an agent skill in the OpenDesign project that provides a guided, one-click contribution flow to the OpenDesign repository, written so that people without a coding background can send a real pull request. It is locked to the
Open source
- G
github-deep-research
Launchgithub-deep-research is an agent skill from the DeerFlow project that researches a single GitHub repository in several rounds and writes a report in Markdown. It is for requests that need more than a README summary, such as a comprehensive
Open source
More AI Skills apps
modelcontextprotocol/server-memory
Knowledge graph-based persistent memory for maintaining context
netdata/netdata#Netdata
Discovery, exploration, reporting and root cause analysis over Netdata metrics
Learn Claude Code
by shareAI-lab - A really interesting analysis of how coding agents like Claude
About agent-platform-eval-flywheel
agent-platform-eval-flywheel
Measures and improves the quality of AI models and agents on Google Cloud
Agent Platform eval flywheel is an agent skill for measuring and improving the quality of generative AI models and agents on Google Cloud. It uses the Agent Platform GenAI Evaluation SDK, through client.evals.evaluate(), and follows what the skill calls the Eval Quality Flywheel, a loop in which you evaluate, read the results, change the system and evaluate again. The skill covers creating evaluation datasets from session traces, from pandas DataFrames or by synthetic generation, selecting and configuring evaluation metrics and writing custom ones, and analyzing rubric verdicts, loss patterns and clusters of failures. Based on the results, it suggests concrete code or prompt changes. It can also evaluate a model served on an Agent Platform endpoint, a bring-your-own model, or a Model-as-a-Service model by ID, and it will deploy the model first when needed, using the deployment reference and the endpoint and MaaS evaluation scripts it includes. The skill is useful for teams that want an evidence-based way to tell whether a model or agent change made things better or worse. It is published by Google on skills.sh under the google skills repository, and the listing shows Gen Agent Trust Hub, Socket and Snyk all passing.
- Price
- Free
- Made by
- Category
- AI Skills
- Website
- github.com/google/skills/agent-platform-eval-flywheel