Description
automate-this is an agent skill from the github/awesome-copilot collection for turning a screen recording of a repetitive manual task into working automation. The user records themselves doing the task and hands over the video, and the agent works out what is being done, why, and how to script it away. The skill begins with a prerequisites check. It needs ffmpeg to extract frames from the recording, and it uses Whisper, an optional speech-to-text tool, when the recording has spoken narration; without Whisper the agent can still analyze the visuals. Phase 1 extracts the content from the recording, pulling out frames at key moments and the audio narration where it exists. Later phases analyze the steps, identify the parts that can be scripted, and build the automation and test it. The approach works best for tasks that are repetitive, rule-based and done the same way each time, such as moving data between screens, renaming files or filling in forms. Automating a task can change how it is done, so the skill's output should be tested on copies before it is run on real data. The recording may show sensitive information on screen, so it should be reviewed before it is shared with the agent. The skill is installed with the skills CLI from the github/awesome-copilot repository. Its skills.sh page showed about 2.3K installs and passing results from three security audits at the time of the scan.…
Highlights
- Turns a screen recording into automation
- Extracts frames and audio narration
- Optional Whisper transcription
- Prerequisites check for ffmpeg
- Scripts for repetitive, rule-based tasks
- Installs with the skills CLI
Ratings & Reviews
No ratings yet
Be the first to rate automate-this.
People also visit
automate-this FAQ
What do I give the skill?
A video file of yourself doing a repetitive task on screen.
What tools does it need?
ffmpeg is required. Whisper is optional and is needed only when the recording has narration.
What kinds of tasks fit?
Repetitive, rule-based tasks done the same way each time, such as moving data or filling in forms.
Is the output ready to run?
It should be tested on copies first, because automating a task can change how it works.
How do I install it?
Run npx skills add https://github.com/github/awesome-copilot --skill automate-this.
What security audits does it have?
skills.sh lists three audits: Gen Agent Trust Hub Pass, Socket Pass and Snyk Pass.
What are the best automate-this alternatives?
Popular alternatives to automate-this include bash-defensive-patterns, autoresearch and boost-prompt. See all automate-this alternatives