music-to-video
Turn a music track (an audio file, a video to pull audio from, or a track
by heygen-comFree
Description
music-to-video is an agent skill from the HyperFrames project that turns a music track into a beat-synced video. The track can be an audio file, a video to take audio from, or a track generated from a mood brief. The output can be a lyric video, a slideshow, or a similar format. The input is music plus optional user images or videos; there is no narration and no website capture. Typography and templates form the base, so a complete video needs no assets at all, and any media the user supplies is cut in on the same beat grid. The skill works as an orchestrator that runs steps in order: setup, which creates a hyperframes.json file and a background music file; analysis of the track into an audiomap; a skeleton storyboard; a complete plan with a frame file; the build, with one composition file per frame; assembly into an index file; and a final render to an MP4. It asks the user to approve the plan and the render. The skill is firm about its beat analysis: one analyzer is the only source of beats, and the agent must not re-measure beats with another tool or by ear.…
Highlights
- Beat-synced lyric videos and slideshows
- One beat analyzer as the single source of timing
- Typography-only videos need no assets
- Plan and render approvals
Ratings & Reviews
No ratings yet
Be the first to rate music-to-video.
People also visit
remotion-to-hyperframes
Migrate React-based Remotion video compositions to HyperFrames HTML
music-to-video FAQ
What does the music-to-video skill do?
It turns a music track into a beat-synced video, such as a lyric video or slideshow, built frame by frame in HyperFrames.
How do I install it?
Run: npx skills add https://github.com/heygen-com/hyperframes --skill music-to-video
Do I need images or footage?
No. Typography and templates are enough for a complete video. Any media you supply is cut in on the beat grid.
Does it ask for approval?
Yes. The plan and the final render are checkpoints that need the user, and the render approval is always asked.
How is the timing decided?
One beat analyzer provides the timing. On calm music, the skill paces by phrases and energy instead of the grid.
What are the best music-to-video alternatives?
Popular alternatives to music-to-video include hyperframes-registry, general-video and product-launch-video. See all music-to-video alternatives