How to make a cinematic music video from a song and reference images
Upload the track and your reference images and tell Vizard Agent the world it should live in. Vizard Agent analyses the song's sections and beats, tests visual styles before committing, generates and animates every shot, and locks the cuts to the music rather than to a stopwatch.
What do you type into Vizard Agent?
Describe the feeling and give it the references. Vizard Agent uses your images to generate the style tests and your description to choose between them, so the two together get much closer to the world you have in mind than either alone. Reference images are worth more than adjectives, because a look is easier to show than to name.
Prompt
What does Vizard Agent actually do?
A music video for a four-minute track is thirty-something shots that have to belong to one world and land on the right beats. Both are decisions made before any shot is generated, which is why Vizard Agent tests the look first. After that it watches the edit rather than just assembling it, and remakes what isn't good enough. In the session behind this article it:
- Downloaded the song and the reference images, and analysed the track's sections, beats and spoken words.
- Tested two image styles side by side, then ran motion tests on both grades using a face still and compared the animated results.
- Wrote a shot plan, generated thirty-seven storyboard stills, reviewed them as tiles and regenerated the six weakest.
- Animated every shot, reviewed contact sheets of the clips in three batches, picked the usable window inside each clip and re-animated the ones that did not work.
- Graded every shot to one look, cut to the word timings, tightened the transitions and locked the cuts to the music.
- Spotted ghosting on a close-up, re-animated it more calmly and re-rendered a 246.92-second master at 1920x1080 and 24fps, the film rate.
When does this not work well?
Generated imagery has a texture, and a four-minute video gives an audience plenty of time to notice it. Vizard Agent reviews and regenerates throughout, which manages the problem rather than removing it. Faces are the hard case, because animated stills can ghost or drift. If the artist needs to appear performing, that has to be filmed. Long tracks cost more, and the rights to the song are yours.
Common questions
Do I need reference images? No, but they help a great deal. Vizard Agent tests styles against what you show it.
Will the cuts land on the beat? Yes. Vizard Agent analyses the sections and beats and locks the cuts to them.
Can a person appear throughout? From a still, animated. Vizard Agent watches for ghosting and re-animates when it appears.