How to keep the audio and replace every frame of a video
Upload the video and tell Vizard Agent to keep the audio and replace the picture. Vizard Agent transcribes the narration, measures its loudness, generates an entirely new set of shots timed to what is being said, adds captions in the right typeface, and delivers a new film on the old soundtrack.
What do you type into Vizard Agent?
Say what stays and what goes, in that order. Vizard Agent needs to know the audio is fixed and everything visual is open, because that turns the job from an edit into a rebuild with a locked soundtrack underneath. Add the mood, the caption language and the frame, which it can't infer from the words alone.
Prompt
What does Vizard Agent actually do?
The narration's loudness is measured before anything is generated, so new music can be built to sit under a known level rather than fought down afterwards. The shots are timed from the transcript, and the caption typeface is installed first, since captions in a language the box has no typeface for come out as boxes or broken letterforms. In the session behind this article it:
- Downloaded the upload, extracted frames, transcribed the audio and pulled the branding file and logo from a previous project.
- Loaded the atmospheric montage playbook and checked which typefaces were available.
- Extracted the narration and measured its loudness twice, to be certain, before generating anything.
- Found and installed the typefaces the captions needed, then generated all the new shots and the background music and previewed every shot.
- Regenerated the closing shot until it worked, built full-length music to fit, and delivered 1080x1350, H.264, 25fps, 84 seconds over the original eighty-second narration.
When does this not work well?
Replacing every frame only works when the audio can stand on its own. New pictures don't fix a bad recording, and if the speaker on camera is the point, don't replace them. Generated shots illustrate a subject rather than document it, eighty seconds is a lot of new picture, and religious, medical and historical material carries obligations.
Common questions
Does the original audio change at all? No. Vizard Agent keeps the narration exactly as recorded and builds everything else around it.
Will the captions work in my language? Vizard Agent checks the installed typefaces and installs what the language needs before rendering.
Can I keep some of the original footage? Yes, if you say so. Vizard Agent replaced all of it here because that was the instruction.