How to remove a person from a video and keep what they were holding
Upload the clip to Vizard Agent and name exactly what should disappear and what must stay, including the objects the person was holding. Vizard Agent checks whether the camera moved, rebuilds the background hidden behind the person, and aligns that reconstruction back onto every frame so the objects they held stay in place.
What do you type into Vizard Agent?
Write it as an instruction plus its exceptions, in that order. Vizard Agent honours negative clauses well, so "do NOT remove the remote control" is a real constraint rather than a hint. Stating it costs one sentence, against a second pass that costs a whole run, because anything you don't protect sits inside the region being rebuilt.
Prompt
What does Vizard Agent actually do?
Removal is reconstruction, not erasure: whatever was behind the person has to be rebuilt from somewhere. So Vizard Agent measures the camera before choosing a method. A still camera means one clean background plate can serve every frame; a moving one means guessing again on every frame. In the session behind this article it:
- Extracted frames across the whole clip to see what was where, and tried the video editor directly on the removal.
- Measured camera stability across the video with OpenCV, the step that decides the whole approach.
- Took one full-resolution frame and inpainted it with the image editor, rebuilding what was behind the person.
- Aligned the rebuilt background back to the original geometry and made a side-by-side comparison to check the alignment.
- Drew a coordinate grid over the original frame and cropped to the region around the person and the objects, so the boundary between what goes and what stays was worked out on real pixel coordinates. The delivered clip was 720x1280 at 30fps and 5.23 seconds long, with the audio preserved.
When does this not work well?
A moving camera makes this much harder, because a single rebuilt plate no longer fits. Whatever was fully hidden behind the person for the whole clip is invented, plausibly, not recovered. Shadows and reflections count as part of the person, so say "and their shadow". Contact points, like fingers around a remote, are the hardest pixels in the shot.
Common questions
Can it remove several things at once? Yes. List them, and list what stays, because everything unnamed sits inside the region Vizard Agent is reconstructing.
What if the result looks smeared where the person was? Say where. Vizard Agent still has the clip, the frames and the rebuilt plate, so the next pass corrects that region only.
Does it work on a handheld shot? It can, and it holds up less well. Vizard Agent measures camera stability first, so expect a softer result than a tripod shot gives.