We change the behavior of actors in a video. For instance, the
outcome of a 100-meter race in the Olympic game can be falsified.
We track objects and segment motions using a modified mean shift
mechanism. The resulting video layers can be played in different
speeds and at different reference points with respect to the
original video. In order to obtain a smooth movement of target
objects, a motion interpolation mechanism is proposed based on
continuous stick figures (i.e., a video of human skeleton) and
video inpainting. The video inpainting mechanism is performed
in a quasi-3D space via guided 3D patch matching for filling.
Interpolated target objects and background layers are fused by
using graph cut. It is hard to tell whether a falsified video
is the original. We demonstrate the original and the falsified
videos in our website at
http://member.mine.tku.edu.tw/www/CVPR08/. The proposed
technique can be used to create special effects in movie
industry.
Keywords: motion interpolation, video inpainting, image
completion, graph cut, mean shift, video special effect