Jianfeng Xu, Dept. of Electronics Engineering and Dept. of Frontier Informatics, The University of Tokyo, Japan. fenax@hal.k.u-tokyo.ac.jp
Toshihiko Yamasaki, Dept. of Electronics Engineering and Dept. of Frontier Informatics, The University of Tokyo, Japan. yamasaki@hal.k.u-tokyo.ac.jp
Kiyoharu Aizawa, Dept. of Electronics Engineering and Dept. of Frontier Informatics, The University of Tokyo, Japan. aizawa@hal.k.u-tokyo.ac.jp
3D video, which consists of a sequence of 3D mesh models, can provide detailed 3D information both in spatial and temporal domain. In this paper, a key frame extraction method has been developed to summarize 3D video by rate-distortion optimization. For this purpose, we introduce an effective feature vector extraction algorithm from 3D video. Prior to key frame extraction, shot detection is performed using the feature vectors as a pre-processing. Then, a rate-distortion(R-D) curve is generated in each shot, where the locations of key frames are optimized. Lastly, R-D trade-off can be achieved by optimizing a cost function with a Lagrange multiplier. Our experimental results show the extracted key frames are compact and faithful to original 3D video.
Citation:
Jianfeng Xu, Toshihiko Yamasaki, Kiyoharu Aizawa, "Key Frame Extraction in 3D Video by Rate-Distortion Optimization," icme, pp.1-4, 2006 IEEE International Conference on Multimedia and Expo, 2006