Real-Time Tracking of Moving Persons by Exploiting Spatio-Temporal Image Slices
|
Abstract—This paper addresses the problem of analyzing human motion in an image sequence. This is of particular importance for video-surveillance applications. We have developed an original and efficient approach to track the apparent contours of a moving articulated structure, avoiding the use of 3D models. This method exploits spatio-temporal $XT$-slices from the image sequence volume $XYT$, where typical trajectory patterns can be associated with articulated motion such as human walking. We reconstruct these trajectories online by introducing an appropriate predictive model while correctly handling occlusion periods. This paradigm can lead to a simple trajectory recognition scheme. Experiments with real-world images depicting human walk or gesture are reported, and obtained results validate the proposed approach.
[1] 797 J.K. Aggarwal and Q. Cai, “Human Motion Analysis: A Review,” Computer Vision and Image Understanding, vol. 73, no. 3, pp. 428-440, 1999.
[2] K. Akita, “Image Sequence Analysis of Real World Human Motion,” Pattern Recognition, vol. 17, no. 1, pp. 73–83, 1984.
[3] M. Allmen and C. Dyer, “Computing Spatiotemporal Surface Flow,” Proc. Third Int'l Conf. Computer Vision, pp. 47–50, 1990.
[4] A. Baumberg and D. Hogg, “Generating Spatiotemporal Models from Examples,” Image and Vision Computing, vol. 14, pp. 525–532, 1996.
[5] A. Bellon, J. Dérutin, F. Heitz, and Y. Ricquebourg, “Real-Time Collision Avoidance at Road-Crossings on Board the Prometheus-Prolab2 Vehicle,” Proc. IEEE Int'l Symp. Intelligent Vehicle, Oct. 1994.
[6] P. Bouthemy, “A Maximum-Likelihood Framework for Determining Moving Edges,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 5, pp. 499–511, May 1989.
[7] L.W. Campbell and A.F. Bobick, “Recognition of Human Body Motion Using Phase Space Constraints,” Proc. Int'l Conf. Computer Vision, 1995.
[8] P.B. Chou and C.M. Brown, “The Theory and Practice of Bayesian Image Labeling,” Int'l J. Computer Vision, vol. 4, no. 3, pp. 185-210, 1990.
[9] J. Duncan and T. Chou, “On the Detection of Motion and the Computation of Optical Flow,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 3, pp. 346–352, Mar. 1992.
[10] D.M. Gavrila, “The Visual Analysis of Human Movement: A Survey,” Computer Vision and Image Understanding, vol. 73, no. 1, Jan. 1999.
[11] F. Heitz and P. Bouthemy, Multimodal Estimation of Discontinuous Optical Flow Using Markov Random Fields IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 12, pp. 1217-1232, Dec. 1993.
[12] E.C. Hildreth, Computations Underlying the Measurement of Visual Motion Artificial Intelligence, vol. 23, pp. 309-354, 1984.
[13] D. Hogg, “Model-Based Vision: A Program To See a Walking Person,” Image and Vision Computing, vol. 1, no. 1, pp. 5–20, Feb. 1983.
[14] T. Hwang and J. Clark, “On Local Detection of Moving Edges,” Proc. 10th Int'l Conf. Pattern Recognition, vol. 1, pp. 180–184, June 1990.
[15] I.A. Kakadiaris and D. Metaxas, “Model-Based Estimation of 3D Human Motion with Occlusion Based on Active Multi-Viewpoint Selection,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 81–87, June 1996.
[16] H. Lee and Z. Chen, “Determination of 3D Human Body Postures From a Single View,” Computer Vision, Graphics, and Image Processing, vol. 30, pp. 148–168, 1985.
[17] P. Rives and J. Borrelly, “Underwater Pipe Inspection Task Using Visual Servoing Techniques,” Proc. IEEE Int'l Conf. Intelligent Robots and Systems, pp. 63-68, Sept. 1997.
[18] M.K. Leung and Y.H. Yang,“A region-based approach for human body motion analysis,” Pattern Recognition, vol. 20, no. 3, pp. 321-339, 1987.
[19] Y. Li, M. Songde, and H. Lu, “Human Posture Recognition Using Multi-Scale Morphological Method and Kalman Motion Estimation,” Proc. 14th Int'l Conf. Pattern Recognition, pp. 175–177, Aug. 1998.
[20] S. Niyogi and E. Adelson, “Analyzing and Recognizing Walking Figures in XYT,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 469–474, 1994.
[21] J. Odobez and P. Bouthemy, “Robust Multiresolution Estimation of Parametric Motion Models,” J. Visual Comm. and Image Representation, vol. 6, no. 4, pp. 348–365, 1995.
[22] J. O'Rourke and N. Badler, “Model-Based Image Analysis of Human Motion Using Constraint Propagation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, no. 6, pp. 522–536, Nov. 1980.
[23] R. Polana and R. Nelson, “Detection and Recognition of Periodic, Non-Rigid Motion,” Int'l J. Computer Vision, vol. 23, no. 3, pp. 261-282, June/July 1997.
[24] K. Rangarajan, W. Allen, and M. Shah, “Matching Motion Trajectories Using Scale-Space,” Pattern Recognition, vol. 26, no. 4, pp. 595–610, 1993.
[25] Y. Ricquebourg, “Analyse de Mouvements Articulés: Mesure et Suivi 2D; Applicationàla Télésurveillance,” PhD thesis, Universitéde Rennes 1, Irisa, Jan. 1997. www.irisa.fr/bibli/publi/theses/1997/ricquebourg ricquebourg.html.
[26] Y. Ricquebourg and P. Bouthemy, “A Statistical Regularization Framework for Estimating Normal Displacements Along Contours with Subpixel Accuracy,” Proc. Sixth Int'l Conf. Computer Analysis of Images and Patterns, pp. 73–81, Sept. 1995.
[27] Y. Ricquebourg and P. Bouthemy, “Tracking of Articulated Structures Exploiting Spatio-Temporal Image Slices,” Proc. Fourth IEEE Int'l Conf. Image Processing, Oct. 1997.
[28] K. Rohr, “Towards Model Based Recognition of Human Movements in Image Sequences,” CVGIP: Image Understanding, vol. 59, 1994.
[29] B. Serra and M. Berthod, “Subpixel Contour Matching Using Continuous Dynamic Programming,” Proc. IEEE Conf. Computer SC Computer Vision and Pattern Recognition, pp. 202-207, 1994.
[30] J. Shen,S. Castan,“An Optimal Linear Operator for Step Edge Detection,” CVGIP, Vol. 54, pp. 112-133, 1992.
[31] R. Singer, “Estimating Optimal Tracking Filter Performance for Manned Maneuvering Targets,” IEEE Trans. Aerospace and Electronic Systems, vol. 6, no. 4, pp. 473–483, July 1970.
[32] A. Utsumi, H. Mori, J. Ohya, and M. Yachida, “Multiple-View-Based Tracking of Multiple Humans,” Proc. 14th Int'l Conf. Pattern Recognition, pp. 597–601, Aug. 1998.
[33] J. Wang, G. Lorette, and P. Bouthemy, “Analysis of Human Motion: A Model-Based Approach,” Proc. Seventh Scandinavian Conf. Image Analysis, pp. 1,142–1,149, Aug. 1991.
[34] I.M. Verbauwhede, C.J. Scheers, and J.M. Rabaey, "Memory Estimation for High Level Synthesis," Proc. 31st ACM/IEEE Design Automation Conf., pp. 143-148, 1994.
Index Terms:
Image sequence, tracking and prediction, human motion analysis, video surveillance, contour displacement, Kalman filtering.
Citation:
Yann Ricquebourg, Patrick Bouthemy, "Real-Time Tracking of Moving Persons by Exploiting Spatio-Temporal Image Slices," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 797-808, Aug. 2000, doi:10.1109/34.868682
PURCHASE ARTICLE: $19
IEEE Xplore Subscribers
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb