Mean Shift Is a Bound Optimization
|
We build on the current understanding of mean shift as an optimization procedure. We demonstrate that, in the case of piecewise constant kernels, mean shift is equivalent to Newton's method. Further, we prove that, for all kernels, the mean shift procedure is a quadratic bound maximization.
[1] 471 K. Fukunaga and L.D. Hostetler, “The Estimation of the Gradient of a Density Function, with Applications in Pattern Recognition,” IEEE Trans. Information Theory, vol. 21, pp. 32-40, 1975.
[2] Y. Cheng, “Mean Shift, Mode Seeking, and Clustering,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 790-799, Aug. 1995.
[3] D. Comaniciu and P. Meer, “Mean Shift Analysis and Applications,” Proc. Int'l Conf. Computer Vision, pp. 1197-1203, Sept. 1999.
[4] D. Comaniciu and P. Meer, “Mean Shift: A Robust Approach toward Feature Space Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[5] D. Ramanan and D.A. Forsyth, “Finding and Tracking People from the Bottom Up,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 467-474, June 2003.
[6] D. Ramanan and D.A. Forsyth, “Using Temporal Coherence to Build Animal Models,” Proc. Int'l Conf. Computer Vision, pp. 338-346, Oct. 2003.
[7] R. Collins, “Mean-Shift Blob Tracking through Scale Space,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 234-240, June 2003.
[8] R.M. Neal and G.E. Hinton, “Learning in Graphical Models,” M.I. Jordan, ed., Chapter: A View of the EM Algorithm that Justifies Incremental, Sparse, and Other Variants, pp. 355-368. Dordrecht: Kluwer Academic Publishers, 1998.
[9] G. Palumbo, G. Tanzella-Nitti, and G. Vettolani, Catalogue of Radial Velocities of Galaxies. New York: Gordon and Breach, 1983.
[10] B. Georgescu, I. Shimshoni, and P. Meer, “Mean Shift Based Clustering in High Dimensions: A Texture Classification Example,” Proc. Int'l Conf. Computer Vision, pp. 456-463, Oct. 2003.
Index Terms:
Mean shift, bound optimization, Newton's method, adaptive gradient descent, mode seeking.
Citation:
Mark Fashing, Carlo Tomasi, "Mean Shift Is a Bound Optimization," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 471-474, Mar. 2005, doi:10.1109/TPAMI.2005.59