Vision-Based Force Measurement
|
Abstract—This paper demonstrates a method to visually measure the force distribution applied to a linearly elastic object using the contour data in an image. The force measurement is accomplished by making use of the result from linear elasticity that the displacement field of the contour of a linearly elastic object is sufficient to completely recover the force distribution applied to the object. This result leads naturally to a deformable template matching approach where the template is deformed according to the governing equations of linear elasticity. An energy minimization method is used to match the template to the contour data in the image. This technique of visually measuring forces we refer to as vision-based force measurement (VBFM). VBFM has the potential to increase the robustness and reliability of micromanipulation and biomanipulation tasks where force sensing is essential for success. The effectiveness of VBFM is demonstrated for both a microcantilever beam and a microgripper. A sensor resolution of less than +/- 3 nN for the microcantilever and +/- 3 mN for the microgripper was achieved using VBFM. Performance optimizations for the energy minimization problem are also discussed that make this algorithm feasible for real-time applications.
[1] 290 J. Canny, A Computational Approach to Edge Detection IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, Nov. 1986.
[2] G. Danuser and E. Mazza, Observing Deformations of 20 Nanometer with a Low Numerical Aperture Light Microscope Optical Inspection and Micromeasurements, vol. 2782, pp. 180-191, 1996.
[3] L. Dong, F. Arai, and T. Fukuda, 3D Nanorobotic Manipulations of Multi-Walled Carbon Nanotubes Proc. 2001 IEEE Int'l Conf. Robotics and Automation, May 2001.
[4] R.B. Guenther and J.W. Lee, Partial Differential Equations of Math. Physics and Integral Equations. Englewood Cliffs, N.J.: Prentice Hall, 1988.
[5] M. Kaneko, N. Nanayama, and T. Tsuji, Vision-Based Active Sensor Using a Flexible Beam IEEE/ASME Trans. Mechatronics, vol. 6, no. 1, pp. 7-16, Mar. 2001.
[6] M. Kass, A. Witkin, and D. Terzopoulos, Snakes: Active Contour Models Int'l J. Computer Vision, pp. 321-331, 1988.
[7] R.J. Knops and L.E. Payne, Uniqueness Theorems in Linear Elasticity. Berlin, Heidelberg: Springer-Verlag 1971.
[8] D. Metaxas, Physics-Based Deformable Models. Boston: Kluwer Academic, 1997.
[9] G. Nakamura and G. Uhlmann, Identification of LaméParameters by Boundary Measurements Am. J. Math., vol. 115, pp. 1161-1187, 1993.
[10] B. Nelson, Y. Zhou, and B. Vikramaditya, Sensor-Based Microassembly of Hybrid MEMS Devices IEEE Control Systems, Dec. 1998.
[11] H. Samet, The Design and Analysis of Spatial Data Structures. Reading, Mass: Addison-Wesley, 1990.
[12] I. Sokolnikoff, Mathematical Theory of Elasticity. Malabar, Fla.: Krieger Publishing, 1983.
[13] J. Sylvester and G. Uhlmann, The Dirichlet to Neumann Map and Applications Inverse Problems in Partial Differential Equations, D. Colton, R. Ewing, W. Rundell, eds., pp. 101-139, 1990.
[14] M. Tortonese, H. Yamada, R.C. Barrett, and C.F. Quate, Atomic Force Microscopy Using a Piezoresistive Cantilever Proc. Transducers '91 Int'l Conf. Solid State Sensors and Actuators, pp. 448-451, 1991.
[15] T. Tsap, D. Goldgof, and S. Sarkar, Efficient Nonlinear Finite Element Modeling of Nonrigid Objects via Optimization of Mesh Models Computer Vision and Image Understanding, vol. 69, pp. 330-350, Mar. 1998.
[16] G. Vanderplaats, Numerical Optimization Techniques for Engineering Design. New York: McGraw-Hill, 1984.
[17] X. Wang, G.K. Ananthasuresh, and J.P. Ostrowski, Vision-Based Sensing of Forces in Elastic Objects Sensors and Actuators A-Physical, vol. 94, no. 3, pp. 142-156, Nov. 2001.
[18] G. Yang, J.A. Gaines, and B.J. Nelson, A Flexible Experimental Workcell for Efficient and Reliable Wafer-Level 3D Microassembly Proc. 2001 IEEE Int'l Conf. Robotics and Automation, May 2001.
[19] A. Yuille, D. Cohen, and W. Hallinan, Feature Extraction from Faces Using Deformable Templates Int'l J. Computer Vision, vol. 8, no. 2, pp. 99-111, 1992.
Index Terms:
Force measurement, deformable templates, elasticity, nonrigid tracking.
Citation:
Michael A. Greminger, Bradley J. Nelson, "Vision-Based Force Measurement," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 3, pp. 290-298, Mar. 2004, doi:10.1109/TPAMI.2004.1262305
PURCHASE ARTICLE: $19
IEEE Xplore Subscribers
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb