Shape from Shading with a Linear Triangular Element Surface Model
|
The authors propose to combine a triangular element surface model with a linearized reflectance map to formulate the shape-from-shading problem. The main idea is to approximate a smooth surface by the union of triangular surface patches called triangular elements and express the approximating surface as a linear combination of a set of nodal basis functions. Since the surface normal of a triangular element is uniquely determined by the heights of its three vertices (or nodes), image brightness can be directly related to nodal heights using the linearized reflectance map. The surface height can then be determined by minimizing a quadratic cost functional corresponding to the squares of brightness errors and solved effectively with the multigrid computational technique. The proposed method does not require any integrability constraint or artificial assumptions on boundary conditions. Simulation results for synthetic and real images are presented to illustrate the performance and efficiency of the method.
[1] 815M. Bertero, T. A. Poggio, and V. Torre, "Ill-posed problems in early vision,"Proc. IEEE, vol. 76, pp. 869-889, Aug. 1988.
[2] M. J. Brooks, "Surface normals from closed paths." inProc. Int. Joint Conf. Artificial Intell.(Tokyo, Japan), Aug. 1979, pp. 913-301.
[3] R. Courant and D. Hilbert,Method of Mathematical Physics. New York: Wiley, 1962.
[4] R. T. Frankot and R. Chellappa, "A method for enforcing integrability in shape from shading algorithm,"IEEE Trans. Patt. Anal. Machine Intell., vol. 10, no. 4, pp. 439-451, 1989; also inShape from Shading(B.K.P. Horn and M. J. Brooks, Eds.). Cambridge, MA: MIT Press, 1989.
[5] W. E. L. Grimson,From Images to Surfaces. Cambridge, MA: MIT Press, 1981.
[6] B. K. P. Horn, "Shape from shading: A method for obtaining the shape of a smooth opaque object from one view," Ph.D. dissertation, Mass. Inst. Technol., Cambridge, MA, 1970.
[7] B. K. P. Horn,Obtaining Shape from Shading Information. Cambridge, MA: MIT Press, 1975.
[8] B. K. P. Horn "Understanding image intensities,"Artificial Intell., vol. 8, no. 2, pp. 201-231, 1977.
[9] B. K. P. Horn, "Height and gradient from shading,"Int. J. Comput. vision, vol. 5, no. 1, pp. 37-67, 1990.
[10] B. K. P. Horn and M. J. Brooks, "The variational approach to shape from shading,"Comp. vision, Graphics, and Image Processing, vol. 33, no. 2, pp. 174-208, Feb. 1986.
[11] B. K. P. Horn and R. W. Sjoberg, "Calculating the reflectance map,"Applied Opt., vol. 18, no. 11, pp. 1770-1779, June 1979; also inProc. DARPA Image Understanding Workshop(Pittsburgh, PA), Nov. 14-15, 1978, pp. 115-126; also inShape from Shading. Cambridge, MA: MIT Press, 1989.
[12] K. Ikeuchi and B. K. P. Horn, "Numerical shape from shading and occluding boundaries,"Artificial Intell., vol. 17, pp. 141-184, 1981; also inShape from Shading(B. K. P. Horn and M. J. Brooks, Eds.). Cambridge, MA: MIT Press, 1989.
[13] C. Johnson,Numerical Solutions of Partial Differential Equations by the Finite Element Method, Cambridge, UK: Cambridge University Press, 1987.
[14] J. J. Koenderink and A. J. van Doorn, "Photometric invariants related to solid shape,"Optica Acta, vol. 27, no. 7, pp. 981-996, 1980; also inShape from Shading. Cambridge, MA: MIT Press, 1989.
[15] Y. G. Leclerc and A. F. Bobick, "The direct computation of height from shading," inProc. IEEE Conf. Comput. Vision Patt. Recogn.(Hawaii), May 1991, pp. 552-558.
[16] C. -H. Lee and A. Rosenfeld, "Improved methods of estimating shape from shading using the light source coordinate system,"Artificial Intell., vol. 26, pp. 125-143, 1985.
[17] D. Lee, "A provably convergent algorithm for shape from shading," inShape from Shading(B. Horn and M. Brooks, Eds.). Cambridge, MA: MIT Press, 1989, pp. 349-373.
[18] K. M. Lee and C. -C. J. Kuo, "Shape from shading with a linear triangular element surface model," Tech. Rep. 172, Univ. Southern Calif., Signal Image Processing Inst., 1991.
[19] K. M. Lee and C. -C. J. Kuo, "Surface reconstruction from photometric stereo,"J. Opt. Soc. Amer. A., vol. 10, no. 5, pp. 855-868, 1993.
[20] A. P. Pentland, "Local shading analysis,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-16, no. 2, pp. 170-187, 1984; also inShape from Shading(B. K. P. Horn and M. J. Brooks, Eds.). Cambridge, MA: MIT Press, 1989.
[21] A. P. Pentland, "Shape information from shading: A theory about human perception," inProc. Int. Conf. Comput. Vision, 1988, pp. 404-413.
[22] T. Poggio, V. Torre, and C. Koch, "Computational vision and regularization theory,"Nature, vol. 317, pp. 314-319, 1985.
[23] H. R. Schwartz,Finite Element Methods. New York: Academic, 1988.
[24] G. B. Smith, "The relationship between image irradiance and surface orientation," inProc. IEEE Conf. Comput. Vision Patt. Recogn.(Washington DC), June 1983, pp. 404-413.
[25] T. Strat, "A numerical method for shape from shading for a single image," Master's thesis, Mass. Inst. Technol., Cambridge, MA, 1979.
[26] R. Szeliski, "Fast shape from shading,"Comput. Vision Graphics Image Processing: Image Understanding, vol. 53, no. 2, pp. 129-153, 1991.
[27] D. Terzopoulos, "Multilevel computational processes for visual surface reconstruction."Comput. Vision Graphics Image Processing, vol. 24, pp. 52-96, 1983.
[28] D. Terzopoulos, "The computation of visual surface representation,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-10, no. 4, pp. 417-438, 1988.
[29] A. N. Tikhonov and V. Y. Arsenin,Method of Mathematical Physics, Washington, DC: Winston and Wiley, 1977.
[30] R. J. Woodham, "A cooperative algorithm for determining surface orientation from a single view," inProc. Int. Joint Conf. Artificial Intell.(Cambridge, MA), Aug. 1977, pp. 635-641.
[31] Q. Zheng and R. Chellappa, "Estimation of illumination direction, albedo, and shape from shading,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-13, no 7. pp. 680-702, 1991.
Index Terms:
image processing; optimisation; linear triangular element surface model; linearized reflectance map; shape-from-shading; image brightness; quadratic cost functional; multigrid computational technique; image processing; optimisation
Citation:
K.M. Lee, C.C.J. Kuo, "Shape from Shading with a Linear Triangular Element Surface Model," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 8, pp. 815-822, Aug. 1993, doi:10.1109/34.236247