Shape from Shading: A Survey
|
Abstract—Since the first shape-from-shading (SFS) technique was developed by Horn in the early 1970s, many different approaches have emerged. In this paper, six well-known SFS algorithms are implemented and compared. The performance of the algorithms was analyzed on synthetic images using mean and standard deviation of depth ($Z$) error, mean of surface gradient ($p$, $q$) error, and CPU timing. Each algorithm works well for certain images, but performs poorly for others. In general, minimization approaches are more robust, while the other approaches are faster. The implementation of these algorithms in C and images used in this paper are available by anonymous ftp under the pub/tech_paper/survey directory at eustis.cs.ucf.edu (132.170.108.42). These are also part of the electronic version of paper.
[1] 690 U.M. Ascher and P.M. Carter, “author, please supply article title,” SIAM J. Numerical Analysis, vol. 30, no. 1, pp. 102-115, Feb. 1993.
[2] H.G. Barrow and J.M. Tenenbaum, “Retrospective on 'Interpreting Line Drawings as Three-Dimensional Surfaces,'” Artificial Intelligence, vol. 59, pp. 71-80, 1993.
[3] M. Bichsel and A.P. Pentland, “A Simple Algorithm for Shape from Shading,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 459-465, 1992.
[4] A. Blake, A. Zisserman, and G. Knowles, Surface Descriptions from Stereo and Shading Image and Vision Computing, vol. 3, no. 4, pp. 183-191, 1985.
[5] B.K.P. Horn and M.J. Brooks, “Shape and Source from Shading,” Int'l Joint Conf. Artificial Intelligence, pp. 932-936, 1985.
[6] A.R. Bruss, “The Eikonal Equation: Some Results Applicable to Computer Vision,” J. Math. Physics, vol. 23, no. 5, pp. 890-896, 1982.
[7] J.J. Clark, “Active Photometric Stereo,” IEEE Proc. Computer Vision and Pattern Recognition, pp. 29-34, 1992.
[8] J. Cryer, P. Tsai, and M. Shah, “Integration of Shape from x Modules: Combining Stereo and Shading,” IEEE Proc. Computer Vision and Pattern Recognition, pp. 720-721, June 1993.
[9] P. Dupuis and J. Oliensis, Direct Method for Reconstructing Shape from Shading Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 453-458, June 1992.
[10] D. Forsyth and A. Zisserman, “Mutual Illumination,” IEEE Proc. Computer Vision and Pattern Recognition, pp. 466-473, 1989.
[11] R.T. Frankot and R. Chellappa, “A Method for Enforcing Integrabilty in Shape from Shading Algorithms,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 439-451, Apr. 1988.
[12] L.N. Hambrick and M.H. Loew, “Entry-Exit Method of Shadow Boundary Segmentation,” IEEE Proc. Computer Vision and Pattern Recognition, p. 656-658, 1985.
[13] M. Hatzitheodorou and J.R. Kender, “An Optimal Algorithm for the Derivation of Shape from Shadows,” IEEE Proc. Computer Vision and Pattern Recognition, pp. 486-491, 1988.
[14] M. Hatzitheodorou, “The Derivation of 3-D Surface Shape from Shadows,” Proc. Image Understanding Workshop, pp. 1,012-1,020, 1989.
[15] G. Healey and T.O. Binford, "Local shape from specularity," Comput. Vision Graphics and Image Processing, vol. 42, pp. 62-86, 1988.
[16] J. Heel, “Dynamic Motion Vision,” Robotics and Autonomous Systems, vol. 6, no. 1, 1990.
[17] B.K.P. Horn, “Shape from Shading: A Method for Obtaining the Shape of a Smooth Opaque Object from One View,” PhD thesis, Massachusetts Inst. of Tech nology, 1970.
[18] B.K.P. Horn, Height and Gradient from Shading Int'l J. Computer Vision, vol. 5, no. 1, pp. 37-75, Aug. 1990.
[19] B.K.P. Horn, R.S. Szeliski, and A.L. Yuille, “Impossible Shaded Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 2, pp. 166-170, Feb. 1993.
[20] D.H. Hougen and N. Ahuja, Estimation of the Light Source Distribution and Its Use in Integrated Shape Recovery from Stereo and Shading Proc. IEEE Fourth Int'l Conf. Computer Vision, pp. 148-155, May 1993.
[21] K. Ikeuchi and B.K.P. Horn, “Numerical Shape from Shading and Occluding Boundaries,” Artificial Intelligence, vol. 17, nos. 1-3, pp. 141-184, 1981.
[22] C. Jiang and M.O. Ward, Shadow Identification Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 606-612, 1992.
[23] R. Kimmel and A.M. Bruckstein, “Shape from Shading via Level Sets,” Israel Inst. of Technology, CIS Report 9209, 1992.
[24] M.S. Langer and S.W. Zucker, "Diffuse Shading, Visibility Fields, and the Geometry of Ambient Light," Proc. Fourth Int'l Conf. Computer Vision, pp. 138-147,Berlin, 1993.
[25] Y.G. Leclerc and A.F. Bobick, “The Direct Computation of Height from Shading,” IEEE Computer Vision and Pattern Recognition, pp. 552-558, 1991.
[26] C.H. Lee and A. Rosenfeld, “Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System,” Artifical Intelligence, vol. 26, no. 2, pp. 125-143, 1985.
[27] D. Lee, “A Provably Convergent Algorithm for Shape from Shading,” IEEE Proc. Computer Vision and Pattern Recognition, pp. 478-485, 1988.
[28] K.M. Lee and C.C.J. Kuo, “Shape from Shading with a Linear Triangular Element Surface Model,” IEEE Pattern Analysis and Machine, vol. 15, no. 8, pp. 815-822, 1993.
[29] J. Malik and D. Maydan, “Recovering Three Dimensional Shape from a Single Image of Curved Objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, 1989.
[30] E. Mingolla and J.T. Todd, “Perception of Solid Shape from Shading,” Biological Cybernetics, vol. 53, pp. 137-151, 1986.
[31] S.K. Nayar, K. Ikeuchi, and T. Kanade, “Shape from Interreflections,” Proc. Int'l Conf. Computer Vision, pp. 1-11, 1990.
[32] S.K. Nayar, K. Ikeuchi, and T. Kanade, "Surface Reflection: Physical and Geometrical Perspectives," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 611-634, 1991.
[33] J. Oliensis, “Shape from Shading as a Partially Well-Constrained Problem,” Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 54, pp. 163-183, 1991.
[34] J. Oliensis and P. Dupuis, “A Global Algorithm for Shape from Shading,” Proc. IEEE Int'l Conf. Computer Vision, pp. 692-701, 1993.
[35] M. Oren and S.K. Nayar, “Diffuse Reflectance from Rough Surfaces,” IEEE Proc. Computer Vision and Pattern Recognition, pp. 763-764, 1993.
[36] A.P. Pentland, “Finding the Illuminant Direction,” J. Optical Soc. of Am., pp. 448-455, 1982.
[37] A.P. Pentland, “Local Shading Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 170-187, 1984.
[38] A.P. Pentland, “Shape Information from Shading: A Theory about Human Perception,” Proc. Int'l Conf. Computer Vision, pp. 404-413, 1988.
[39] A. Pentland, “Photometric Motion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 879-890, 1991.
[40] B.-T. Phong, "Illumination for Computer Generated Pictures," Comm. ACM, vol. 18, no. 6, 1975, pp. 311-317.
[41] H. Pien and J. Gauch, “A Variational Approach to Sensor Fusion Using Registered Range and Intensity Data,” SPIE OE/Aerospace Sensing, Apr. 1993.
[42] W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling, Numerical Recipes in C. Cambridge Univ. Press, 1990.
[43] D. Raviv, Y.H. Pao, and K.A. Loparo, “Segmentation Between Overlapping Parts: The Moving Shadows Approach,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 19, no. 4, pp. 880-883, 1989.
[44] D. Raviv, Y.H. Pao, and K.A. Loparo, “Reconstruction of Three-Dimensional Surfaces from Two-Dimensional Binary Images,” IEEE Trans. Robotics and Automation, vol. 5, no. 5, pp. 701-710, 1989.
[45] V.S. Ramachandran, “Perceiving Shape from Shading,” Scientific Am., vol. 159, pp. 76-83, 1988.
[46] E. Rouy and A. Tourin, “A Viscosity Solutions Approach to Shape-from-Shading,” SIAM J. Numerical Analysis, vol. 29, no. 3, pp. 867-884, 1992.
[47] S.A. Shafer and T. Kanade, “Using Shadows in Finding Surface Orientations,” Computer Vision, Graphics, and Image Processing, vol. 22, pp. 145-176, 1983.
[48] R. Szeliski, “Fast Shape from Shading,” Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 53, pp. 129-153, 1991.
[49] K.E. Torrance and E.M. Sparrow, “Theory for Off-Specular Reflection from Roughened Surfaces,” J. Optical Soc. Am., vol. 57, pp. 1,105-1,114, 1967.
[50] P.S. Tsai and M. Shah, “Shape from Shading Using Linear Approximation,” Image and Vision Computing J., vol. 12, no. 8, pp. 487-498, 1994.
[51] O.E. Vega and Y.H. Yang, “Shading Logic: A Heuristic Approach to Recover Shape from Shading,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 592-597, June 1993.
[52] R. Zhang, P. Tsai, and M. Shah, “Photomotion,” Computer Vision and Image Understanding, vol. 63, no. 2, Mar. 1996.
[53] R. Zhang, P. Tsai, J. Cryer, and M. Shah, “A Survey of Shape from Shading Methods,” Technical Report CS-TR-97-15, Computer Science Dept., Univ. of Central Florida, 1997.
[54] Q. Zheng and R. Chellappa, Estimation of Illuminant Direction, Albedo, and Shape from Shading IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 680-702, July 1991.
Index Terms:
Shape from shading, analysis of algorithms, Lambertian model, survey of shape from shading algorithms.
Citation:
Ruo Zhang, Ping-Sing Tsai, James Edwin Cryer, Mubarak Shah, "Shape from Shading: A Survey," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 8, pp. 690-706, Aug. 1999, doi:10.1109/34.784284
PURCHASE ARTICLE: $19
IEEE Xplore Subscribers
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb