BRDF Invariant Stereo Using Light Transport Constancy
|
Nearly all existing methods for stereo reconstruction assume that scene reflectance is Lambertian and make use of brightness constancy as a matching invariant. We introduce a new invariant for stereo reconstruction called light transport constancy (LTC), which allows completely arbitrary scene reflectance (bidirectional reflectance distribution functions (BRDFs)). This invariant can be used to formulate a rank constraint on multiview stereo matching when the scene is observed by several lighting configurations in which only the lighting intensity varies. In addition, we show that this multiview constraint can be used with as few as two cameras and two lighting configurations. Unlike previous methods for BRDF invariant stereo, LTC does not require precisely configured or calibrated light sources or calibration objects in the scene. Importantly, the new constraint can be used to provide BRDF invariance to any existing stereo method whenever appropriate lighting variation is available.
[1] 1616 D. Bhat and S. Nayar, “Stereo in the Presence of Specular Reflection,” Proc. IEEE Int'l Conf. Computer Vision, pp. 1086-1092, 1995.
[2] A. Blake, “Specular Stereo,” Proc. Ninth Int'l Joint Conf. Artificial Intelligence, vol. 2, pp. 973-976, 1985.
[3] G. Brelstaff and A. Blake, “Detecting Specular Reflections Using Lambertian Constraints,” Proc. IEEE Int'l Conf. Computer Vision, pp. 297-302, 1988.
[4] B. Carrihill and R. Hummel, “Experiments with the Intensity Ratio Depth Sensor,” Computer Vision, Graphics, and Image Processing, vol. 32, pp. 337-358, 1985.
[5] B. Curless and M. Levoy, “Better Optical Triangulation through Spacetime Analysis,” Proc. IEEE Int'l Conf. Computer Vision, pp.987-994, 1995.
[6] J. Davis, D. Nehab, R. Ramamoorthi, and S. Rusinkiewicz, “Spacetime Stereo: A Unifying Framework for Depth from Triangulation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 296-302, Feb. 2005.
[7] P.E. Debevec and J. Malik, “Recovering High Dynamic Range Radiance Maps from Photographs,” Proc. ACM Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '97), pp.369-378, 1997.
[8] K. Fujii, M.D. Grossberg, and S.K. Nayar, “A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 814-821, 2005.
[9] A. Hertzmann and S.M. Seitz, “Example-Based Photometric Stereo: Shape Reconstruction with General Varying BRDFs,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp.1254-1264, Aug. 2005.
[10] J.A. Jalkio, R.C. Kim, and S.K. Case, “Three-Dimensional Inspection Using Multistripe Structured Light,” Optical Eng., vol. 24, no. 6, pp. 966-974, 1985.
[11] H. Jin, S. Soatto, and A. Yezzi, “Multi-View Stereo Beyond Lambert,” Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 171-178, June 2003.
[12] V. Kolmogorov and R. Zabih, “Computing Visual Correspondence with Occlusions Using Graph Cuts,” Proc. IEEE Int'l Conf. Computer Vision, pp. 508-515, 2001.
[13] V. Kolmogorov, “An Implementation of Graph-Cuts Stereo,” http://www.cs.cornell.edu/People/vnksoftware.html , 2003.
[14] Y. Li, S. Lin, H. Lu, S.B. Kang, and H.-.Y. Shum, “Multibaseline Stereo in the Presence of Specular Reflections,” Proc. Int'l Conf. Pattern Recognition, pp. 573-576, 2002.
[15] S. Lin, Y. Li, S.B. Kang, X. Tong, and H.-Y. Shum, “Diffuse-Specular Separation and Depth Recovery from Image Sequences,” Proc. European Conf. Computer Vision, pp. 210-224, 2002.
[16] S. Magda, T. Zickler, D. Kriegman, and P. Belhumeur, “Beyond Lambert: Reconstructing Surfaces with Arbitrary BRDFs,” Proc. IEEE Int'l Conf. Computer Vision, pp. 297-302, 2001.
[17] S. Mann and R. Picard, “Being Undigital with Digital Cameras: Extending Dynamic Range by Combining Differently Exposed Pictures,” Proc. Imaging Science and Technology 48th Ann. Conf., pp.442-448, 1995.
[18] T. Mitsunaga and S.K. Nayar, “Radiometric Self Calibration,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp.380-387, 1999.
[19] T. Miyasaka and K. Araki, “Development of Real Time 3D Measurement System Using Intensity Ratio Method,” Proc. Machine Vision and Three-Dimensional Imaging System for Inspection and Metrology II, Intelligent System and Advanced Manufacturing, 2001.
[20] R. Ng, R. Ramamoorthi, and P. Hanrahan, “All-Frequency Shadows Using Non-Linear Wavelet Lighting Approximation,” ACM Trans. Graphics (SIGGRAPH), vol. 22, pp. 376-381, 2003.
[21] D. Scharstein and R. Szeliski ,www.middlebury.edustereo, 2003.
[22] D. Scharstein, and R. Szeliski, “A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms,” Int'l J. Computer Vision, vol. 47, no. 1, pp. 7-42, May 2002.
[23] D. Scharstein and R. Szeliski, “High-Accuracy Stereo Depth Maps Using Structured Light,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 195-202, 2003.
[24] A. Treuille, A. Hertzmann, and S.M. Seitz, “Example-Based Stereo with General BRDFs,” Proc. European Conf. Computer Vision, pp.457-469, 2004.
[25] L. Wolff and E. Angelopoulou, “Three-Dimensional Stereo by Photometric Ratios,” J. Optical Soc. Am., vol. 11, no. 11, pp. 3069-3078, 1994.
[26] R. Yang, M. Pollefeys, and G. Welch, “Dealing with Textureless Regions and Specular Highlights—A Progressive Space Carving Scheme Using a Novel Photo-Consistency Measure,” Proc. IEEE Int'l Conf. Computer Vision, pp. 576-584, 2003.
[27] L. Zhang, B. Curless, and S.M. Seitz, “Spacetime Stereo: Shape Recovery for Dynamic Scenes,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 367-374, 2003.
[28] T. Zickler, P.N. Belhumeur, and D.J. Kriegman, “Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction,” Proc. European Conf. Computer Vision, pp. 869-884, 2002.
[29] T. Zickler, P.N. Belhumeur, and D.J. Kriegman, “Toward a Stratification of Helmholtz Stereopsis,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 548-554, 2003.
[30] T. Zickler, J. Ho, D.J. Kriegman, J. Ponce, and P.N. Belhumeur, “Binocular Helmholtz Stereopsis,” Proc. IEEE Int'l Conf. Computer Vision, pp. 1411-1417, 2003.
Index Terms:
Stereo, BRDF, rank constraint, light transport constancy, non-Lambertian.
Citation:
Liang Wang, Ruigang Yang, James E. Davis, "BRDF Invariant Stereo Using Light Transport Constancy," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 9, pp. 1616-1626, July 2007, doi:10.1109/TPAMI.2007.1171
PURCHASE ARTICLE: $19
IEEE Xplore Subscribers
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb