TIM-21-01198_R1.pdf (6.1 MB)
Download file

Incorporating Lambertian Priors into Surface Normals Measurement

Download (6.1 MB)
journal contribution
posted on 07.07.2021, 15:00 by Y Ju, M Jian, S Guo, Y Wang, Huiyu Zhou, J Dong
The goal of photometric stereo is to measure theprecise surface normal of a 3D object from observations withvarious shading cues. However, non-Lambertian surfaces in-fluence the measurement accuracy due to irregular shadingcues. Despite deep neural networks have been employed tosimulate the performance of non-Lambertian surfaces, the errorin specularities, shadows, and crinkle regions is hard to bereduced. In order to address this challenge, we here propose aphotometric stereo network that incorporates Lambertian priorsto better measure the surface normal. In this paper, we usethe initial normal under the Lambertian assumption as theprior information to refine the normal measurement, insteadof solely applying the observed shading cues to deriving thesurface normal. Our method utilizes the Lambertian informationto reparameterize the network weights and the powerful fittingability of deep neural networks to correct these errors causedby general reflectance properties. Our explorations include: theLambertian priors (1) reduce the learning hypothesis space,making our method learn the mapping in the same surfacenormal space and improving the accuracy of learning, and(2) provides the differential features learning, improving thesurfaces reconstruction of details. –Extensive experiments verifythe effectiveness of the proposed Lambertian prior photometricstereo network in accurate surface normal measurement, on thechallenging benchmark dataset.

Funding

The work was supported by the National Key R & D Program of Chinaunder Grant (2018AAA0100602), the National Key Scientific Instrument andEquipment Development Projects of China (41927805), the National NaturalScience Foundation of China (61501417, 61976123), Royal Society - K.C. Wong International Fellowship (NIF\R1\180909) and the Taishan YoungScholars Program of Shandong Province

History

Author affiliation

School of Informatics

Version

AM (Accepted Manuscript)

Published in

IEEE Transactions on Instrumentation and Measurement

Publisher

Institute of Electrical and Electronics Engineers

issn

0018-9456

Acceptance date

25/06/2021

Copyright date

2021

Publisher DOI

Language

en