sensors-21-02131.pdf (8.04 MB)

Three-Dimensional Reconstruction with a Laser Line Based on 2 Image In-Painting and Multi-Spectral Photometric Stereo

Download (8.04 MB)
journal contribution
posted on 09.09.2021, 09:21 by L Lu, H Zhu, J Dong, Y Ju, Huiyu Zhou
This paper presents a multi-spectral photometric stereo (MPS) method based on image in-painting, which can reconstruct the shape using a multi-spectral image with a laser line. One of the difficulties in multi-spectral photometric stereo is to extract the laser line because the required illumination for MPS, e.g., red, green, and blue light, may pollute the laser color. Unlike previous methods, through the improvement of the network proposed by Isola, a Generative Adversarial Network based on image in-painting was proposed, to separate a multi-spectral image with a laser line into a clean laser image and an uncorrupted multi-spectral image without the laser line. Then these results were substituted into the method proposed by Fan to obtain high-precision 3D reconstruction results. To make the proposed method applicable to real-world objects, a rendered image dataset obtained using the rendering models in ShapeNet has been used for training the network. Evaluation using the rendered images and real-world images shows the superiority of the proposed approach over several previous methods.

History

Citation

Sensors 2021, 21(6), 2131; https://doi.org/10.3390/s21062131

Author affiliation

School of Informatics

Version

VoR (Version of Record)

Published in

Sensors

Volume

21

Issue

6

Publisher

MDPI AG

issn

1424-8220

Acceptance date

07/03/2021

Copyright date

2021

Available date

09/09/2021

Language

en