Realistic texture mapping and coherent up-to-date rendering is one of the most important issues in indoor 3-D modelling.However,existing texturing approaches are usually performed manually during the modelling process...Realistic texture mapping and coherent up-to-date rendering is one of the most important issues in indoor 3-D modelling.However,existing texturing approaches are usually performed manually during the modelling process,and cannot accommodate changes in indoor environments occurring after the model was created,resulting in outdated and misleading texture rendering.In this study,a structured learning-based texture mapping method is proposed for automatic mapping a single still photo from a mobile phone onto an alreadyconstructed indoor 3-D model.The up-to-date texture is captured using a smart phone,and the indoor structural layout is extracted by incorporating per-pixel segmentation in the FCN algorithm and the line constraints into a structured learning algorithm.This enables real-time texture mapping according to parts of the model,based on the structural layout.Furthermore,the rough camera pose is estimated by pedestrian dead reckoning(PDR)and map information to determine where to map the texture.The experimental results presented in this paper demonstrate that our approach can achieve accurate fusion of 3-D triangular meshes with 2-D single images,achieving low-cost and automatic indoor texture updating.Based on this fusion approach,users can have a better experience in virtual indoor3-D applications.展开更多
基金supported by the National Key Research and Development Program of China[grant number 2016YFB0502203]the National Natural Science Foundation of China Project[41701445]The State Key Laboratory of Information Engineering in Surveying,Mapping and Remote Sensing of Wuhan University.
文摘Realistic texture mapping and coherent up-to-date rendering is one of the most important issues in indoor 3-D modelling.However,existing texturing approaches are usually performed manually during the modelling process,and cannot accommodate changes in indoor environments occurring after the model was created,resulting in outdated and misleading texture rendering.In this study,a structured learning-based texture mapping method is proposed for automatic mapping a single still photo from a mobile phone onto an alreadyconstructed indoor 3-D model.The up-to-date texture is captured using a smart phone,and the indoor structural layout is extracted by incorporating per-pixel segmentation in the FCN algorithm and the line constraints into a structured learning algorithm.This enables real-time texture mapping according to parts of the model,based on the structural layout.Furthermore,the rough camera pose is estimated by pedestrian dead reckoning(PDR)and map information to determine where to map the texture.The experimental results presented in this paper demonstrate that our approach can achieve accurate fusion of 3-D triangular meshes with 2-D single images,achieving low-cost and automatic indoor texture updating.Based on this fusion approach,users can have a better experience in virtual indoor3-D applications.
