Reverse engineering dealing with images is traditionally based on image processing and contour recognition. A new method is presented based on the combination of sectional slicing with image mosaic. Sectional contours...Reverse engineering dealing with images is traditionally based on image processing and contour recognition. A new method is presented based on the combination of sectional slicing with image mosaic. Sectional contours of the target object are generated by colorful liquid or laser scanning, these images from different views are fused into a set of complete cross-sectional images, thereby the whole practical model is reconstructed in 3D space.展开更多
The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the a...The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the acquisition of images in real-time,motion blur,caused by camera shaking or human motion,appears.Deep learning-based intelligent control applied in vision can help us solve the problem.To this end,we propose a 3D reconstruction method for motion-blurred images using deep learning.First,we develop a BF-WGAN algorithm that combines the bilateral filtering(BF)denoising theory with a Wasserstein generative adversarial network(WGAN)to remove motion blur.The bilateral filter denoising algorithm is used to remove the noise and to retain the details of the blurred image.Then,the blurred image and the corresponding sharp image are input into the WGAN.This algorithm distinguishes the motion-blurred image from the corresponding sharp image according to the WGAN loss and perceptual loss functions.Next,we use the deblurred images generated by the BFWGAN algorithm for 3D reconstruction.We propose a threshold optimization random sample consensus(TO-RANSAC)algorithm that can remove the wrong relationship between two views in the 3D reconstructed model relatively accurately.Compared with the traditional RANSAC algorithm,the TO-RANSAC algorithm can adjust the threshold adaptively,which improves the accuracy of the 3D reconstruction results.The experimental results show that our BF-WGAN algorithm has a better deblurring effect and higher efficiency than do other representative algorithms.In addition,the TO-RANSAC algorithm yields a calculation accuracy considerably higher than that of the traditional RANSAC algorithm.展开更多
Historical architecture is an important carrier of cultural and historical heritage in a country and region,and its protection and restoration work plays a crucial role in the inheritance of cultural heritage.However,...Historical architecture is an important carrier of cultural and historical heritage in a country and region,and its protection and restoration work plays a crucial role in the inheritance of cultural heritage.However,the damage and destruction of buildings urgently need to be repaired due to the ancient age of historical buildings and the influence of natural environment and human factors.Therefore,an artificial intelligence repair technology based on three-dimensional(3D)point cloud(PC)reconstruction and generative adversarial networks(GANs)was proposed to improve the precision and efficiency of repair work.First,in-depth research on the principles and algorithms of 3D PC data processing and GANs should be conducted.Second,a digital restoration frameworkwas constructed by combining these two artificial intelligence technologies to achieve precise and efficient restoration of historical buildings through continuous adversarial learning processes.The experimental results showed that the errors in the restoration of palace buildings,defense walls,pagodas,altars,temples,and mausoleums were 0.17,0.12,0.13,0.11,and 0.09,respectively.The technique can significantly reduce the error while maintaining the high-precision repair effect.This technology with artificial intelligence as the core has excellent accuracy and stability in the digital restoration.It provides a new technical means for the digital restoration of historical buildings and has important practical significance for the protection of cultural heritage.展开更多
The rise of artificial intelligence generated content(AIGC)has been remarkable in the language and image fields,but artificial intelligence(AI)generated three-dimensional(3D)models are still under-explored due to thei...The rise of artificial intelligence generated content(AIGC)has been remarkable in the language and image fields,but artificial intelligence(AI)generated three-dimensional(3D)models are still under-explored due to their complex nature and lack of training data.The conventional approach of creating 3D content through computer-aided design(CAD)is labor-intensive and requires expertise,making it challenging for novice users.To address this issue,we propose a sketch-based 3D modeling approach,Deep3DSketch-im,which uses a single freehand sketch for modeling.This is a challenging task due to the sparsity and ambiguity.Deep3DSketch-im uses a novel data representation called the signed distance field(SDF)to improve the sketch-to-3D model process by incorporating an implicit continuous field instead of voxel or points,and a specially designed neural network that can capture point and local features.Extensive experiments are conducted to demonstrate the effectiveness of the approach,achieving state-of-the-art(SOTA)performance on both synthetic and real datasets.Additionally,users show more satisfaction with results generated by Deep3DSketch-im,as reported in a user study.We believe that Deep3DSketch-im has the potential to revolutionize the process of 3D modeling by providing an intuitive and easy-to-use solution for novice users.展开更多
基金Supported by Construction of Key Disciplines in Shanghai (B503)
文摘Reverse engineering dealing with images is traditionally based on image processing and contour recognition. A new method is presented based on the combination of sectional slicing with image mosaic. Sectional contours of the target object are generated by colorful liquid or laser scanning, these images from different views are fused into a set of complete cross-sectional images, thereby the whole practical model is reconstructed in 3D space.
基金the National Natural Science Foundation of China under Grant 61902311in part by the Japan Society for the Promotion of Science(JSPS)Grants-in-Aid for Scientific Research(KAKENHI)under Grant JP18K18044.
文摘The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the acquisition of images in real-time,motion blur,caused by camera shaking or human motion,appears.Deep learning-based intelligent control applied in vision can help us solve the problem.To this end,we propose a 3D reconstruction method for motion-blurred images using deep learning.First,we develop a BF-WGAN algorithm that combines the bilateral filtering(BF)denoising theory with a Wasserstein generative adversarial network(WGAN)to remove motion blur.The bilateral filter denoising algorithm is used to remove the noise and to retain the details of the blurred image.Then,the blurred image and the corresponding sharp image are input into the WGAN.This algorithm distinguishes the motion-blurred image from the corresponding sharp image according to the WGAN loss and perceptual loss functions.Next,we use the deblurred images generated by the BFWGAN algorithm for 3D reconstruction.We propose a threshold optimization random sample consensus(TO-RANSAC)algorithm that can remove the wrong relationship between two views in the 3D reconstructed model relatively accurately.Compared with the traditional RANSAC algorithm,the TO-RANSAC algorithm can adjust the threshold adaptively,which improves the accuracy of the 3D reconstruction results.The experimental results show that our BF-WGAN algorithm has a better deblurring effect and higher efficiency than do other representative algorithms.In addition,the TO-RANSAC algorithm yields a calculation accuracy considerably higher than that of the traditional RANSAC algorithm.
基金supported by The Social Science Foundation of Fujian Province(Grant no.FJ2021B080)The 2023 Fujian Provincial Foreign Cooperation Science and Technology Plan Project(2023I0047)+3 种基金The 2022 Longyan Industry-University-Research Joint Innovation Project(2022LYF18001)The 2023 Fujian Natural Resources Science and Tech-nology Innovation Project(KY-060000-04-2023-2002)Open Project Fund of Hunan Provincial Key Laboratory for Remote Sensing Monitoring of Ecological Environment in Dongting Lake Area(Project No:DTH Key Lab.2023-04)The Construction Science and Technology Research and Development Project of Fujian Province,China(Grant no.2022-K-85).
文摘Historical architecture is an important carrier of cultural and historical heritage in a country and region,and its protection and restoration work plays a crucial role in the inheritance of cultural heritage.However,the damage and destruction of buildings urgently need to be repaired due to the ancient age of historical buildings and the influence of natural environment and human factors.Therefore,an artificial intelligence repair technology based on three-dimensional(3D)point cloud(PC)reconstruction and generative adversarial networks(GANs)was proposed to improve the precision and efficiency of repair work.First,in-depth research on the principles and algorithms of 3D PC data processing and GANs should be conducted.Second,a digital restoration frameworkwas constructed by combining these two artificial intelligence technologies to achieve precise and efficient restoration of historical buildings through continuous adversarial learning processes.The experimental results showed that the errors in the restoration of palace buildings,defense walls,pagodas,altars,temples,and mausoleums were 0.17,0.12,0.13,0.11,and 0.09,respectively.The technique can significantly reduce the error while maintaining the high-precision repair effect.This technology with artificial intelligence as the core has excellent accuracy and stability in the digital restoration.It provides a new technical means for the digital restoration of historical buildings and has important practical significance for the protection of cultural heritage.
基金Project supported by the National Key R&D Program of China(No.2022YFB3303301)the National Natural Science Foundation of China(Nos.62006208,62107035,and 62207024)the Public Welfare Research Program of Huzhou Science and Technology Bureau,China(No.2022GZ01)。
文摘The rise of artificial intelligence generated content(AIGC)has been remarkable in the language and image fields,but artificial intelligence(AI)generated three-dimensional(3D)models are still under-explored due to their complex nature and lack of training data.The conventional approach of creating 3D content through computer-aided design(CAD)is labor-intensive and requires expertise,making it challenging for novice users.To address this issue,we propose a sketch-based 3D modeling approach,Deep3DSketch-im,which uses a single freehand sketch for modeling.This is a challenging task due to the sparsity and ambiguity.Deep3DSketch-im uses a novel data representation called the signed distance field(SDF)to improve the sketch-to-3D model process by incorporating an implicit continuous field instead of voxel or points,and a specially designed neural network that can capture point and local features.Extensive experiments are conducted to demonstrate the effectiveness of the approach,achieving state-of-the-art(SOTA)performance on both synthetic and real datasets.Additionally,users show more satisfaction with results generated by Deep3DSketch-im,as reported in a user study.We believe that Deep3DSketch-im has the potential to revolutionize the process of 3D modeling by providing an intuitive and easy-to-use solution for novice users.
