Image processing based three-dimensional model reconstruction for cross-platform numerical simulation

Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different computing tools have to be developed so as to solve particular fields at different scales and for different processes.Therefore,the integration of different types of software is inevitable.However,it is difficult to perform the transfer of the meshes and simulated results among software packages because of the lack of shared data formats or encrypted data formats.An image processing based method for three-dimensional model reconstruction for numerical simulation was proposed,which presents a solution to the integration problem by a series of slice or projection images obtained by the post-processing modules of the numerical simulation software.By means of mapping image pixels to meshes of either finite difference or finite element models,the geometry contour can be extracted to export the stereolithography model.The values of results,represented by color,can be deduced and assigned to the meshes.All the models with data can be directly or indirectly integrated into other software as a continued or new numerical simulation.The three-dimensional reconstruction method has been validated in numerical simulation of castings and case studies were provided in this study.

Three-Dimensional Model Reconstruction of Nonwovens from Multi-Focus Images

The three-dimensional(3D)model is of great significance to analyze the performance of nonwovens.However,the existing modelling methods could not reconstruct the 3D structure of nonwovens at low cost.A new method based on deep learning was proposed to reconstruct 3D models of nonwovens from multi-focus images.A convolutional neural network was trained to extract clear fibers from sequence images.Image processing algorithms were used to obtain the radius,the central axis,and depth information of fibers from the extraction results.Based on this information,3D models were built in 3D space.Furthermore,self-developed algorithms optimized the central axis and depth of fibers,which made fibers more realistic and continuous.The method with lower cost could reconstruct 3D models of nonwovens conveniently.

3D Shape Reconstruction of Lumbar Vertebra From Two X-ray Images and a CT Model

Structure reconstruction of 3 D anatomy from biplanar X-ray images is a challenging topic. Traditionally, the elastic-model-based method was used to reconstruct 3 D shapes by deforming the control points on the elastic mesh. However, the reconstructed shape is not smooth because the limited control points are only distributed on the edge of the elastic mesh.Alternatively, statistical-model-based methods, which include shape-model-based and intensity-model-based methods, are introduced due to their smooth reconstruction. However, both suffer from limitations. With the shape-model-based method, only the boundary profile is considered, leading to the loss of valid intensity information. For the intensity-based-method, the computation speed is slow because it needs to calculate the intensity distribution in each iteration. To address these issues, we propose a new reconstruction method using X-ray images and a specimen’s CT data. Specifically, the CT data provides both the shape mesh and the intensity model of the vertebra. Intensity model is used to generate the deformation field from X-ray images, while the shape model is used to generate the patient specific model by applying the calculated deformation field.Experiments on the public synthetic dataset and clinical dataset show that the average reconstruction errors are 1.1 mm and1.2 mm, separately. The average reconstruction time is 3 minutes.

A 3D Model Reconstruction Method Using Slice Images

Abstract：reconstruction method using slice im-ages is proposed. Wanting to extract the outermost contours from slice images, the method of the improved GVF-Snake model with optimized force field and ray method is employed. And then, the 3D model is reconstructed by contour connection using the im-proved shortest diagonal method and judgment function of contour fracture. The results show that the accuracy of reconstruction 3D model is improved.

Deep-Learning-Empowered 3D Reconstruction for Dehazed Images in IoT-Enhanced Smart Cities

With increasingly more smart cameras deployed in infrastructure and commercial buildings,3D reconstruction can quickly obtain cities’information and improve the efficiency of government services.Images collected in outdoor hazy environments are prone to color distortion and low contrast;thus,the desired visual effect cannot be achieved and the difficulty of target detection is increased.Artificial intelligence(AI)solutions provide great help for dehazy images,which can automatically identify patterns or monitor the environment.Therefore,we propose a 3D reconstruction method of dehazed images for smart cities based on deep learning.First,we propose a fine transmission image deep convolutional regression network(FT-DCRN)dehazing algorithm that uses fine transmission image and atmospheric light value to compute dehazed image.The DCRN is used to obtain the coarse transmission image,which can not only expand the receptive field of the network but also retain the features to maintain the nonlinearity of the overall network.The fine transmission image is obtained by refining the coarse transmission image using a guided filter.The atmospheric light value is estimated according to the position and brightness of the pixels in the original hazy image.Second,we use the dehazed images generated by the FT-DCRN dehazing algorithm for 3D reconstruction.An advanced relaxed iterative fine matching based on the structure from motion(ARI-SFM)algorithm is proposed.The ARISFM algorithm,which obtains the fine matching corner pairs and reduces the number of iterations,establishes an accurate one-to-one matching corner relationship.The experimental results show that our FT-DCRN dehazing algorithm improves the accuracy compared to other representative algorithms.In addition,the ARI-SFM algorithm guarantees the precision and improves the efficiency.

3-Dimensional Irradiance Imaging with a Single Camera System

本文提出了用一个摄像机重建三维发光体辐射场分布的方法．连续的三维发光体可以看成若干个互相平行的二维发光断层的组合，对发光体某断层进行聚焦摄像，得到的图像是该断层的高斯像和其他断层的离焦像的叠加像．对不同断层分别聚焦摄像，得到一组辐射图像，对图像进行变换、处理，采用图像反演算法，可以重建各断层的辐射场．本文用实验装置模拟了具有两断层的三维发光体，获得了初步结果，证明了该理论的正确性．

An Improved High Precision 3D Semantic Mapping of Indoor Scenes from RGB-D Images

This paper proposes an improved high-precision 3D semantic mapping method for indoor scenes using RGB-D images.The current semantic mapping algorithms suffer from low semantic annotation accuracy and insufficient real-time performance.To address these issues,we first adopt the Elastic Fusion algorithm to select key frames from indoor environment image sequences captured by the Kinect sensor and construct the indoor environment space model.Then,an indoor RGB-D image semantic segmentation network is proposed,which uses multi-scale feature fusion to quickly and accurately obtain object labeling information at the pixel level of the spatial point cloud model.Finally,Bayesian updating is used to conduct incremental semantic label fusion on the established spatial point cloud model.We also employ dense conditional random fields(CRF)to optimize the 3D semantic map model,resulting in a high-precision spatial semantic map of indoor scenes.Experimental results show that the proposed semantic mapping system can process image sequences collected by RGB-D sensors in real-time and output accurate semantic segmentation results of indoor scene images and the current local spatial semantic map.Finally,it constructs a globally consistent high-precision indoor scenes 3D semantic map.

Evaluation of Airway Obstruction at Soft Palate Level in Male Patients with Obstructive Sleep Apnea/Hypopnea Syndrome:Dynamic 3-Dimensional CT Imaging of Upper Airway

This study examined the dynamic characteristics of upper airway collapse at soft palate level in patients with obstructive sleep apnea/hypopnea syndrome（OSAHS） by using dynamic 3-Dimensional（3-D） CT imaging.A total of 41 male patients who presented with 2 of the following symptoms,i.e.,daytime sleepiness and fatigue,frequent snoring,and apnea with witness,were diagnosed as having OSAHS.They underwent full-night polysomnography and then dynamic 3-D CT imaging of the upper airway during quiet breathing and in Muller＇s maneuver.The soft palate length（SPL）,the minimal cross-sectional area of the retropalatal region（mXSA-RP）,and the vertical distance from the hard palate to the upper posterior part of the hyoid（hhL） were compared between the two breathing states.These parameters,together with hard palate length（HPL）,were also compared between mild/moderate and severe OSAHS groups.Association of these parameters with the severity of OSAHS [as reflected by apnea hypopnea index（AHI） and the lowest saturation of blood oxygen（LSaO2）] was examined.The results showed that 31 patients had severe OSAHS,and 10 mild/moderate OSAHS.All the patients had airway obstruction at soft palate level.mXSA-RP was significantly decreased and SPL remarkably increased during Muller＇s maneuver as compared with the quiet breathing state.There were no significant differences in these airway parameters（except the position of the hyoid bone） between severe and mild/moderate OSAHS groups.And no significant correlation between these airway parameters and the severity of OSAHS was found.The position of hyoid was lower in the severe OSAHS group than in the mild/moderate OSAHS group.The patients in group with body mass index（BMI）≥26 had higher collapse ratio of mXSA-RP,greater neck circumference and smaller mXSA-RP in the Muller＇s maneuver than those in group with BMI26（P0.05 for all）.It was concluded that dynamic 3-D CT imaging could dynamically show the upper airway changes at soft palate level in OSAHS patients.All the OSAHS patients had airway obstruction of various degrees at soft palate level.But no correlation was observed between the airway change at soft palate level and the severity of OSAHS.The patients in group with BMI≥26 were more likely to develop airway obstruction at soft palate level than those with BMI26.

PC-BASED SURFACE RECONSTRUCTION OF MEDICAL CT IMAGES

It is an active research area to reconstruct 3-D object and display its visible surfacesfrom cross-sectional images. In this paper, the methods of reconstructing 3-D object from medicalCT images and displaying the visible surfaces are discussed. A polygon approximation methodthat forms polygon with the same number of segment points and a fast interpolation method forcross-sectional contours are presented at first. Then the voxel set of a human liver is reconstructed.And then the liver voxel set is displayed using depth and gradient shading methods. The softwareis written in C programming language at a microcomputer image processing system with a PC/ATcomputer as the host and a PC-VISION board as the image processing unit. The result of theprocessing is satisfying.

Enhancing 3D Reconstruction Accuracy of FIB Tomography Data Using Multi‑voltage Images and Multimodal Machine Learning

FIB-SEM tomography is a powerful technique that integrates a focused ion beam(FIB)and a scanning electron microscope(SEM)to capture high-resolution imaging data of nanostructures.This approach involves collecting in-plane SEM imagesand using FIB to remove material layers for imaging subsequent planes,thereby producing image stacks.However,theseimage stacks in FIB-SEM tomography are subject to the shine-through effect,which makes structures visible from theposterior regions of the current plane.This artifact introduces an ambiguity between image intensity and structures in thecurrent plane,making conventional segmentation methods such as thresholding or the k-means algorithm insufficient.Inthis study,we propose a multimodal machine learning approach that combines intensity information obtained at differentelectron beam accelerating voltages to improve the three-dimensional(3D)reconstruction of nanostructures.By treatingthe increased shine-through effect at higher accelerating voltages as a form of additional information,the proposed methodsignificantly improves segmentation accuracy and leads to more precise 3D reconstructions for real FIB tomography data.

New Virtual Cutting Algorithms for 3D Surface Model Reconstructed from Medical Images

This paper proposes a practical algorithms of plane cutting, stereo clipping and arbitrary cutting for 3D surface model reconstructed from medical images. In plane cutting and stereo clipping algorithms, the 3D model is cut by plane or polyhedron. Lists of edge and vertex in every cut plane are established. From these lists the boundary contours are created and their relationship of embrace is ascertained. The region closed by the contours is triangulated using Delaunay triangulation algorithm. Arbitrary cutting operation creates cutting curve interactively. The cut model still maintains its correct topology structure. With these operations, tissues inside can be observed easily and it can aid doctors to diagnose. The methods can also be used in surgery planning of radiotherapy.

Three-dimensional imaging identified the accessory bile duct in a patient with cholangiocarcinoma

The development of diagnostic imaging technology, such as multidetector computed tomography(MDCT) and magnetic resonance cholangiopancreatography(MRCP), has made it possible to obtain detailed images of the bile duct. Recent reports have indicated that a 3-dimensional(3D) reconstructed imaging system would be useful for understanding the liver anatomy before surgery. We have investigated a novel method that fuses MDCT and MRCP images. This novel system easily made it possible to detect the anatomical relationship between the vessels and bile duct in the portal hepatis. In this report, we describe a very rare case of extrahepatic cholangiocarcinoma associated with an accessory bile duct from the caudate lobe connecting with the intrapancreatic bile duct. We were unable to preoperatively detect this accessory bile duct using MDCT and MRCP. However, prior to the second operation, we were able to clearly visualise the injured accessory bile duct using our novel 3D imaging modality. In thisreport, we suggest that this imaging technique can be considered a novel and useful modality for understanding the anatomy of the portal hepatis, including the hilar bile duct.

3D reconstruction method and connectivity rules of fracture networks generated under different mining layouts

In current research,a series of triaxial tests,which were employed to simulate three typical mining layouts(i.e.,top-coal caving,non-pillar mining and protected coal seam mining),were conducted on coal by using MTS815 Flex Test GT rock mechanics test system,and the fracture networks in the broken coal samples were qualitatively and quantitatively investigated by employing CT scanning and 3D reconstruction techniques.This work aimed at providing a detail description on the micro-structure and fractureconnectivity characteristics of rupture coal samples under different mining layouts.The results show that:(i)for protected coal seam mining layout,the coal specimens failure is in a compression-shear manner and oppositely,(ii)the tension-shear failure phenomenon is observed for top-coal caving and non-pillar mining layouts.By investigating the connectivity features of the generated fractures in the direction ofσ_1,under different mining layouts,it is found that the connectivity level of the fractures of the samples corresponding to non-pillar mining layout was the highest.

3-D RECONSTRUCTION OF SHAPE AND STRUCTURE FOR THE SPACE OBJECT FROM SERIAL CROSS-SECTIONS

A new method for reconstructing a 3-dimensional object from serial cross-sectionsis presented in this paper.The method is based on the principle of sampling and considersevery point in cross-sections as a sampling point and performs the interpolating of nonlinearfunction with these sampling points.Compared with other methods,this method has manyadvantages such as higher precision and fewer requested known sampling points.The result ofreconstruction with this method is an“entity”which involves the exterior shape and interiorconstruction information of the object simultaneously.

3-D Visualization of Medical Images with Arbitrary Sections

In this paper, with the general retrospect to the research on surface reconstruction and the marching cubes algorithm, we gave detailed description of an algorithm on the construction of object surfaces. The possible ambiguity problem in the original marching cubes algorithm was eliminated by its index mechanism. Some results on the MRI images were presented. Based on extracting and clipping contours from a set of medial slice images and setting the patch vertices values according to the gray images, this algorithm may be applied to form the arbitrary section images with three dimensional effects. It can also enhance the visual effect and interpretation of medical data.

Quantitative analysis of 3-dimensional root architecture based on image reconstruction and its application to research on phosphorus uptake in soybean

Quantification of 3-dimensional (3-D) plant root architecture is one of the most important approaches to investigating plant root growth and its function in nutrient acquisition and utilization. However, no effective methods have been reported hitherto to quantify 3-D root architecture parameters, making it difficult to further study the 3-D characteris- tics of the root system and its function. In the present study, we created a rapid algorithm to reconstruct 3-D root system images based on the basic structural features of such linear objects as roots, using 2-D root images taken by digital CCD cameras at multi- viewing angles. This method is very effective in the reconstruction of plant root system images, thus enabling us to obtain the digital model of 3-D root architecture and its 3-D skeleton, based on which some major root architecture parameters can be calculated. Using this method, we were able to ac- quire 3-D parameters of soybean root architecture whose root diameter was more than 0.3 mm, includ- ing tap root length, total root length, average basal root angle, ratio of root width to root depth, percent- age distribution of root length in different layers and root distribution in different 3-D regions of the growth medium. We also quantitatively analyzed the rela- tionship between different root architecture parame-ters and such plant nutrition parameters as soybean biomass and phosphorus (P) uptake. Our study may provide a new tool in studying the growth and nutri- tional functions of plant root systems.

A fast, accurate and dense feature matching algorithm for aerial images

Three-dimensional(3D)reconstruction based on aerial images has broad prospects,and feature matching is an important step of it.However,for high-resolution aerial images,there are usually problems such as long time,mismatching and sparse feature pairs using traditional algorithms.Therefore,an algorithm is proposed to realize fast,accurate and dense feature matching.The algorithm consists of four steps.Firstly,we achieve a balance between the feature matching time and the number of matching pairs by appropriately reducing the image resolution.Secondly,to realize further screening of the mismatches,a feature screening algorithm based on similarity judgment or local optimization is proposed.Thirdly,to make the algorithm more widely applicable,we combine the results of different algorithms to get dense results.Finally,all matching feature pairs in the low-resolution images are restored to the original images.Comparisons between the original algorithms and our algorithm show that the proposed algorithm can effectively reduce the matching time,screen out the mismatches,and improve the number of matches.

Weld pool boundary and weld bead shape reconstruction based on passive vision in P-GMAW

A passive visual sensing system is established in this research, and clear weld pool images in pulsed gas metal arc welding （ P-GMA W） can be captured with this system. The three-dimensional weld pool geometry, especially the weld height, is not only a crucial factor in determining workpiece mechanical properties, but also an important parameter for reflecting the penetration. A new three-dimensional （3D） model is established to describe the weld pool geometry in P-GMAW. Then, a series of algorithms are developed to extract the model geometrical parameters from the weld pool images. Furthermore, the method to reconstruct the 3 D shape of weld pool boundary and weld bead from the two-dimensional images is investigated.

Slicing Method for Reverse Engineering Based on Image Mosaic

Reverse engineering dealing with images is traditionally based on image processing and contour recognition. A new method is presented based on the combination of sectional slicing with image mosaic. Sectional contours of the target object are generated by colorful liquid or laser scanning, these images from different views are fused into a set of complete cross-sectional images, thereby the whole practical model is reconstructed in 3D space.