Remote sensing images carry crucial ground information,often involving the spatial distribution and spatiotemporal changes of surface elements.To safeguard this sensitive data,image encryption technology is essential....Remote sensing images carry crucial ground information,often involving the spatial distribution and spatiotemporal changes of surface elements.To safeguard this sensitive data,image encryption technology is essential.In this paper,a novel Fibonacci sine exponential map is designed,the hyperchaotic performance of which is particularly suitable for image encryption algorithms.An encryption algorithm tailored for handling the multi-band attributes of remote sensing images is proposed.The algorithm combines a three-dimensional synchronized scrambled diffusion operation with chaos to efficiently encrypt multiple images.Moreover,the keys are processed using an elliptic curve cryptosystem,eliminating the need for an additional channel to transmit the keys,thus enhancing security.Experimental results and algorithm analysis demonstrate that the algorithm offers strong security and high efficiency,making it suitable for remote sensing image encryption tasks.展开更多
This study is to compare three-dimensional(3D)isotropic T2-weighted magnetic resonance imaging(MRI)with compressed sensing-sampling perfection with application optimized contrast(CS-SPACE)and the conventional image(3D...This study is to compare three-dimensional(3D)isotropic T2-weighted magnetic resonance imaging(MRI)with compressed sensing-sampling perfection with application optimized contrast(CS-SPACE)and the conventional image(3D-SPACE)sequence in terms of image quality,estimated signal-to-noise ratio(SNR),relative contrast-to-noise ratio(CNR),and the lesions’conspicuous of the female pelvis.Thirty-six females(age:51,28-73)with cervical carcinoma(n=20),rectal carcinoma(n=7),or uterine fibroid(n=9)were included.Patients underwent magnetic resonance(MR)imaging at a 3T scanner with the sequences of 3D-SPACE,CS-SPACE,and twodimensional(2D)T2-weighted turbo-spin echo(TSE).Quantitative analyses of estimated SNR and relative CNR between tumors and other tissues,image quality,and tissue conspicuity were performed.Two radiologists assessed the difference in diagnostic findings for carcinoma.Quantitative values and qualitative scores were analyzed,respectively.The estimated SNR and the relative CNR of tumor-to-muscle obturator internus,tumor-to-myometrium,and myometrium-to-muscle obturator internus was comparable between 3D-SPACE and CS-SPACE.The overall image quality and the conspicuity of the lesion scores of the CS-SPACE were higher than that of the 3D-SPACE(P<0.01).The CS-SPACE sequence offers shorter scan time,fewer artifacts,and comparable SNR and CNR to conventional 3D-SPACE,and has the potential to improve the performance of T2-weighted images.展开更多
Atmospheric ammonia(NH_(3)) is a chemically active trace gas that plays an important role in the atmospheric environment and climate change. Satellite remote sensing is a powerful technique to monitor NH_(3) concentra...Atmospheric ammonia(NH_(3)) is a chemically active trace gas that plays an important role in the atmospheric environment and climate change. Satellite remote sensing is a powerful technique to monitor NH_(3) concentration based on the absorption lines of NH_(3) in the thermal infrared region. In this study, we establish a retrieval algorithm to derive the NH_(3)column from the Hyperspectral Infrared Atmospheric Sounder(HIRAS) onboard the Chinese Feng Yun(FY)-3D satellite and present the first atmospheric NH_(3) column global map observed by the HIRAS instrument. The HIRAS observations can well capture NH_(3) hotspots around the world, e.g., India, West Africa, and East China, where large NH_(3) emissions exist. The HIRAS NH_(3) columns are also compared to the space-based Infrared Atmospheric Sounding Interferometer(IASI)measurements, and we find that the two instruments observe a consistent NH_(3) global distribution, with correlation coefficient(R) values of 0.28–0.73. Finally, some remaining issues about the HIRAS NH_(3) retrieval are discussed.展开更多
The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resoluti...The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resolution remote sensing images,we present an effective YOLOv3 framework,corner regression-based YOLOv3(Correg-YOLOv3),to localize dense building accurately.This improved YOLOv3 algorithm establishes a vertex regression mechanism and an additional loss item about building vertex offsets relative to the center point of bounding box.By extending output dimensions,the trained model is able to output the rectangular bounding boxes and the building vertices meanwhile.Finally,we evaluate the performance of the Correg-YOLOv3 on our self-produced data set and provide a comparative analysis qualitatively and quantitatively.The experimental results achieve high performance in precision(96.45%),recall rate(95.75%),F1 score(96.10%)and average precision(98.05%),which were 2.73%,5.4%,4.1%and 4.73%higher than that of YOLOv3.Therefore,our proposed algorithm effectively tackles the problem of dense building detection in high resolution images.展开更多
This paper proposes an improved high-precision 3D semantic mapping method for indoor scenes using RGB-D images.The current semantic mapping algorithms suffer from low semantic annotation accuracy and insufficient real...This paper proposes an improved high-precision 3D semantic mapping method for indoor scenes using RGB-D images.The current semantic mapping algorithms suffer from low semantic annotation accuracy and insufficient real-time performance.To address these issues,we first adopt the Elastic Fusion algorithm to select key frames from indoor environment image sequences captured by the Kinect sensor and construct the indoor environment space model.Then,an indoor RGB-D image semantic segmentation network is proposed,which uses multi-scale feature fusion to quickly and accurately obtain object labeling information at the pixel level of the spatial point cloud model.Finally,Bayesian updating is used to conduct incremental semantic label fusion on the established spatial point cloud model.We also employ dense conditional random fields(CRF)to optimize the 3D semantic map model,resulting in a high-precision spatial semantic map of indoor scenes.Experimental results show that the proposed semantic mapping system can process image sequences collected by RGB-D sensors in real-time and output accurate semantic segmentation results of indoor scene images and the current local spatial semantic map.Finally,it constructs a globally consistent high-precision indoor scenes 3D semantic map.展开更多
Structure reconstruction of 3 D anatomy from biplanar X-ray images is a challenging topic. Traditionally, the elastic-model-based method was used to reconstruct 3 D shapes by deforming the control points on the elasti...Structure reconstruction of 3 D anatomy from biplanar X-ray images is a challenging topic. Traditionally, the elastic-model-based method was used to reconstruct 3 D shapes by deforming the control points on the elastic mesh. However, the reconstructed shape is not smooth because the limited control points are only distributed on the edge of the elastic mesh.Alternatively, statistical-model-based methods, which include shape-model-based and intensity-model-based methods, are introduced due to their smooth reconstruction. However, both suffer from limitations. With the shape-model-based method, only the boundary profile is considered, leading to the loss of valid intensity information. For the intensity-based-method, the computation speed is slow because it needs to calculate the intensity distribution in each iteration. To address these issues, we propose a new reconstruction method using X-ray images and a specimen’s CT data. Specifically, the CT data provides both the shape mesh and the intensity model of the vertebra. Intensity model is used to generate the deformation field from X-ray images, while the shape model is used to generate the patient specific model by applying the calculated deformation field.Experiments on the public synthetic dataset and clinical dataset show that the average reconstruction errors are 1.1 mm and1.2 mm, separately. The average reconstruction time is 3 minutes.展开更多
According to the data characteristics of Landsat thematic mapper (TM) and MODIS, a new fu sion algorithm about thermal infrared data has been proposed in the article based on improving wave let reconstruction. Under...According to the data characteristics of Landsat thematic mapper (TM) and MODIS, a new fu sion algorithm about thermal infrared data has been proposed in the article based on improving wave let reconstruction. Under the domain of neighborhood wavelet reconstruction, data of TM and MO DIS are divided into three layers using wavelet decomposition. The texture information of TM data is retained by fusing highfrequency information. The neighborhood correction coefficient method (NC CM) is set up based on the search neighborhood of a certain size to fuse lowfrequency information. Thermal infrared value of MODIS data is reduced to the space value of TM data by applying NCCM. The data with high spectrum, high spatial and high temporal resolution, are obtained through the al gorithm in the paper. Verification results show that the texture information of TM data and high spec tral information of MODIS data could be preserved well by the fusion algorithm. This article could provide technical support for high precision and fast extraction of the surface environment parame ters.展开更多
In airborne array synthetic aperture radar(SAR), the three-dimensional(3D) imaging performance and cross-track resolution depends on the length of the equivalent array. In this paper, Barker sequence criterion is used...In airborne array synthetic aperture radar(SAR), the three-dimensional(3D) imaging performance and cross-track resolution depends on the length of the equivalent array. In this paper, Barker sequence criterion is used for sparse flight sampling of airborne array SAR, in order to obtain high cross-track resolution in as few times of flights as possible. Under each flight, the imaging algorithm of back projection(BP) and the data extraction method based on modified uniformly redundant arrays(MURAs) are utilized to obtain complex 3D image pairs. To solve the side-lobe noise in images, the interferometry between each image pair is implemented, and compressed sensing(CS) reconstruction is adopted in the frequency domain. Furthermore, to restore the geometrical relationship between each flight, the phase information corresponding to negative MURA is compensated on each single-pass image reconstructed by CS. Finally,by coherent accumulation of each complex image, the high resolution in cross-track direction is obtained. Simulations and experiments in X-band verify the availability.展开更多
A novel technique of three-dimensional (3D) reconstruction, segmentation, display and analysis of series slices of images including microscopic wide field optical sectioning by deconvolution method, cryo-electron micr...A novel technique of three-dimensional (3D) reconstruction, segmentation, display and analysis of series slices of images including microscopic wide field optical sectioning by deconvolution method, cryo-electron microscope slices by Fou-rier-Bessel synthesis and electron tomography (ET), and a series of computed tomography (CT) was developed to perform si-multaneous measurement on the structure and function of biomedical samples. The paper presents the 3D reconstruction seg-mentation display and analysis results of pollen spore, chaperonin, virus, head, cervical bone, tibia and carpus. At the same time, it also puts forward some potential applications of the new technique in the biomedical realm.展开更多
Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different ...Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different computing tools have to be developed so as to solve particular fields at different scales and for different processes.Therefore,the integration of different types of software is inevitable.However,it is difficult to perform the transfer of the meshes and simulated results among software packages because of the lack of shared data formats or encrypted data formats.An image processing based method for three-dimensional model reconstruction for numerical simulation was proposed,which presents a solution to the integration problem by a series of slice or projection images obtained by the post-processing modules of the numerical simulation software.By means of mapping image pixels to meshes of either finite difference or finite element models,the geometry contour can be extracted to export the stereolithography model.The values of results,represented by color,can be deduced and assigned to the meshes.All the models with data can be directly or indirectly integrated into other software as a continued or new numerical simulation.The three-dimensional reconstruction method has been validated in numerical simulation of castings and case studies were provided in this study.展开更多
With increasingly more smart cameras deployed in infrastructure and commercial buildings,3D reconstruction can quickly obtain cities’information and improve the efficiency of government services.Images collected in o...With increasingly more smart cameras deployed in infrastructure and commercial buildings,3D reconstruction can quickly obtain cities’information and improve the efficiency of government services.Images collected in outdoor hazy environments are prone to color distortion and low contrast;thus,the desired visual effect cannot be achieved and the difficulty of target detection is increased.Artificial intelligence(AI)solutions provide great help for dehazy images,which can automatically identify patterns or monitor the environment.Therefore,we propose a 3D reconstruction method of dehazed images for smart cities based on deep learning.First,we propose a fine transmission image deep convolutional regression network(FT-DCRN)dehazing algorithm that uses fine transmission image and atmospheric light value to compute dehazed image.The DCRN is used to obtain the coarse transmission image,which can not only expand the receptive field of the network but also retain the features to maintain the nonlinearity of the overall network.The fine transmission image is obtained by refining the coarse transmission image using a guided filter.The atmospheric light value is estimated according to the position and brightness of the pixels in the original hazy image.Second,we use the dehazed images generated by the FT-DCRN dehazing algorithm for 3D reconstruction.An advanced relaxed iterative fine matching based on the structure from motion(ARI-SFM)algorithm is proposed.The ARISFM algorithm,which obtains the fine matching corner pairs and reduces the number of iterations,establishes an accurate one-to-one matching corner relationship.The experimental results show that our FT-DCRN dehazing algorithm improves the accuracy compared to other representative algorithms.In addition,the ARI-SFM algorithm guarantees the precision and improves the efficiency.展开更多
The three-dimensional(3D)model is of great significance to analyze the performance of nonwovens.However,the existing modelling methods could not reconstruct the 3D structure of nonwovens at low cost.A new method based...The three-dimensional(3D)model is of great significance to analyze the performance of nonwovens.However,the existing modelling methods could not reconstruct the 3D structure of nonwovens at low cost.A new method based on deep learning was proposed to reconstruct 3D models of nonwovens from multi-focus images.A convolutional neural network was trained to extract clear fibers from sequence images.Image processing algorithms were used to obtain the radius,the central axis,and depth information of fibers from the extraction results.Based on this information,3D models were built in 3D space.Furthermore,self-developed algorithms optimized the central axis and depth of fibers,which made fibers more realistic and continuous.The method with lower cost could reconstruct 3D models of nonwovens conveniently.展开更多
Rapidly and accurately assessing the geometric characteristics of coarse aggregate particles is crucial for ensuring pavement performance in highway engineering.This article introduces an innovative system for the thr...Rapidly and accurately assessing the geometric characteristics of coarse aggregate particles is crucial for ensuring pavement performance in highway engineering.This article introduces an innovative system for the three-dimensional(3D)surface reconstruction of coarse aggregate particles using occlusion-free multi-view imaging.The system captures synchronized images of particles in free fall,employing a matte sphere and a nonlinear optimization approach to estimate the camera projection matrices.A pre-trained segmentation model is utilized to eliminate the background of the images.The Shape from Silhouettes(SfS)algorithm is then applied to generate 3D voxel data,followed by the Marching Cubes algorithm to construct the 3D surface contour.Validation against standard parts and diverse coarse aggregate particles confirms the method's high accuracy,with an average measurement precision of 0.434 mm and a significant increase in scanning and reconstruction efficiency.展开更多
FIB-SEM tomography is a powerful technique that integrates a focused ion beam(FIB)and a scanning electron microscope(SEM)to capture high-resolution imaging data of nanostructures.This approach involves collecting in-p...FIB-SEM tomography is a powerful technique that integrates a focused ion beam(FIB)and a scanning electron microscope(SEM)to capture high-resolution imaging data of nanostructures.This approach involves collecting in-plane SEM imagesand using FIB to remove material layers for imaging subsequent planes,thereby producing image stacks.However,theseimage stacks in FIB-SEM tomography are subject to the shine-through effect,which makes structures visible from theposterior regions of the current plane.This artifact introduces an ambiguity between image intensity and structures in thecurrent plane,making conventional segmentation methods such as thresholding or the k-means algorithm insufficient.Inthis study,we propose a multimodal machine learning approach that combines intensity information obtained at differentelectron beam accelerating voltages to improve the three-dimensional(3D)reconstruction of nanostructures.By treatingthe increased shine-through effect at higher accelerating voltages as a form of additional information,the proposed methodsignificantly improves segmentation accuracy and leads to more precise 3D reconstructions for real FIB tomography data.展开更多
Abstract:reconstruction method using slice im-ages is proposed. Wanting to extract the outermost contours from slice images, the method of the improved GVF-Snake model with optimized force field and ray method is emp...Abstract:reconstruction method using slice im-ages is proposed. Wanting to extract the outermost contours from slice images, the method of the improved GVF-Snake model with optimized force field and ray method is employed. And then, the 3D model is reconstructed by contour connection using the im-proved shortest diagonal method and judgment function of contour fracture. The results show that the accuracy of reconstruction 3D model is improved.展开更多
It is an active research area to reconstruct 3-D object and display its visible surfacesfrom cross-sectional images. In this paper, the methods of reconstructing 3-D object from medicalCT images and displaying the vis...It is an active research area to reconstruct 3-D object and display its visible surfacesfrom cross-sectional images. In this paper, the methods of reconstructing 3-D object from medicalCT images and displaying the visible surfaces are discussed. A polygon approximation methodthat forms polygon with the same number of segment points and a fast interpolation method forcross-sectional contours are presented at first. Then the voxel set of a human liver is reconstructed.And then the liver voxel set is displayed using depth and gradient shading methods. The softwareis written in C programming language at a microcomputer image processing system with a PC/ATcomputer as the host and a PC-VISION board as the image processing unit. The result of theprocessing is satisfying.展开更多
Unmanned aerial vehicle(UAV)array InSAR is a new type of single-flight 3D SAR imaging system with the advantages of high coherence and resolution.However,due to the low altitude of the platform,the elevation ambiguity...Unmanned aerial vehicle(UAV)array InSAR is a new type of single-flight 3D SAR imaging system with the advantages of high coherence and resolution.However,due to the low altitude of the platform,the elevation ambiguity of the system is smaller than the maximal terrain elevation.Since the spatial phase unwrapping is conducted based on the assumption of phase continuity,the inappropriate ambiguity will cause significant unwrapping errors.In this work,a 3D phase unwrapping algorithm assisted by image segmentation is proposed to address this issue.The Markov random field(MRF)is utilized for image segmentation.The optimal spatial phase unwrapping network is achieved based on the segmentation results.The asymptotic 3D phase unwrapping is adopted to get the refined 3D reconstruction.Results based on the real airborne array-InSAR data show that the proposed method effectively improves the elevation ambiguity.展开更多
The development of deep learning has inspired some new methods to solve the 3D reconstruction problem for Tomographic Particle Image Velocimetry (Tomo-PIV). However, the supervised learning method requires a large num...The development of deep learning has inspired some new methods to solve the 3D reconstruction problem for Tomographic Particle Image Velocimetry (Tomo-PIV). However, the supervised learning method requires a large number of data with ground truth as training information, which is very difficult to gather from experiments. Although synthetic datasets can be used as alternatives, they are still not exactly the same with the real-world experimental data. In this paper, an Unsupervised Reconstruction Technique based on U-net (UnRTU) is proposed to reconstruct volume particle distribution explicitly. Instead of using ground truth data, a projection function is used as an unsupervised loss function for network training to reconstruct particle distribution. The UnRTU was compared with some traditional algebraic reconstruction algorithms and supervised learning method using synthetic data under different particle density and noise level. The results indicate that UnRTU outperforms these traditional approaches in both reconstruction quality and noise robustness, and is comparable to the supervised learning methods AI-PR. For experimental tests, particles dispersed in cured epoxy resin are moved by an electric rail with a certain speed to obtain the ground truth data of particle velocity. Compared with other algorithms, the reconstructed particle distribution by UnRTU has the best reconstruction fidelity. And the accuracy of the 3D velocity field estimated by UnRTU is 12.9% higher than that from the traditional MLOS-MART algorithm. It demonstrates significant potential and advantages for UnRTU in 3D reconstruction of particle distribution. Finally, UnRTU was successfully applied to the high-speed planar cascade airflow field, demonstrating its applicability for measuring complex fluid flow fields at higher particle density.展开更多
The material flow in friction stir welded 2014 Al alloy has been investigated using a marker insert technique (MIT). Results of the flow visualization show that the material flow is asymmetrical during the friction ...The material flow in friction stir welded 2014 Al alloy has been investigated using a marker insert technique (MIT). Results of the flow visualization show that the material flow is asymmetrical during the friction stir welding (FSW) process and there are also significant differences in the flow patterns observed on advancing side and retreating side. On advancing side, some material transport forward and some move backward, but on retreating side, material only transport backward. At the top surface of the weld, significant material transport forward due to the action of the rotating tool shoulder. Combining the data from all the markers, a three-dituensional flow visualization, similar to the 3D image reconstruction technique, was obtained. The three-dimensional plot gives the tendency chart of material flow in friction stir welding process and from the plot it can be seen that there is a vertical, circular motion around the longitudinal axis of the weld. On the advancing side of the weld, the material is pushed downward but on the retreating side, the material is pushed toward the crown of the weld. The net result of the two relative motions in both side of the advancing and the retreating is that a circular motion comes into being. Comparatively, the material flow around the longitudinal axis is a secondary motion.展开更多
Crystal shape distribution, i.e. the multidimensional size distribution of crystals, is of great importance to their down-stream processing such as in filtration as well as to the end-use properties including the diss...Crystal shape distribution, i.e. the multidimensional size distribution of crystals, is of great importance to their down-stream processing such as in filtration as well as to the end-use properties including the dissolution rate and bioavailability for crystalline pharmaceuticals. Engineering crystal shape and shape distribution requires knowledge about the growth behavior of different crystal facets under varied operational conditions e.g. supersaturations. Measurement of the facet growth rates and growth kinetics of static crystals in a crystallizer without stirring has been reported previously. Here attention is given to study on real-time characterization of the 3D facet growth behavior of crystals in a stirred tank where crystals are constantly moving and rotating. The measurement technique is stereo imaging and the crystal shape reconstruction is based on a stereo imaging camera model. By reference to a case study on potash alum crystallization, it is demonstrated that the crystal size and shape distributions (CSSD) of moving and rotating potash alum crystals in the solution can be reconstructed. The moving window approach was used to correlate 3D face growth kinetics with supersaturation (in the range 0.04 - 0.12) given by an ATR FTIR probe. It revealed that {100} is the fastest growing face, leading to a rapid reduction of its area, while the {111} face has the slowest growth rate, reflected in its area continuously getting larger.展开更多
基金supported by the National Natural Science Foundation of China(Grant No.91948303)。
文摘Remote sensing images carry crucial ground information,often involving the spatial distribution and spatiotemporal changes of surface elements.To safeguard this sensitive data,image encryption technology is essential.In this paper,a novel Fibonacci sine exponential map is designed,the hyperchaotic performance of which is particularly suitable for image encryption algorithms.An encryption algorithm tailored for handling the multi-band attributes of remote sensing images is proposed.The algorithm combines a three-dimensional synchronized scrambled diffusion operation with chaos to efficiently encrypt multiple images.Moreover,the keys are processed using an elliptic curve cryptosystem,eliminating the need for an additional channel to transmit the keys,thus enhancing security.Experimental results and algorithm analysis demonstrate that the algorithm offers strong security and high efficiency,making it suitable for remote sensing image encryption tasks.
文摘This study is to compare three-dimensional(3D)isotropic T2-weighted magnetic resonance imaging(MRI)with compressed sensing-sampling perfection with application optimized contrast(CS-SPACE)and the conventional image(3D-SPACE)sequence in terms of image quality,estimated signal-to-noise ratio(SNR),relative contrast-to-noise ratio(CNR),and the lesions’conspicuous of the female pelvis.Thirty-six females(age:51,28-73)with cervical carcinoma(n=20),rectal carcinoma(n=7),or uterine fibroid(n=9)were included.Patients underwent magnetic resonance(MR)imaging at a 3T scanner with the sequences of 3D-SPACE,CS-SPACE,and twodimensional(2D)T2-weighted turbo-spin echo(TSE).Quantitative analyses of estimated SNR and relative CNR between tumors and other tissues,image quality,and tissue conspicuity were performed.Two radiologists assessed the difference in diagnostic findings for carcinoma.Quantitative values and qualitative scores were analyzed,respectively.The estimated SNR and the relative CNR of tumor-to-muscle obturator internus,tumor-to-myometrium,and myometrium-to-muscle obturator internus was comparable between 3D-SPACE and CS-SPACE.The overall image quality and the conspicuity of the lesion scores of the CS-SPACE were higher than that of the 3D-SPACE(P<0.01).The CS-SPACE sequence offers shorter scan time,fewer artifacts,and comparable SNR and CNR to conventional 3D-SPACE,and has the potential to improve the performance of T2-weighted images.
基金supported by the Feng Yun Application Pioneering Project (FY-APP-2022.0502)the National Natural Science Foundation of China (Grant No. 42205140)。
文摘Atmospheric ammonia(NH_(3)) is a chemically active trace gas that plays an important role in the atmospheric environment and climate change. Satellite remote sensing is a powerful technique to monitor NH_(3) concentration based on the absorption lines of NH_(3) in the thermal infrared region. In this study, we establish a retrieval algorithm to derive the NH_(3)column from the Hyperspectral Infrared Atmospheric Sounder(HIRAS) onboard the Chinese Feng Yun(FY)-3D satellite and present the first atmospheric NH_(3) column global map observed by the HIRAS instrument. The HIRAS observations can well capture NH_(3) hotspots around the world, e.g., India, West Africa, and East China, where large NH_(3) emissions exist. The HIRAS NH_(3) columns are also compared to the space-based Infrared Atmospheric Sounding Interferometer(IASI)measurements, and we find that the two instruments observe a consistent NH_(3) global distribution, with correlation coefficient(R) values of 0.28–0.73. Finally, some remaining issues about the HIRAS NH_(3) retrieval are discussed.
基金National Natural Science Foundation of China(No.41871305)National Key Research and Development Program of China(No.2017YFC0602204)+2 种基金Fundamental Research Funds for the Central Universities,China University of Geosciences(Wuhan)(No.CUGQY1945)Open Fund of Key Laboratory of Geological Survey and Evaluation of Ministry of Education and the Fundamental Research Funds for the Central Universities(No.GLAB2019ZR02)Open Fund of Laboratory of Urban Land Resources Monitoring and Simulation,Ministry of Natural Resources,China(No.KF-2020-05-068)。
文摘The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resolution remote sensing images,we present an effective YOLOv3 framework,corner regression-based YOLOv3(Correg-YOLOv3),to localize dense building accurately.This improved YOLOv3 algorithm establishes a vertex regression mechanism and an additional loss item about building vertex offsets relative to the center point of bounding box.By extending output dimensions,the trained model is able to output the rectangular bounding boxes and the building vertices meanwhile.Finally,we evaluate the performance of the Correg-YOLOv3 on our self-produced data set and provide a comparative analysis qualitatively and quantitatively.The experimental results achieve high performance in precision(96.45%),recall rate(95.75%),F1 score(96.10%)and average precision(98.05%),which were 2.73%,5.4%,4.1%and 4.73%higher than that of YOLOv3.Therefore,our proposed algorithm effectively tackles the problem of dense building detection in high resolution images.
基金This work was supported in part by the National Natural Science Foundation of China under Grant U20A20225,61833013in part by Shaanxi Provincial Key Research and Development Program under Grant 2022-GY111.
文摘This paper proposes an improved high-precision 3D semantic mapping method for indoor scenes using RGB-D images.The current semantic mapping algorithms suffer from low semantic annotation accuracy and insufficient real-time performance.To address these issues,we first adopt the Elastic Fusion algorithm to select key frames from indoor environment image sequences captured by the Kinect sensor and construct the indoor environment space model.Then,an indoor RGB-D image semantic segmentation network is proposed,which uses multi-scale feature fusion to quickly and accurately obtain object labeling information at the pixel level of the spatial point cloud model.Finally,Bayesian updating is used to conduct incremental semantic label fusion on the established spatial point cloud model.We also employ dense conditional random fields(CRF)to optimize the 3D semantic map model,resulting in a high-precision spatial semantic map of indoor scenes.Experimental results show that the proposed semantic mapping system can process image sequences collected by RGB-D sensors in real-time and output accurate semantic segmentation results of indoor scene images and the current local spatial semantic map.Finally,it constructs a globally consistent high-precision indoor scenes 3D semantic map.
基金supported in part by The National Key Research and Development Program of China(2018YFC2001302)the National Natural Science Foundation of China(61976209)+1 种基金CAS International Collaboration Key Project(173211KYSB20190024)Strategic Priority Research Program of CAS(XDB32040000)。
文摘Structure reconstruction of 3 D anatomy from biplanar X-ray images is a challenging topic. Traditionally, the elastic-model-based method was used to reconstruct 3 D shapes by deforming the control points on the elastic mesh. However, the reconstructed shape is not smooth because the limited control points are only distributed on the edge of the elastic mesh.Alternatively, statistical-model-based methods, which include shape-model-based and intensity-model-based methods, are introduced due to their smooth reconstruction. However, both suffer from limitations. With the shape-model-based method, only the boundary profile is considered, leading to the loss of valid intensity information. For the intensity-based-method, the computation speed is slow because it needs to calculate the intensity distribution in each iteration. To address these issues, we propose a new reconstruction method using X-ray images and a specimen’s CT data. Specifically, the CT data provides both the shape mesh and the intensity model of the vertebra. Intensity model is used to generate the deformation field from X-ray images, while the shape model is used to generate the patient specific model by applying the calculated deformation field.Experiments on the public synthetic dataset and clinical dataset show that the average reconstruction errors are 1.1 mm and1.2 mm, separately. The average reconstruction time is 3 minutes.
基金Supported by the National Natural Science Foundation of China(No.41101503)the National Social Science Foundation of China(No.11&ZD161)Graduate Innovative Scientific Research Project of Chongqing Technology and Business University(No.yjscxx2014-052-29)
文摘According to the data characteristics of Landsat thematic mapper (TM) and MODIS, a new fu sion algorithm about thermal infrared data has been proposed in the article based on improving wave let reconstruction. Under the domain of neighborhood wavelet reconstruction, data of TM and MO DIS are divided into three layers using wavelet decomposition. The texture information of TM data is retained by fusing highfrequency information. The neighborhood correction coefficient method (NC CM) is set up based on the search neighborhood of a certain size to fuse lowfrequency information. Thermal infrared value of MODIS data is reduced to the space value of TM data by applying NCCM. The data with high spectrum, high spatial and high temporal resolution, are obtained through the al gorithm in the paper. Verification results show that the texture information of TM data and high spec tral information of MODIS data could be preserved well by the fusion algorithm. This article could provide technical support for high precision and fast extraction of the surface environment parame ters.
文摘In airborne array synthetic aperture radar(SAR), the three-dimensional(3D) imaging performance and cross-track resolution depends on the length of the equivalent array. In this paper, Barker sequence criterion is used for sparse flight sampling of airborne array SAR, in order to obtain high cross-track resolution in as few times of flights as possible. Under each flight, the imaging algorithm of back projection(BP) and the data extraction method based on modified uniformly redundant arrays(MURAs) are utilized to obtain complex 3D image pairs. To solve the side-lobe noise in images, the interferometry between each image pair is implemented, and compressed sensing(CS) reconstruction is adopted in the frequency domain. Furthermore, to restore the geometrical relationship between each flight, the phase information corresponding to negative MURA is compensated on each single-pass image reconstructed by CS. Finally,by coherent accumulation of each complex image, the high resolution in cross-track direction is obtained. Simulations and experiments in X-band verify the availability.
文摘A novel technique of three-dimensional (3D) reconstruction, segmentation, display and analysis of series slices of images including microscopic wide field optical sectioning by deconvolution method, cryo-electron microscope slices by Fou-rier-Bessel synthesis and electron tomography (ET), and a series of computed tomography (CT) was developed to perform si-multaneous measurement on the structure and function of biomedical samples. The paper presents the 3D reconstruction seg-mentation display and analysis results of pollen spore, chaperonin, virus, head, cervical bone, tibia and carpus. At the same time, it also puts forward some potential applications of the new technique in the biomedical realm.
基金funded by National Key R&D Program of China(No.2021YFB3401200)the National Natural Science Foundation of China(No.51875308)the Beijing Nature Sciences Fund-Haidian Originality Cooperation Project(L212002).
文摘Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different computing tools have to be developed so as to solve particular fields at different scales and for different processes.Therefore,the integration of different types of software is inevitable.However,it is difficult to perform the transfer of the meshes and simulated results among software packages because of the lack of shared data formats or encrypted data formats.An image processing based method for three-dimensional model reconstruction for numerical simulation was proposed,which presents a solution to the integration problem by a series of slice or projection images obtained by the post-processing modules of the numerical simulation software.By means of mapping image pixels to meshes of either finite difference or finite element models,the geometry contour can be extracted to export the stereolithography model.The values of results,represented by color,can be deduced and assigned to the meshes.All the models with data can be directly or indirectly integrated into other software as a continued or new numerical simulation.The three-dimensional reconstruction method has been validated in numerical simulation of castings and case studies were provided in this study.
基金supported in part by the National Natural Science Foundation of China under Grant 61902311in part by the Japan Society for the Promotion of Science(JSPS)Grants-in-Aid for Scientific Research(KAKENHI)under Grant JP18K18044.
文摘With increasingly more smart cameras deployed in infrastructure and commercial buildings,3D reconstruction can quickly obtain cities’information and improve the efficiency of government services.Images collected in outdoor hazy environments are prone to color distortion and low contrast;thus,the desired visual effect cannot be achieved and the difficulty of target detection is increased.Artificial intelligence(AI)solutions provide great help for dehazy images,which can automatically identify patterns or monitor the environment.Therefore,we propose a 3D reconstruction method of dehazed images for smart cities based on deep learning.First,we propose a fine transmission image deep convolutional regression network(FT-DCRN)dehazing algorithm that uses fine transmission image and atmospheric light value to compute dehazed image.The DCRN is used to obtain the coarse transmission image,which can not only expand the receptive field of the network but also retain the features to maintain the nonlinearity of the overall network.The fine transmission image is obtained by refining the coarse transmission image using a guided filter.The atmospheric light value is estimated according to the position and brightness of the pixels in the original hazy image.Second,we use the dehazed images generated by the FT-DCRN dehazing algorithm for 3D reconstruction.An advanced relaxed iterative fine matching based on the structure from motion(ARI-SFM)algorithm is proposed.The ARISFM algorithm,which obtains the fine matching corner pairs and reduces the number of iterations,establishes an accurate one-to-one matching corner relationship.The experimental results show that our FT-DCRN dehazing algorithm improves the accuracy compared to other representative algorithms.In addition,the ARI-SFM algorithm guarantees the precision and improves the efficiency.
基金National Natural Science Foundation of China(No.61771123)。
文摘The three-dimensional(3D)model is of great significance to analyze the performance of nonwovens.However,the existing modelling methods could not reconstruct the 3D structure of nonwovens at low cost.A new method based on deep learning was proposed to reconstruct 3D models of nonwovens from multi-focus images.A convolutional neural network was trained to extract clear fibers from sequence images.Image processing algorithms were used to obtain the radius,the central axis,and depth information of fibers from the extraction results.Based on this information,3D models were built in 3D space.Furthermore,self-developed algorithms optimized the central axis and depth of fibers,which made fibers more realistic and continuous.The method with lower cost could reconstruct 3D models of nonwovens conveniently.
基金Supported by the Key R&D Projects in Shaanxi Province(2022JBGS3-08)。
文摘Rapidly and accurately assessing the geometric characteristics of coarse aggregate particles is crucial for ensuring pavement performance in highway engineering.This article introduces an innovative system for the three-dimensional(3D)surface reconstruction of coarse aggregate particles using occlusion-free multi-view imaging.The system captures synchronized images of particles in free fall,employing a matte sphere and a nonlinear optimization approach to estimate the camera projection matrices.A pre-trained segmentation model is utilized to eliminate the background of the images.The Shape from Silhouettes(SfS)algorithm is then applied to generate 3D voxel data,followed by the Marching Cubes algorithm to construct the 3D surface contour.Validation against standard parts and diverse coarse aggregate particles confirms the method's high accuracy,with an average measurement precision of 0.434 mm and a significant increase in scanning and reconstruction efficiency.
基金funded by the Deutsche Forschungsgemein-schaft(DFG,German Research Foundation)-SFB 986-Project number 192346071.
文摘FIB-SEM tomography is a powerful technique that integrates a focused ion beam(FIB)and a scanning electron microscope(SEM)to capture high-resolution imaging data of nanostructures.This approach involves collecting in-plane SEM imagesand using FIB to remove material layers for imaging subsequent planes,thereby producing image stacks.However,theseimage stacks in FIB-SEM tomography are subject to the shine-through effect,which makes structures visible from theposterior regions of the current plane.This artifact introduces an ambiguity between image intensity and structures in thecurrent plane,making conventional segmentation methods such as thresholding or the k-means algorithm insufficient.Inthis study,we propose a multimodal machine learning approach that combines intensity information obtained at differentelectron beam accelerating voltages to improve the three-dimensional(3D)reconstruction of nanostructures.By treatingthe increased shine-through effect at higher accelerating voltages as a form of additional information,the proposed methodsignificantly improves segmentation accuracy and leads to more precise 3D reconstructions for real FIB tomography data.
基金Supported by National Natural Science Foundation of China(No.61272286)
文摘Abstract:reconstruction method using slice im-ages is proposed. Wanting to extract the outermost contours from slice images, the method of the improved GVF-Snake model with optimized force field and ray method is employed. And then, the 3D model is reconstructed by contour connection using the im-proved shortest diagonal method and judgment function of contour fracture. The results show that the accuracy of reconstruction 3D model is improved.
文摘It is an active research area to reconstruct 3-D object and display its visible surfacesfrom cross-sectional images. In this paper, the methods of reconstructing 3-D object from medicalCT images and displaying the visible surfaces are discussed. A polygon approximation methodthat forms polygon with the same number of segment points and a fast interpolation method forcross-sectional contours are presented at first. Then the voxel set of a human liver is reconstructed.And then the liver voxel set is displayed using depth and gradient shading methods. The softwareis written in C programming language at a microcomputer image processing system with a PC/ATcomputer as the host and a PC-VISION board as the image processing unit. The result of theprocessing is satisfying.
文摘Unmanned aerial vehicle(UAV)array InSAR is a new type of single-flight 3D SAR imaging system with the advantages of high coherence and resolution.However,due to the low altitude of the platform,the elevation ambiguity of the system is smaller than the maximal terrain elevation.Since the spatial phase unwrapping is conducted based on the assumption of phase continuity,the inappropriate ambiguity will cause significant unwrapping errors.In this work,a 3D phase unwrapping algorithm assisted by image segmentation is proposed to address this issue.The Markov random field(MRF)is utilized for image segmentation.The optimal spatial phase unwrapping network is achieved based on the segmentation results.The asymptotic 3D phase unwrapping is adopted to get the refined 3D reconstruction.Results based on the real airborne array-InSAR data show that the proposed method effectively improves the elevation ambiguity.
基金the foundation of National Natural Science Foundation of China(No.52376163)National Key Laboratory of Science and Technology on Aerodynamic Design and Research(No.614220121050327).
文摘The development of deep learning has inspired some new methods to solve the 3D reconstruction problem for Tomographic Particle Image Velocimetry (Tomo-PIV). However, the supervised learning method requires a large number of data with ground truth as training information, which is very difficult to gather from experiments. Although synthetic datasets can be used as alternatives, they are still not exactly the same with the real-world experimental data. In this paper, an Unsupervised Reconstruction Technique based on U-net (UnRTU) is proposed to reconstruct volume particle distribution explicitly. Instead of using ground truth data, a projection function is used as an unsupervised loss function for network training to reconstruct particle distribution. The UnRTU was compared with some traditional algebraic reconstruction algorithms and supervised learning method using synthetic data under different particle density and noise level. The results indicate that UnRTU outperforms these traditional approaches in both reconstruction quality and noise robustness, and is comparable to the supervised learning methods AI-PR. For experimental tests, particles dispersed in cured epoxy resin are moved by an electric rail with a certain speed to obtain the ground truth data of particle velocity. Compared with other algorithms, the reconstructed particle distribution by UnRTU has the best reconstruction fidelity. And the accuracy of the 3D velocity field estimated by UnRTU is 12.9% higher than that from the traditional MLOS-MART algorithm. It demonstrates significant potential and advantages for UnRTU in 3D reconstruction of particle distribution. Finally, UnRTU was successfully applied to the high-speed planar cascade airflow field, demonstrating its applicability for measuring complex fluid flow fields at higher particle density.
文摘The material flow in friction stir welded 2014 Al alloy has been investigated using a marker insert technique (MIT). Results of the flow visualization show that the material flow is asymmetrical during the friction stir welding (FSW) process and there are also significant differences in the flow patterns observed on advancing side and retreating side. On advancing side, some material transport forward and some move backward, but on retreating side, material only transport backward. At the top surface of the weld, significant material transport forward due to the action of the rotating tool shoulder. Combining the data from all the markers, a three-dituensional flow visualization, similar to the 3D image reconstruction technique, was obtained. The three-dimensional plot gives the tendency chart of material flow in friction stir welding process and from the plot it can be seen that there is a vertical, circular motion around the longitudinal axis of the weld. On the advancing side of the weld, the material is pushed downward but on the retreating side, the material is pushed toward the crown of the weld. The net result of the two relative motions in both side of the advancing and the retreating is that a circular motion comes into being. Comparatively, the material flow around the longitudinal axis is a secondary motion.
文摘Crystal shape distribution, i.e. the multidimensional size distribution of crystals, is of great importance to their down-stream processing such as in filtration as well as to the end-use properties including the dissolution rate and bioavailability for crystalline pharmaceuticals. Engineering crystal shape and shape distribution requires knowledge about the growth behavior of different crystal facets under varied operational conditions e.g. supersaturations. Measurement of the facet growth rates and growth kinetics of static crystals in a crystallizer without stirring has been reported previously. Here attention is given to study on real-time characterization of the 3D facet growth behavior of crystals in a stirred tank where crystals are constantly moving and rotating. The measurement technique is stereo imaging and the crystal shape reconstruction is based on a stereo imaging camera model. By reference to a case study on potash alum crystallization, it is demonstrated that the crystal size and shape distributions (CSSD) of moving and rotating potash alum crystals in the solution can be reconstructed. The moving window approach was used to correlate 3D face growth kinetics with supersaturation (in the range 0.04 - 0.12) given by an ATR FTIR probe. It revealed that {100} is the fastest growing face, leading to a rapid reduction of its area, while the {111} face has the slowest growth rate, reflected in its area continuously getting larger.