Automatic three-dimensional reconstruction based on four-view stereo vision using checkerboard pattern

An automatic three-dimensional(3D) reconstruction method based on four-view stereo vision using checkerboard pattern is presented. Mismatches easily exist in traditional binocular stereo matching due to the repeatable or similar features of binocular images. In order to reduce the probability of mismatching and improve the measure precision, a four-camera measurement system which can add extra matching constraints and offer multiple measurements is applied in this work. Moreover, a series of different checkerboard patterns are projected onto the object to obtain dense feature points and remove mismatched points. Finally, the 3D model is generated by performing Delaunay triangulation and texture mapping on the point cloud obtained by four-view matching. This method was tested on the 3D reconstruction of a terracotta soldier sculpture and the Buddhas in the Mogao Grottoes. Their point clouds without mismatched points were obtained and less processing time was consumed in most cases relative to binocular matching. These good reconstructed models show the effectiveness of the method.

Disagreement in middle ear volume estimation between tympanometry and three-dimensional volume reconstruction in the context of tympanic membrane perforation

Introduction: Middle ear volume(MEV) is a clinically relevant parameter across middle ear diseases. MEV values between these techniques have never before been tested for agreement in ears with perforated tympanic membranes(TMs).Methods: Middle ears were identified from 36 patients ranging 18-89 years of age with TM perforations who underwent tympanometry and temporal bone computed tomography(CT) between 2005 and 2015. MEVs calculated by both tympanometry and three-dimensional volume reconstruction(3DVR) were analyzed for agreement using Bland Altman plots. The differences between tympanometric and 3DVR MEV values for each given middle ear were characterized across MEV quartiles(1= smallest; 4= largest) and across increasing states of middle ear disease using Kruskale Wallis and Wilcoxon testing with Bonferroni correction.Results: Bland Altman plots demonstrated significant disagreement between MEV measurement techniques. Differences between tympanometric(T) and 3DVR MEV values were significantly greater with increasing average(i.e.(Tt3DVR)/2)) MEV per linear regression(p < 0.0001). Significance was demonstrated between fourth and first average MEV quartiles(p= 0.0024), fourth and second quartiles(p= 0.0024), third and first quartiles(p= 0.0048), and third and second quartiles(p= 0.048). Absolute MEV difference was not significantly different across varying states of middle ear disease(p= 0.44).Conclusion: Statistically and clinically significant disagreement was demonstrated between tympanometric and 3DVR MEV values. Studies that vary in MEV estimation techniques may be expected to demonstrate significantly different results. These preliminary results suggest that clinicians should endeavor to seek further confirmation when interpreting high tympanometric MEV values.

Science Letters:Dynamic concision for three-dimensional reconstruction of human organ built with virtual reality modelling language (VRML)

This research studies the process of 3D reconstruction and dynamic concision based on 2D medical digital images using virtual reality modelling language (VRML) and JavaScript language, with a focus on how to realize the dynamic concision of 3D medical model with script node and sensor node in VRML. The 3D reconstruction and concision of body internal organs can be built with such high quality that they are better than those obtained from the traditional methods. With the function of dynamic concision, the VRML browser can offer better windows for man-computer interaction in real-time environment than ever before. 3D reconstruction and dynamic concision with VRML can be used to meet the requirement for the medical observation of 3D reconstruction and have a promising prospect in the fields of medical imaging.

Three-dimensional positions of scattering centers reconstruction from multiple SAR images based on radargrammetry

A method and procedure is presented to reconstruct three-dimensional(3D) positions of scattering centers from multiple synthetic aperture radar(SAR) images. Firstly, two-dimensional(2D) attribute scattering centers of targets are extracted from 2D SAR images. Secondly, similarity measure is developed based on 2D attributed scatter centers' location, type, and radargrammetry principle between multiple SAR images. By this similarity, we can associate 2D scatter centers and then obtain candidate 3D scattering centers. Thirdly, these candidate scattering centers are clustered in 3D space to reconstruct final 3D positions. Compared with presented methods, the proposed method has a capability of describing distributed scattering center, reduces false and missing 3D scattering centers, and has fewer restrictionson modeling data. Finally, results of experiments have demonstrated the effectiveness of the proposed method.

Micro-computerized Three-dimensional Reconstruction of the Palmar Arteries and Its Clinical Significance

Thirty adult upper extremities were used to study the arteries of the hand byangiography,cross-sectional dissection and three-dimensional reconstruction withmicrocomputer.The arterial skeleton of the palm was composed of superficial,deep anddorsal planes.There were three main anastomotic pathways between the radial and ulnararteries or their branches in the radio-ulnar direction,while in the palmar dorsal dirce-tion there were three anastomotic zones between the palrnar and dorsal arterial plancs.The branches of the deep palmar arch radiated distally,proximally,palmarly anddorsally,so that the arch acted as the center of the arterial network of the hand.Thetransverse arterial allocations in the carpo-metacarpal segment of the palm were four intypes,but in the mid-palmar and metacarpo-phalangcal segments were three only.Accord-ing to the sources,cross-sectional area,irrigation territories and anastomoses of the ar-teries in each segment,the clinical significance in the rcplantation of the amputatcd palmshas been

Three-dimensional reconstruction of human spinal cord based on histological serial sections

BACKGROUND： It is not possible to reconstruct the inner structure of the spinal cord, such as gray matter and spinal tracts, from the Visual Human Project database or CT and MRI databases, due to low image resolution and contrast in macrosection images. OBJECTIVE： To explore a semi-automatic computerized three-dimensional （3D） reconstruction of human spinal cord based on histological serial sections, in order to solve issues such as low contrast. DESIGN, TIME AND SETTING： An experimental study combining serial section techniques and 3D reconstruction, performed in the laboratory of Human Anatomy and Histoembryology at the Medical School of Nantong University during January to April 2008. SETTING： Department of Anatomy, Institute of Neurobiology, Jiangsu Province Key Laboratory of Neural Regeneration, Laboratory of Image Engineering. MATERIALS： A human lumbar spinal cord segment from fresh autopsy material of an adult male. METHODS： After 4% paraformaldehyde fixation for three days, serial sections of the lumbar spinal cord were cut on a Leica cryostat and mounted on slides in sequence, with eight sections aligned separately on each slide. All sections were stained with Luxol Fast Blue to reveal myelin sheaths. After gradient dehydration and clearing, the stained slides were coverslipped. Sections were observed and images recorded under a light microscope using a digital camera. Six images were acquired at x25 magnification and automatically stitched into a complete section image. After all serial images were obtained, 96 complete serial images of the human lumbar cord segment were automatically processed with ＂Curves＂, ＂Autocontrast＂, ＂Gray scale 8 bit＂, ＂Invert＂, ＂Image resize to 50%＂ steps using Photoshop 7.0 software. All images were added in order into 3D-DOCTOR 4.0 software as a stack, where serial images were automatically realigned with neighboring images and semi-automatically segmented for white matter and gray matter. Finally, simple surface and volume reconstruction were completed on a personal computer. The reconstructed human lumbar spinal cord segment was interactively observed, cut, and measured. MAIN OUTCOME MEASURES： The reconstructed human lumbar spinal cord segment. RESULTS： Compared with serial images obtained from other image modalities, such as CT, MRI, and macrosections from The Visual Human Project database, the Luxol Fast Blue stained histological serial section images exhibited higher resolution and contrast between gray and white matter. Image processing and 3D reconstruction steps were semi-automatically performed with related software. The 3D reconstructed human lumbar cord segment were observed, cut, and measured on a PC. CONCLUSION： A semi-automatically computerized method, based on histological serial sections, is an effective way to 3D-reconstruct the human spinal cord.

Study on Multi-density Contrast Agent Fillers of Duct Casting Based on CT Three-Dimensional Reconstruction

The three-dimensional visualization model of human body duct is based on virtual anatomical structure reconstruction with duct angiography,which realizes virtual model transferred from two-dimensional,planar and static images into three-dimensional,stereoscopic and dynamic ones repectively.In recent years,the multi-duct segmentation and division of the same specimen（or organ） is the focus of attention shared by surgeons and clinical anatomists.On the basis of 4.22 g/cm3 body bone density,this study has screened out metal oxide contract agent with different density for infusion and modeling,as well as compared and analyzed the effects of three-dimensional image of CT virtual bronchoscopy（CTVB）,three-dimensional image of CT maximum intensity projection and three-dimensional model.This experiment result showed synchronously infusing multi-duct of same specimen（or organ） with contrast agent in different densities could reconstruct three-dimensional models of all ducts once only and adjust threshold to develop single or multiple ducts.It was easier to segment and observe the duct structure,anastomosis,directions and crossing in different parts,which was beyond comparison with three-dimensional image of CTVB.Although the existing three-dimensional duct reconstruction techniques still cannot be applied in living bodies temporarily,this study focused on a creative design of ducts segmentation in different density,which proposed a new experimental idea for developing multi-duct three-dimensional model in living body in the future.It will play a significant role in disease diagnosis and individual design in surgical treatment program.Therefore,this study observes the three-dimensional status of human duct with the application of contrast agent fillers in different density,combined with three-dimensional reconstruction technology.It provides an innovative idea and method for constructing three-dimensional model of digital multi-duct specimen,and the ultimate goal is to develop the digitized virtual human and precise medical treatment better and faster.

Research and Realization of Medical Image Fusion Based on Three-Dimensional Reconstruction

A new medical image fusion technique is presented.The method is based on three-dimensional reconstruction.After reconstruction,the three-dimensional volume data is normalized by three-dimensional coordinate conversion in the same way and intercepted through setting up cutting plane including anatomical structure,as a result two images in entire registration on space and geometry are obtained and the images are fused at last.Compared with traditional two-dimensional fusion technique,three-dimensional fusion technique can not only resolve the different problems existed in the two kinds of images,but also avoid the registration error of the two kinds of images when they have different scan and imaging parameter.The research proves this fusion technique is more exact and has no registration,so it is more adapt to arbitrary medical image fusion with different equipments.

A rapid micro-magnetic resonance imaging scanning for three-dimensional reconstruction of peripheral nerve fascicles

The most common methods for three-dimensional reconstruction of peripheral nerve fascicles include histological and radiology techniques. Histological techniques have many drawbacks including an enormous manual workload and poor image registration. Micro-magnetic resonance imaging（Micro-MRI）, an emerging radiology technique, has been used to report results in the brain, liver and tumor tissues. However, micro-MRI usage for obtaining intraneural structures has not been reported. The aim of this study was to present a new imaging method for three-dimensional reconstruction of peripheral nerve fascicles by ~1T micro-MRI. Freshly harvested sciatic nerve samples from an amputated limb were divided into four groups. Two different scanning conditions（Mannerist Solution/GD-DTPA contrast agent, distilled water） were selected, and both T1 and T2 phases programmed for each scanning condition. Three clinical surgeons evaluated the quality of the images via a standardized scale. Moreover, to analyze deformation of the two-dimensional image, the nerve diameter and total area of the micro-MRI images were compared after hematoxylin-eosin staining. The results show that rapid micro-MRI imaging method can be used for three-dimensional reconstruction of the fascicle structure. Nerve sample immersed in contrast agent（Mannerist Solution/GD-DTPA） and scanned in the T1 phase was the best. Moreover, the nerve sample was scanned freshly and can be recycled for other procedures. MRI images show better stability and smaller deformation compared with histological images. In conclusion, micro-MRI provides a feasible and rapid method for three-dimensional reconstruction of peripheral nerve fascicles, which can clearly show the internal structure of the peripheral nerve.

A method for phase reconstruction in optical three-dimensional shape measurement

In optical three-dimensional shape measurement, a method of improving the measurement precision for phase reconstruction without phase unwrapping is analyzed in detail. Intensities of any five consecutive pixels that lie in the x-axis direction of the phase domain are given. Partial derivatives of the phase function in the x- and y-axis directions are obtained with a phase-shifting mechanism, the origin of which is analysed. Furthermore, to avoid phase unwrapping in the phase reconstruction, we derive the gradient of the phase function and perform a two-dimensional integral along the x- and y-axis directions. The reconstructed phase can be obtained directly by performing numerical integration, and thus it is of great convenience for phase reconstruction. Finally, the results of numerical simulations and practical experiments verify the correctness of the proposed method.

Digitizing the Undigitized: Converting Traditional Archaeological Records into Computerized, Three-Dimensional Site Reconstruction

Archaeological excavation involves disintegration, removal, and reassembly of the archaeological record;as such it is considered by many to be an unrepeatable, destructive activity. This perception has contributed to an advancement in archaeological practice, namely, the development of computerized recording systems that digitally record archaeological excavations spatially and volumetrically during fieldwork. This paper is concerned with those archaeological sites where digital field recording has not been done. These sites, recorded by traditional methods, should not be excluded from attempts to restructure the spatial, volumetric, and stratigraphic archaeological data. A thorough methodology for the conversion of traditional records into digitized data is presented, including the detailed procedures required for three-dimensional plotting of recorded data—both the excavated material and the drawn site maps and cross-sections. Finally, the use of these methods is demonstrated on a complex Early to Middle Pleistocene site, illustrating the benefits of digitization and three-dimensional reconstruction in resolving stratigraphic and spatial questions.

Seismic data reconstruction based on low dimensional manifold model

Seismic data reconstruction is an essential and yet fundamental step in seismic data processing workflow,which is of profound significance to improve migration imaging quality,multiple suppression effect,and seismic inversion accuracy.Regularization methods play a central role in solving the underdetermined inverse problem of seismic data reconstruction.In this paper,a novel regularization approach is proposed,the low dimensional manifold model(LDMM),for reconstructing the missing seismic data.Our work relies on the fact that seismic patches always occupy a low dimensional manifold.Specifically,we exploit the dimension of the seismic patches manifold as a regularization term in the reconstruction problem,and reconstruct the missing seismic data by enforcing low dimensionality on this manifold.The crucial procedure of the proposed method is to solve the dimension of the patches manifold.Toward this,we adopt an efficient dimensionality calculation method based on low-rank approximation,which provides a reliable safeguard to enforce the constraints in the reconstruction process.Numerical experiments performed on synthetic and field seismic data demonstrate that,compared with the curvelet-based sparsity-promoting L1-norm minimization method and the multichannel singular spectrum analysis method,the proposed method obtains state-of-the-art reconstruction results.

Study on Three Dimensional Reconstruction of Transesophageal Echocardiographic Images

Using biplane transesophageal echocardiography and the concept of three dimensional transthoracic echocardiography,we performed three dimensional reconstruction of transesophageal images of various clinicopathologic cases,including atrial septal defect,mitral stenosis,mitral valve prolapse and pulmonary stenosis.The hardware equipments and image processing flow chart of three dimensional reconstruction of transesophageal echocardiographic images are described. Our present study indicates that three dimensional reconstruction of transesophageal echocardiographic images could display multi-regional three dimensional structures of heart and great vessels,including superior vena cava,ascending aorta,right ventricular outflow tract, pulmonary artery and left heart,with clear,visual and stereoscopic imaging.The regional structures could be displayed at different levels of stereo-anatomic-sec-tions and in different orientations of rotating stereo-images,which could provide accurate three dimensional anatomical information for cardiac stereo-morphological study and definition of spatial location and size of cardiac abnormalities.

Three-dimensional reconstructed magnetic resonance scans:Accuracy in identifying and defining knee meniscal tears

AIM To determine whether three-dimensional(3D) reconstruction from conventional magnetic resonance imaging(MRI) is able to accurately detect a meniscal tear, and define the configuration.METHODS Thirty-three patients' 3T MRI scan data were collected and sagittal uni-planar 3D reconstructions performed from the preoperative MRI. There were 24 meniscal tears in 24 patients, and nine controls. All patients had arthroscopic corroboration of MRI findings. Two independent observers prospectively reported on all 33 reconstructions. Meniscal tear presence or absence was noted, and tear configuration subsequently categorised as either radial, bucket-handle, parrot beak, horizontal or complex.RESULTS Identification of control menisci or meniscal tear presence was excellent(Accuracy: observer 1 = 90.9%; observer 2 = 81.8%). Of the tear configurations, bucket handle tears were accurately identified(Accuracy observer 1 and 2 = 80%). The remaining tear configurations were notaccurately discernable.CONCLUSION Uni-planar 3D reconstruction from 3T MRI knee scan sequences are useful in identifying normal menisci and menisci with bucket-handle tears. Advances in MRI sequencing and reconstruction software are awaited for accurate identification of the remaining meniscal tear configurations.

3-Dimensional Irradiance Imaging with a Single Camera System

本文提出了用一个摄像机重建三维发光体辐射场分布的方法．连续的三维发光体可以看成若干个互相平行的二维发光断层的组合，对发光体某断层进行聚焦摄像，得到的图像是该断层的高斯像和其他断层的离焦像的叠加像．对不同断层分别聚焦摄像，得到一组辐射图像，对图像进行变换、处理，采用图像反演算法，可以重建各断层的辐射场．本文用实验装置模拟了具有两断层的三维发光体，获得了初步结果，证明了该理论的正确性．

基于RGB-D双目视觉的苗期玉米三维模型重构方法研究

以玉米幼苗为对象,研究基于RGB-D双目视觉的苗期玉米三维模型重构方法,实现了部分重构参数的优化。首先,针对目标进行固定步距角环绕图像采集,依据RGB图像中目标区域分割结果,对深度图像进行目标区域深度数据分割,并采用改进后的均值滤波对苗期玉米区域内深度数据孔洞进行自适应填充;其次,针对苗期玉米各角度的深度点云数据,采用先粗后精完成多角度点云配准与融合;最后,对比两种体素精简方法对点云的精简平滑效果,实现苗期玉米三维模型的重构。通过试验对比步距角对苗期玉米模型的重构效率与精度,结果表明:采用八叉树滤波精简效果较好,60°步距角建模误差最小,重构的模型与苗期玉米株高精度误差为4.4 mm,茎粗平均精度误差为0.62 mm,能满足苗期玉米的三维重构形态测量需求。

3D-DSA与Dyna-CT在颅内支架置入术中的临床应用研究

目的探讨三维DSA血管成像(3D-DSA)及数字平板造影机的C臂旋转并断层重建技术(DynaCT)在颅内支架置入术患者中的临床应用。方法选择2019年1月-2020年6月厦门大学附属中山医院收治92例颅内动脉狭窄患者,所有患者均行颅内支架置入术治疗,分为对照组(n=38例)和观察组(n=54例)。对照组采用3D-DSA引导,观察组采用DynaCT引导,术后进行12个月门诊随访,比较两组改良Rankin量表(mRS)评分、手术成功率、并发症、支架再狭窄及斑块检出率。结果观察组术后4个月、8个月及12个月mRS评分、支架成形术耗时低于对照组(P<0.05);观察组Dyna-CT的术前规划、观察到支架表面图像与术中所见吻合,手术成功率为83.33%,高于对照组63.16%(P<0.05);两组围术期并发症发生率无统计意义(P>0.05);观察组手术后进行12个月门诊随访,患者支架再狭窄、血管狭窄部位斑块检出率低于对照组(P<0.05)。结论DynaCT用于颅内支架置入术中能改善患者症状,缩短支架成形术耗时,有助于提高手术成功率,未增加并发症发生率,能降低血管狭窄部位斑块检出率,值得推广应用。

全耳内镜下耳屏软骨-软骨膜复合体在上鼓室外侧壁重建中的临床应用

目的探究全耳内镜下耳屏软骨-软骨膜复合体在上鼓室外侧壁重建中的临床应用。方法选取2020年6月~2023年6月间徐州市中心医院收治的58例进行上鼓室外侧壁重建的胆脂瘤患者,根据采用修复材料的不同分为对照组及观察组各29例。对照组采用耳屏软骨膜进行上鼓室外侧壁重建,观察组采用耳屏软骨-软骨膜复合体进行上鼓室外侧壁重建,两组患者均于全耳内镜下进行手术。统计患者术中出血量、手术时间,术后3个月复查听力情况、干耳情况及耳道功能改善情况,术后随访6个月鼓膜愈合情况。结果与术前比较,术后3个月气导听阈、气骨导差降低(P<0.05),与对照组比较,观察组气导听阈、气骨导差降低(P<0.05);与对照组比较,观察组干耳率、耳道功能良好率、听力提高成功率均升高,干耳时间缩短,但耳屏愈合时间增加(P<0.05);与对照组比较,观察组手术时间缩短,术中出血量减少(P<0.05);观察组、对照组术后并发症总发生率分别为13.79%、24.14%,二者比较差异无统计学意义(P>0.05);观察组愈合良好率高于对照组(86.21%vs.62.07%)(P<0.05),两组患者耳膜穿孔(10.34%vs.24.14%)、鼓膜移位(3.45%vs.6.90%)及鼓膜回缩(0.00%vs.6.90%)发生情况比较,差异无统计学意义(P>0.05)。结论全耳内镜下耳屏软骨-软骨膜复合体在上鼓室外侧壁重建中有利于改善患者听力,有利于术后恢复。

分时相低对比剂注射方案在颅内动脉瘤三维-数字减影血管造影成像的应用

目的 探讨分时相低剂量低流率对比剂注射方案在颅内动脉瘤三维(three-dimensional,3D)-数字减影血管造影(digital subtraction angiography,DSA)成像的临床应用价值。方法 前瞻性连续收集经计算机断层扫描血管成像(CTA)/磁共振血管造影(MRA)检查疑似或确诊颅内动脉瘤患者共69例,按照交替序贯将患者分实验组35例,常规组34例,统计分析两组患者动脉瘤成像评分、旋转造影辐射剂量及栓塞效果。结果 实验组与常规组三维重建成像对颅内动脉瘤的细节显示比较,差异无统计学意义(P=0.633)。两组间患者辐射剂量空气比释动能(air kerma,AK)、剂量-面积乘积(dose-area product,DAP)比较,差异均无统计学意义(P=0.176,P=0.765)。两组患者间栓塞效果比较,差异无统计学意义(P=0.111)。实验组患者行3D-DSA使用对比剂剂量显著少于常规组,差异有统计学意义[(9.29±0.86)mL vs.(18.00±0.00)mL,P<0.01]。结论 分时相低对比剂注射方案在颅内动脉瘤患者3D-DSA成像安全有效,应用该方案能显著减少患者的对比剂使用剂量。