目前,ToF(Time of Flight)三维成像技术在人脸检测、3D目标识别、三维重建等视觉任务领域具有广阔的应用前景。然而,用ToF相机所获得的深度信息往往存在与像素、温度、深度畸变、多径干扰以及背景光相关的噪声干扰。现有的ToF优化算法...目前,ToF(Time of Flight)三维成像技术在人脸检测、3D目标识别、三维重建等视觉任务领域具有广阔的应用前景。然而,用ToF相机所获得的深度信息往往存在与像素、温度、深度畸变、多径干扰以及背景光相关的噪声干扰。现有的ToF优化算法耗时较大且很难保留目标的细节信息,这些问题严重影响了ToF相机的实际应用。针对以上问题,本文提出一种实时的基于振幅图的ToF深度图优化方法。首先通过ToF接收端采集的原始数据生成带有噪声的振幅图像。针对振幅图中的噪声,选用快速高效的双边网格滤波对振幅图进行去噪。然后,利用优化后的振幅图生成掩码以分割出深度图中前景和背景区域。同时,对深度图中的噪声以及误差像素用滤波的方式优化,最后将优化后的深度图和掩码融合生成最终的深度图。实验结果表明,本文所提算法可以实时有效地滤除深度图噪声,去除背景噪声的干扰,同时能很好地保留深度图中目标对象的细节信息。有助于ToF相机拥有更广泛的应用场景。展开更多
The Lunar Environment heliospheric X-ray Imager(LEXI)and Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)missions will image the Earth’s dayside magneto pause and cusps in soft X-rays after their respective l...The Lunar Environment heliospheric X-ray Imager(LEXI)and Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)missions will image the Earth’s dayside magneto pause and cusps in soft X-rays after their respective launches in the near future,to specify glo bal magnetic reconnection modes for varying solar wind conditions.To suppo rt the success of these scientific missions,it is critical to develop techniques that extract the magnetopause locations from the observed soft X-ray images.In this research,we introduce a new geometric equation that calculates the subsolar magnetopause position(RS)from a satellite position,the look direction of the instrument,and the angle at which the X-ray emission is maximized.Two assumptions are used in this method:(1)The look direction where soft X-ray emissions are maximized lies tangent to the magnetopause,and(2)the magnetopause surface near the subsolar point is almost spherical and thus RSis nea rly equal to the radius of the magneto pause curvature.We create synthetic soft X-ray images by using the Open Geospace General Circulation Model(OpenGGCM)global magnetohydrodynamic model,the galactic background,the instrument point spread function,and Poisson noise.We then apply the fast Fourier transform and Gaussian low-pass filte rs to the synthetic images to re move noise and obtain accurate look angles for the soft X-ray pea ks.From the filte red images,we calculate RS and its accuracy for different LEXI locations,look directions,and solar wind densities by using the OpenGGCM subsolar magnetopause location as ground truth.Our method estimates RS with an accuracy of<0.3 RE when the solar wind density exceeds>10 cm-3.The accuracy improves for greater solar wind densities and during southward interplanetary magnetic fields.The method ca ptures the magnetopause motion during southwa rd interplaneta ry magnetic field turnings.Consequently,the technique will enable quantitative analysis of the magnetopause motion and help reveal the dayside reconnection modes for dynamic solar wind conditions.This technique will suppo rt the LEXI and SMILE missions in achieving their scientific o bjectives.展开更多
文摘目前,ToF(Time of Flight)三维成像技术在人脸检测、3D目标识别、三维重建等视觉任务领域具有广阔的应用前景。然而,用ToF相机所获得的深度信息往往存在与像素、温度、深度畸变、多径干扰以及背景光相关的噪声干扰。现有的ToF优化算法耗时较大且很难保留目标的细节信息,这些问题严重影响了ToF相机的实际应用。针对以上问题,本文提出一种实时的基于振幅图的ToF深度图优化方法。首先通过ToF接收端采集的原始数据生成带有噪声的振幅图像。针对振幅图中的噪声,选用快速高效的双边网格滤波对振幅图进行去噪。然后,利用优化后的振幅图生成掩码以分割出深度图中前景和背景区域。同时,对深度图中的噪声以及误差像素用滤波的方式优化,最后将优化后的深度图和掩码融合生成最终的深度图。实验结果表明,本文所提算法可以实时有效地滤除深度图噪声,去除背景噪声的干扰,同时能很好地保留深度图中目标对象的细节信息。有助于ToF相机拥有更广泛的应用场景。
基金supported by NASA(Grant Nos.80NSSC19K0844,80NSSC20K1670,80MSFC20C0019,and 80GSFC21M0002)support from NASA Goddard Space Flight Center internal funding programs(HIF,Internal Scientist Funding Model,and Internal Research and Development)。
文摘The Lunar Environment heliospheric X-ray Imager(LEXI)and Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)missions will image the Earth’s dayside magneto pause and cusps in soft X-rays after their respective launches in the near future,to specify glo bal magnetic reconnection modes for varying solar wind conditions.To suppo rt the success of these scientific missions,it is critical to develop techniques that extract the magnetopause locations from the observed soft X-ray images.In this research,we introduce a new geometric equation that calculates the subsolar magnetopause position(RS)from a satellite position,the look direction of the instrument,and the angle at which the X-ray emission is maximized.Two assumptions are used in this method:(1)The look direction where soft X-ray emissions are maximized lies tangent to the magnetopause,and(2)the magnetopause surface near the subsolar point is almost spherical and thus RSis nea rly equal to the radius of the magneto pause curvature.We create synthetic soft X-ray images by using the Open Geospace General Circulation Model(OpenGGCM)global magnetohydrodynamic model,the galactic background,the instrument point spread function,and Poisson noise.We then apply the fast Fourier transform and Gaussian low-pass filte rs to the synthetic images to re move noise and obtain accurate look angles for the soft X-ray pea ks.From the filte red images,we calculate RS and its accuracy for different LEXI locations,look directions,and solar wind densities by using the OpenGGCM subsolar magnetopause location as ground truth.Our method estimates RS with an accuracy of<0.3 RE when the solar wind density exceeds>10 cm-3.The accuracy improves for greater solar wind densities and during southward interplanetary magnetic fields.The method ca ptures the magnetopause motion during southwa rd interplaneta ry magnetic field turnings.Consequently,the technique will enable quantitative analysis of the magnetopause motion and help reveal the dayside reconnection modes for dynamic solar wind conditions.This technique will suppo rt the LEXI and SMILE missions in achieving their scientific o bjectives.