基于深度学习复杂环境的偏振成像技术研究进展(特邀)

Research progress on polarimetric imaging technology in complex environments based on deep learning(invited)

偏振成像技术通过偏振信息的获取和解译,可以有效抑制复杂环境干扰,提升成像质量,增强目标感知能力,对于复杂环境下的光学成像探测具有独特优势。然而,在散射、低照度等复杂环境下,偏振图像退化机理呈现非线性特征,偏振信息解译方法复杂度高。深度学习方法具有强大的特征提取和学习能力,通过学习大规模数据隐藏的映射规律获得偏振信息的复原效果,特别适合偏振成像这种多维度、相互关联的复杂信号处理问题。文中基于偏振成像的基本原理以及复杂环境偏振成像技术的范式,针对散射和噪声这两类典型的成像环境,介绍了深度学习偏振成像技术的研究进展,同时阐述了深度学习赋能复杂环境偏振成像任务的优势,最后对该领域的未来发展方向作以展望。

Significance Polarization information,as one of the fundamental physical characteristics of light waves,can provide information about the intrinsic properties of the target.Polarimetric imaging technology digitizes the polarization information of the measured target field through digital processing.This approach effectively reduces the interference from the light propagation environment,thereby improving the imaging quality of the target and enhancing perception of its characteristics.In complex environments,polarimetric imaging has significant advantages.However,in complex environments such as scattering and low illumination,the degradation mechanism of polarized images exhibits nonlinear characteristics,leading to high complexity in polarized information interpretation methods.Deep learning methods possess powerful feature extraction and learning capabilities,enabling the recovery of polarized information by learning the mapping rules hidden in the largescale collected data.This approach is particularly suitable for complex signal processing problems like polarimetric imaging,which involves multiple dimensions and interrelated signals.Progress First,the basic theory of the polarimetric imaging is introduced,including the principles of polarimetric imaging and a macroscopic description of polarimetric imaging issues in complex environments.Next,the general workflow of deep learning polarization imaging technology in complex environments is introduced.Based on deep learning,polarimetric imaging technology in complex environments uses the multidimensional polarimetric parameters collected by the polarimetric imaging system as input data.It leverages the nonlinear feature-fitting capabilities of neural networks to obtain image restoration results.Essentially,this approach transforms the nonlinear inverse problem of polarimetric imaging restoration in complex environments into a pseudo-forward problem,avoiding the challenges associated with solving nonlinear inverse problem algorithms.The representative developments of research in deep learning polarimetric imaging technology in response to scattering and noise,two of the most representative complex imaging environments,have been elaborated.From the inception of research in this field,the developmental trajectory of the field has been systematically outlined.In the early stages,polarimetric imaging technology in complex environments based on deep learning primarily relied on supervised training.Due to the challenges in collecting real-world data,researchers explored solutions using unsupervised,self-supervised,transfer learning,and simulation algorithms.Researchers also delved into the incorporation of prior knowledge and physical models into networks,leading to training approaches embedded with physical models or guided by prior knowledge.Overall,these representative works have made significant contributions to addressing the difficulties in constructing large-scale datasets,enhancing the generalization performance of networks,and exploring the interpretability of the networks.To better illustrate the connections and distinctions among research works,and to streamline the developmental process in this field for reader convenience,a summary has been compiled in the form of a table.The table provides task types,training methods,and characteristics of representative works for easy reference.Conclusions and Prospects With the rapid development of deep learning,polarimetric imaging technology in complex environments has achieved remarkable research progress.Existing studies indicate that,due to the multiple parameters and inherent correlations in polarized information,this multi-dimensional and interrelated signal processing problem is well-suited for the application of deep learning.The combination of deep learning and polarimetric imaging technology enables further improvement in optical imaging quality,meeting the imaging demands of complex environments and demonstrating more prominent advantages.The generalization ability,interpretability,and parameter lightweighting of deep learning technology remain areas that require further in-depth research.There is a continued need for refinement in multimodal fusion strategies,exploration of the underlying principles of network polarimetric parameter image restoration,and the design of network structures tailored for polarized multidimensional data to enhance real-time performance.Further efforts are essential to consolidate the feasibility of deep learning models in polarimetric imaging within complex environments,to enhance the adaptability of models to changes in complex environmental conditions,and to make them more universally applicable across different scenarios.