The increasing popularity of the metaverse has led to a growing interest and market size in spatial computing from both academia and industry.Developing portable and accurate imaging and depth sensing systems is cruci...The increasing popularity of the metaverse has led to a growing interest and market size in spatial computing from both academia and industry.Developing portable and accurate imaging and depth sensing systems is crucial for advancing next-generation virtual reality devices.This work demonstrates an intelligent,lightweight,and compact edge-enhanced depth perception system that utilizes a binocular meta-lens for spatial computing.The miniaturized system comprises a binocular meta-lens,a 532 nm filter,and a CMOS sensor.For disparity computation,we propose a stereo-matching neural network with a novel H-Module.The H-Module incorporates an attention mechanism into the Siamese network.The symmetric architecture,with cross-pixel interaction and cross-view interaction,enables a more comprehensive analysis of contextual information in stereo images.Based on spatial intensity discontinuity,the edge enhancement eliminates illposed regions in the image where ambiguous depth predictions may occur due to a lack of texture.With the assistance of deep learning,our edge-enhanced system provides prompt responses in less than 0.15 seconds.This edge-enhanced depth perception meta-lens imaging system will significantly contribute to accurate 3D scene modeling,machine vision,autonomous driving,and robotics development.展开更多
Meta-lens are a new type of planar optical element that can flexibly manipulate the phase, polarization and amplitude of the beam, and are currently receiving a great deal of attention as they are easier to process an...Meta-lens are a new type of planar optical element that can flexibly manipulate the phase, polarization and amplitude of the beam, and are currently receiving a great deal of attention as they are easier to process and manufacture. Off-axis meta-lens are a special type of meta-lens with a certain degree of dispersion that can be used as a beam-splitting element, providing a unique and feasible way to realize micro-miniature instruments. We analyze the effects of different numerical apertures and off-axis angles on the spectral resolution, focusing efficiency and simulation results of off-axis meta-lens to provide ideas for subsequent research and application of off-axis meta-lens. A number of off-axis meta-lens with parameters NA = 0.408 α = 13°, NA = 0.18 α = 13°<sup></sup> and NA = 0.408 α = 20° were simulated through Lumerical software. The results show that the off-axis angle is related to the resolution;the larger the angle, the better the spectral resolution but the lower the focusing efficiency;when the numerical aperture is smaller, the smaller the coverage of the phase distribution, which will lead to a larger deviation between simulation and theory. The designer needs to balance the numerical aperture, off-axis angle and other parameters reasonably according to the requirements in order to achieve the desired effect. The findings of this study have important reference values for the theoretical analysis of off-axis meta-lens and the design of parameters in practical applications. .展开更多
基金supports from the Research Grants Council of the Hong Kong Special Administrative Region,China[Project No.C5031-22GCityU11310522+3 种基金CityU11300123]the Department of Science and Technology of Guangdong Province[Project No.2020B1515120073]City University of Hong Kong[Project No.9610628]JST CREST(Grant No.JPMJCR1904).
文摘The increasing popularity of the metaverse has led to a growing interest and market size in spatial computing from both academia and industry.Developing portable and accurate imaging and depth sensing systems is crucial for advancing next-generation virtual reality devices.This work demonstrates an intelligent,lightweight,and compact edge-enhanced depth perception system that utilizes a binocular meta-lens for spatial computing.The miniaturized system comprises a binocular meta-lens,a 532 nm filter,and a CMOS sensor.For disparity computation,we propose a stereo-matching neural network with a novel H-Module.The H-Module incorporates an attention mechanism into the Siamese network.The symmetric architecture,with cross-pixel interaction and cross-view interaction,enables a more comprehensive analysis of contextual information in stereo images.Based on spatial intensity discontinuity,the edge enhancement eliminates illposed regions in the image where ambiguous depth predictions may occur due to a lack of texture.With the assistance of deep learning,our edge-enhanced system provides prompt responses in less than 0.15 seconds.This edge-enhanced depth perception meta-lens imaging system will significantly contribute to accurate 3D scene modeling,machine vision,autonomous driving,and robotics development.
文摘Meta-lens are a new type of planar optical element that can flexibly manipulate the phase, polarization and amplitude of the beam, and are currently receiving a great deal of attention as they are easier to process and manufacture. Off-axis meta-lens are a special type of meta-lens with a certain degree of dispersion that can be used as a beam-splitting element, providing a unique and feasible way to realize micro-miniature instruments. We analyze the effects of different numerical apertures and off-axis angles on the spectral resolution, focusing efficiency and simulation results of off-axis meta-lens to provide ideas for subsequent research and application of off-axis meta-lens. A number of off-axis meta-lens with parameters NA = 0.408 α = 13°, NA = 0.18 α = 13°<sup></sup> and NA = 0.408 α = 20° were simulated through Lumerical software. The results show that the off-axis angle is related to the resolution;the larger the angle, the better the spectral resolution but the lower the focusing efficiency;when the numerical aperture is smaller, the smaller the coverage of the phase distribution, which will lead to a larger deviation between simulation and theory. The designer needs to balance the numerical aperture, off-axis angle and other parameters reasonably according to the requirements in order to achieve the desired effect. The findings of this study have important reference values for the theoretical analysis of off-axis meta-lens and the design of parameters in practical applications. .
