The increasing popularity of the metaverse has led to a growing interest and market size in spatial computing from both academia and industry.Developing portable and accurate imaging and depth sensing systems is cruci...The increasing popularity of the metaverse has led to a growing interest and market size in spatial computing from both academia and industry.Developing portable and accurate imaging and depth sensing systems is crucial for advancing next-generation virtual reality devices.This work demonstrates an intelligent,lightweight,and compact edge-enhanced depth perception system that utilizes a binocular meta-lens for spatial computing.The miniaturized system comprises a binocular meta-lens,a 532 nm filter,and a CMOS sensor.For disparity computation,we propose a stereo-matching neural network with a novel H-Module.The H-Module incorporates an attention mechanism into the Siamese network.The symmetric architecture,with cross-pixel interaction and cross-view interaction,enables a more comprehensive analysis of contextual information in stereo images.Based on spatial intensity discontinuity,the edge enhancement eliminates illposed regions in the image where ambiguous depth predictions may occur due to a lack of texture.With the assistance of deep learning,our edge-enhanced system provides prompt responses in less than 0.15 seconds.This edge-enhanced depth perception meta-lens imaging system will significantly contribute to accurate 3D scene modeling,machine vision,autonomous driving,and robotics development.展开更多
BACKGROUND: Certain neural functions, such as peripheral reflexes, differ between genders, while higher brain functions, such as language, are asymmetrically distributed between the two hemispheres. The question rema...BACKGROUND: Certain neural functions, such as peripheral reflexes, differ between genders, while higher brain functions, such as language, are asymmetrically distributed between the two hemispheres. The question remains as to whether depth perception differs between hemispheric laterality and genders, and whether it is affected by eye dominance. OBJECTIVE: To determine whether depth perception is influenced by factors such as gender, eye dominance, and hemispheric lateralization by recording evoked potential associated with depth perception. DESIGN, TIME AND SETTING: A contrast observation based on neuroelectrophysiology was performed at the Department of Biophysics of Ege University Medical School between June 2006 and April 2007. PARTICIPANTS: A total of 34 subjects, 19 females and 15 males, were included in the study with a mean age of (31.0 ± 6.9) years. All subjects were free of neurological or psychological disorders, or problems such as strabismus or vision correction. METHODS: Random-dot stereograms were used to elicit brain activity. A specially designed signal acquisition system employing two computers was used to record evoked potentials from both hemispheres via two pairs of scalp electrodes placed over the occipitotemporal areas of both hemispheres at symmetrical locations. MAIN OUTCOME MEASURES: Negative potential with a mean latency of (211.21 ±25.55) ms and a mean amplitude of (6.05 ± 1.53) pV was recorded from both occipitotemporal areas in 30 out of 34 participants. This was termed "Nd" and represented the evoked potential associated with depth perception. RESULTS: There were no significant differences in Nd amplitude or latency between the two hemispheres, the two eyes, or genders (P 〉 0.05). CONCLUSION: The evoked potential associated with depth perception was not influenced by gender, hemisphere, or eye dominance.展开更多
Depth perception for night vision (NV) imagery could largely improve scene comprehension. We present a novel scheme to give fused multi-band NV imagery smoothly natural color appearance as well as depth sense from c...Depth perception for night vision (NV) imagery could largely improve scene comprehension. We present a novel scheme to give fused multi-band NV imagery smoothly natural color appearance as well as depth sense from color. Our approach is based on simulating color cues by varying saturation values of each object in the color NV image, in correspondence with the ratio between the infrared and low-light-level sensor outputs which in practice is the depth feature for same materials. We render the NV image segment- by-segment by taking advantage image fusion. Experiments have of image segmentation, dominant shown that the proposed scheme color transfer, saturation variation, and can achieve satisfying results.展开更多
Objectives: The study aimed to compare stereopsis, aniseikonia, and associated symptoms in bilateral pseudophakia with and without anisometropia. Methods: Patients with senile cataracts, previously scheduled for phaco...Objectives: The study aimed to compare stereopsis, aniseikonia, and associated symptoms in bilateral pseudophakia with and without anisometropia. Methods: Patients with senile cataracts, previously scheduled for phacoemulsification with an IOL implant in both eyes were included in this cross-sectional study. Patients were divided into two groups: control group (n = 69) with an interocular post-surgical refraction difference in Spherical Equivalent (SE) <sup>?</sup>;Stereotest. Ten symptoms related to aniseikonia were evaluated with a questionnaire. Statistical evaluation of data included models of univariate, multivariate, and regression analyses. Results: Cataract surgery-induced aniseikonia was 0.64% ± 1.41% in control group and 0.62% ± 1.76% in anisometropia group with an insignificant difference (p = 0.766). Measured stereoacuity was 1.95 ± 0.17 log10 seconds of arc in the control group and 2.12 ± 0.22 log10 seconds of arc in the anisometropia group with a significant difference (p Conclusions: The study showed that stereopsis, aniseikonia, and associated symptoms did not stand for a substantial problem for visual comfort of bilateral pseu- dophakia with anisometropia less than 3D.展开更多
Objective: The current study aimed to assess the association between the type of anisometropia and its effects on monocular and binocular best-corrected vision acuity (BCVA), aniseikonia, and stereopsis in the absence...Objective: The current study aimed to assess the association between the type of anisometropia and its effects on monocular and binocular best-corrected vision acuity (BCVA), aniseikonia, and stereopsis in the absence of strabismus. Methods: In total, 162 individuals with anisometropia and healthy eyes and without a previous history of amblyopia therapy and eye surgery were included in the analysis. According to spherical and cylindrical components and spherical equivalent, they were divided into the spherical hyperopic anisometropia (SHA, n = 31), spherical myopic anisometropia (SMA, n = 45), astigmatic or cylindrical hyperopic anisometropia (CHA, n = 22), and astigmatic or cylindrical myopic anisometropia (CMA, n = 64) groups. Patients without anisometropia (NA, n = 188) were classified under the control group. The effects of anisometropia on monocular and binocular BCVA, aniseikonia, and stereoacuity were examined. Results: The NA group had a significantly lower LogMAR of BCVA of the right eye (RE), left eye (LE), worse eye than the SHA, SMA, CMA, and CHA groups. Moreover, the SMA group had significantly lower LogMAR of BCVA than the CHA group (p Conclusion: Worse visual levels of the RE, LE, worse eye, BCVA difference, and lower stereopsis were evidenced in each type of anisometropia defined in this study. Cylindrical hyperopic anisometropia (CHA) resulted in a statically significant worsening VA level and stereopsis than cylindrical myopic (CMA) or spherical myopic anisometropia.展开更多
Background:The human visual system can use binocular disparity to make depth judgements.Previous studies looking at the normal population have found a wide range in ability to perform depth-polarity tasks.We explored ...Background:The human visual system can use binocular disparity to make depth judgements.Previous studies looking at the normal population have found a wide range in ability to perform depth-polarity tasks.We explored if these large individual differences are also present when using a depth increment paradigm,and if they depend on the sign of disparity.Methods:Stereoacuity for detecting a wedge-shaped surface in a field of dots was measured in 53 adults(28 males)with normal vision.To better understand the variance in stereoacuity in the sample,for 18 subjects we measured stereo cuity with disparity noise added to the stimulus.Stereoacuity was unaffected at low levels of stimulus noise but beyond a critical value,it increased with the standard deviation of the noise.At this point the stimulus noise is equivalent to the internal noise of the subject.Stereoacuity measured at high stimulus noise levels reflects the efficiency with which a noisy input is processed by the visual system.We derived both parameters by fitting the linear amplifier model.Results:Stereoacuity ranged from 24 to 275 arc seconds.We found population differences in stereoacuity were explained by variation in both processing efficiency and internal noise levels.There was a tendency for higher task performance for crossed disparities compared to uncrossed disparities.Within subject sensitivity differences between crossed and uncrossed disparity were due to a higher efficiency when processing one direction.There was a trend for subjects with equal acuity for the two directions to have an increase in processing efficiency compensating for higher internal noise levels for that direction.Conclusions:Overall,our results show that the individual differences in stereoacuity for depth increment tasks can be attributed to variances in both the quality of the received input and the efficiency of processing of disparity-processing mechanisms.展开更多
Accommodation and convergence play critical roles in the natural process of depth perception, and the field of natural three-dimensional (3D) perception in stereo displays has been extensively explored. However, no ...Accommodation and convergence play critical roles in the natural process of depth perception, and the field of natural three-dimensional (3D) perception in stereo displays has been extensively explored. However, no prototypes of these natural 3D displays are suitable for wear due to the system size and weight. In addition, few of the researches have involved subjects with ametropia. We propose and develop an optical see-through head-mounted display (HMD) capable of diopter adjustment of both the virtual image and the real world scene. The prototype demonstrates a diagonal field of view (NOV) of 42° and an exit pupil diameter of 9 mnl, and a diopter adjustment range of -5.5D to 0D. Depth adjustment of virtual image is demonstrated with experiments, the results show the HMD can be further used to investigate the accommodation and convergence cues in depth perception in AR environment, particularly for users with different degree of the ametropia.展开更多
Background The operating microscopes have been applied to modern surgery for nearly a century.However,generations of microsurgeons have to flex their necks and fix their eyes on the eyepieces of a microscope continual...Background The operating microscopes have been applied to modern surgery for nearly a century.However,generations of microsurgeons have to flex their necks and fix their eyes on the eyepieces of a microscope continually that leads to physical and mental fatigue during a long operation.Stereoscopic three-dimensional (3D) media provides more ergonomic working environment,subsequently,resulting better performance in tasks and more accurate judgment.In this study,an alternative method of magnification was analyzed using a three-dimensional microsurgical video system and compared with the traditional method under microscopy to evaluate the availability and feasibility of a 3D microsurgical video system for microvascular anastomosis.Methods Forty Sprague-Dawley rats were randomly divided into four groups with each of 10.In 20 rats,10 femoral artery anastomoses with a conventional microscope (arterial microscope group) were compared with that of 10 femoral artery anastomoses with a 3D microsurgical video system (arterial 3D group).For the other 20 rats,10 femoral vein anastomoses using a conventional microscope (venous microscope group) were compared with that of 10 femoral vein anastomoses using a 3D microsurgical video system (venous 3D group).The arterial and venous microscope groups were considered to be the control groups.The arterial and venous 3D groups were the experimental groups.The examined criteria were as follows:anastomotic time,patency right after the procedure and 10 days later,number of sutures,vessel caliber,and pathological features.Results There were no differences between the operating equipment with respect to vessel caliber,anastomotic time,patency rate,number of sutures,and pathological changes in either the small arteries or veins.The average arterial anastomotic time of the arterial microscope group and arterial 3D group was 34.21 and 33.87 minutes,respectively (P >0.05).The average venous anastomotic time of the venous microscope group and venous 3D group was 29.95 and 31.50 minutes,respectively (P >0.05).Conclusions A small vessel anastomosis can be performed successfully with the help of a 3D display system.Although the vascular anastomotic time did not demonstrate a significant difference between the groups,the 3D microsurgical video system offers another option to improve the working environment for surgeons.Further development of our 3D monitoring system should focus on a higher resolution and better flexibility.展开更多
Brain-specific loss of a microtubule-binding protein collapsin response mediator protein-2(CRMP2)in the mouse recapitulates many schizophrenia-like behaviors of human patients,possibly resulting from associated develo...Brain-specific loss of a microtubule-binding protein collapsin response mediator protein-2(CRMP2)in the mouse recapitulates many schizophrenia-like behaviors of human patients,possibly resulting from associated developmental deficits in neuronal differentiation,path-finding,and synapse formation.However,it is still unclear how the Crmp2 loss affects neuronal circuit function and plasticity.By conducting in vivo and ex vivo electrophysiological recording in the mouse primary visual cortex(V1),we reveal that CRMP2 exerts a key regulation on the timing of postnatal critical period(CP)for experience-dependent circuit plasticity of sensory cortex.In the developing V1,the Crmp2 deficiency induces not only a delayed maturation of visual tuning functions but also a precocious CP for visual input-induced ocular dominance plasticity and its induction activity–coincident binocular inputs right after eye-opening.Mechanistically,the Crmp2 deficiency accelerates the maturation process of cortical inhibitory transmission and subsequently promotes an early emergence of balanced excitatory-inhibitory cortical circuits during the postnatal development.Moreover,the precocious CP plasticity results in deteriorated binocular depth perception in adulthood.Thus,these findings suggest that the Crmp2 deficiency dysregulates the timing of CP for experience-dependent refinement of circuit connections and further leads to impaired sensory perception in later life.展开更多
基金supports from the Research Grants Council of the Hong Kong Special Administrative Region,China[Project No.C5031-22GCityU11310522+3 种基金CityU11300123]the Department of Science and Technology of Guangdong Province[Project No.2020B1515120073]City University of Hong Kong[Project No.9610628]JST CREST(Grant No.JPMJCR1904).
文摘The increasing popularity of the metaverse has led to a growing interest and market size in spatial computing from both academia and industry.Developing portable and accurate imaging and depth sensing systems is crucial for advancing next-generation virtual reality devices.This work demonstrates an intelligent,lightweight,and compact edge-enhanced depth perception system that utilizes a binocular meta-lens for spatial computing.The miniaturized system comprises a binocular meta-lens,a 532 nm filter,and a CMOS sensor.For disparity computation,we propose a stereo-matching neural network with a novel H-Module.The H-Module incorporates an attention mechanism into the Siamese network.The symmetric architecture,with cross-pixel interaction and cross-view interaction,enables a more comprehensive analysis of contextual information in stereo images.Based on spatial intensity discontinuity,the edge enhancement eliminates illposed regions in the image where ambiguous depth predictions may occur due to a lack of texture.With the assistance of deep learning,our edge-enhanced system provides prompt responses in less than 0.15 seconds.This edge-enhanced depth perception meta-lens imaging system will significantly contribute to accurate 3D scene modeling,machine vision,autonomous driving,and robotics development.
文摘BACKGROUND: Certain neural functions, such as peripheral reflexes, differ between genders, while higher brain functions, such as language, are asymmetrically distributed between the two hemispheres. The question remains as to whether depth perception differs between hemispheric laterality and genders, and whether it is affected by eye dominance. OBJECTIVE: To determine whether depth perception is influenced by factors such as gender, eye dominance, and hemispheric lateralization by recording evoked potential associated with depth perception. DESIGN, TIME AND SETTING: A contrast observation based on neuroelectrophysiology was performed at the Department of Biophysics of Ege University Medical School between June 2006 and April 2007. PARTICIPANTS: A total of 34 subjects, 19 females and 15 males, were included in the study with a mean age of (31.0 ± 6.9) years. All subjects were free of neurological or psychological disorders, or problems such as strabismus or vision correction. METHODS: Random-dot stereograms were used to elicit brain activity. A specially designed signal acquisition system employing two computers was used to record evoked potentials from both hemispheres via two pairs of scalp electrodes placed over the occipitotemporal areas of both hemispheres at symmetrical locations. MAIN OUTCOME MEASURES: Negative potential with a mean latency of (211.21 ±25.55) ms and a mean amplitude of (6.05 ± 1.53) pV was recorded from both occipitotemporal areas in 30 out of 34 participants. This was termed "Nd" and represented the evoked potential associated with depth perception. RESULTS: There were no significant differences in Nd amplitude or latency between the two hemispheres, the two eyes, or genders (P 〉 0.05). CONCLUSION: The evoked potential associated with depth perception was not influenced by gender, hemisphere, or eye dominance.
基金supported by the National Natural Science Foundation of China(No.60502042)the Shanghai Rising-Star Program(No.06QA14003)
文摘Depth perception for night vision (NV) imagery could largely improve scene comprehension. We present a novel scheme to give fused multi-band NV imagery smoothly natural color appearance as well as depth sense from color. Our approach is based on simulating color cues by varying saturation values of each object in the color NV image, in correspondence with the ratio between the infrared and low-light-level sensor outputs which in practice is the depth feature for same materials. We render the NV image segment- by-segment by taking advantage image fusion. Experiments have of image segmentation, dominant shown that the proposed scheme color transfer, saturation variation, and can achieve satisfying results.
文摘Objectives: The study aimed to compare stereopsis, aniseikonia, and associated symptoms in bilateral pseudophakia with and without anisometropia. Methods: Patients with senile cataracts, previously scheduled for phacoemulsification with an IOL implant in both eyes were included in this cross-sectional study. Patients were divided into two groups: control group (n = 69) with an interocular post-surgical refraction difference in Spherical Equivalent (SE) <sup>?</sup>;Stereotest. Ten symptoms related to aniseikonia were evaluated with a questionnaire. Statistical evaluation of data included models of univariate, multivariate, and regression analyses. Results: Cataract surgery-induced aniseikonia was 0.64% ± 1.41% in control group and 0.62% ± 1.76% in anisometropia group with an insignificant difference (p = 0.766). Measured stereoacuity was 1.95 ± 0.17 log10 seconds of arc in the control group and 2.12 ± 0.22 log10 seconds of arc in the anisometropia group with a significant difference (p Conclusions: The study showed that stereopsis, aniseikonia, and associated symptoms did not stand for a substantial problem for visual comfort of bilateral pseu- dophakia with anisometropia less than 3D.
文摘Objective: The current study aimed to assess the association between the type of anisometropia and its effects on monocular and binocular best-corrected vision acuity (BCVA), aniseikonia, and stereopsis in the absence of strabismus. Methods: In total, 162 individuals with anisometropia and healthy eyes and without a previous history of amblyopia therapy and eye surgery were included in the analysis. According to spherical and cylindrical components and spherical equivalent, they were divided into the spherical hyperopic anisometropia (SHA, n = 31), spherical myopic anisometropia (SMA, n = 45), astigmatic or cylindrical hyperopic anisometropia (CHA, n = 22), and astigmatic or cylindrical myopic anisometropia (CMA, n = 64) groups. Patients without anisometropia (NA, n = 188) were classified under the control group. The effects of anisometropia on monocular and binocular BCVA, aniseikonia, and stereoacuity were examined. Results: The NA group had a significantly lower LogMAR of BCVA of the right eye (RE), left eye (LE), worse eye than the SHA, SMA, CMA, and CHA groups. Moreover, the SMA group had significantly lower LogMAR of BCVA than the CHA group (p Conclusion: Worse visual levels of the RE, LE, worse eye, BCVA difference, and lower stereopsis were evidenced in each type of anisometropia defined in this study. Cylindrical hyperopic anisometropia (CHA) resulted in a statically significant worsening VA level and stereopsis than cylindrical myopic (CMA) or spherical myopic anisometropia.
文摘Background:The human visual system can use binocular disparity to make depth judgements.Previous studies looking at the normal population have found a wide range in ability to perform depth-polarity tasks.We explored if these large individual differences are also present when using a depth increment paradigm,and if they depend on the sign of disparity.Methods:Stereoacuity for detecting a wedge-shaped surface in a field of dots was measured in 53 adults(28 males)with normal vision.To better understand the variance in stereoacuity in the sample,for 18 subjects we measured stereo cuity with disparity noise added to the stimulus.Stereoacuity was unaffected at low levels of stimulus noise but beyond a critical value,it increased with the standard deviation of the noise.At this point the stimulus noise is equivalent to the internal noise of the subject.Stereoacuity measured at high stimulus noise levels reflects the efficiency with which a noisy input is processed by the visual system.We derived both parameters by fitting the linear amplifier model.Results:Stereoacuity ranged from 24 to 275 arc seconds.We found population differences in stereoacuity were explained by variation in both processing efficiency and internal noise levels.There was a tendency for higher task performance for crossed disparities compared to uncrossed disparities.Within subject sensitivity differences between crossed and uncrossed disparity were due to a higher efficiency when processing one direction.There was a trend for subjects with equal acuity for the two directions to have an increase in processing efficiency compensating for higher internal noise levels for that direction.Conclusions:Overall,our results show that the individual differences in stereoacuity for depth increment tasks can be attributed to variances in both the quality of the received input and the efficiency of processing of disparity-processing mechanisms.
基金supported by the National Basic Research Program of China(973,No.2011CB706701)the National Science Foundation of China(NSFC,Nos.61205024 and 61178038)+1 种基金National High Technology Research and Development Program of China(863,No.2013AA013901)New Century Excellent Talents in University 2012(No.NCET-12-0043)
文摘Accommodation and convergence play critical roles in the natural process of depth perception, and the field of natural three-dimensional (3D) perception in stereo displays has been extensively explored. However, no prototypes of these natural 3D displays are suitable for wear due to the system size and weight. In addition, few of the researches have involved subjects with ametropia. We propose and develop an optical see-through head-mounted display (HMD) capable of diopter adjustment of both the virtual image and the real world scene. The prototype demonstrates a diagonal field of view (NOV) of 42° and an exit pupil diameter of 9 mnl, and a diopter adjustment range of -5.5D to 0D. Depth adjustment of virtual image is demonstrated with experiments, the results show the HMD can be further used to investigate the accommodation and convergence cues in depth perception in AR environment, particularly for users with different degree of the ametropia.
文摘Background The operating microscopes have been applied to modern surgery for nearly a century.However,generations of microsurgeons have to flex their necks and fix their eyes on the eyepieces of a microscope continually that leads to physical and mental fatigue during a long operation.Stereoscopic three-dimensional (3D) media provides more ergonomic working environment,subsequently,resulting better performance in tasks and more accurate judgment.In this study,an alternative method of magnification was analyzed using a three-dimensional microsurgical video system and compared with the traditional method under microscopy to evaluate the availability and feasibility of a 3D microsurgical video system for microvascular anastomosis.Methods Forty Sprague-Dawley rats were randomly divided into four groups with each of 10.In 20 rats,10 femoral artery anastomoses with a conventional microscope (arterial microscope group) were compared with that of 10 femoral artery anastomoses with a 3D microsurgical video system (arterial 3D group).For the other 20 rats,10 femoral vein anastomoses using a conventional microscope (venous microscope group) were compared with that of 10 femoral vein anastomoses using a 3D microsurgical video system (venous 3D group).The arterial and venous microscope groups were considered to be the control groups.The arterial and venous 3D groups were the experimental groups.The examined criteria were as follows:anastomotic time,patency right after the procedure and 10 days later,number of sutures,vessel caliber,and pathological features.Results There were no differences between the operating equipment with respect to vessel caliber,anastomotic time,patency rate,number of sutures,and pathological changes in either the small arteries or veins.The average arterial anastomotic time of the arterial microscope group and arterial 3D group was 34.21 and 33.87 minutes,respectively (P >0.05).The average venous anastomotic time of the venous microscope group and venous 3D group was 29.95 and 31.50 minutes,respectively (P >0.05).Conclusions A small vessel anastomosis can be performed successfully with the help of a 3D display system.Although the vascular anastomotic time did not demonstrate a significant difference between the groups,the 3D microsurgical video system offers another option to improve the working environment for surgeons.Further development of our 3D monitoring system should focus on a higher resolution and better flexibility.
基金the National Natural Science Foundation of China(32071025,31921002,and 31730108)the Beijing Municipal Science&Technology Commission(Z181100001518001)+1 种基金the Interdisciplinary Research Fund of Beijing Normal Universitythe Strategic Priority Research Program and Innovation Program of the Chinese Academy of Sciences(XDB32020100)。
文摘Brain-specific loss of a microtubule-binding protein collapsin response mediator protein-2(CRMP2)in the mouse recapitulates many schizophrenia-like behaviors of human patients,possibly resulting from associated developmental deficits in neuronal differentiation,path-finding,and synapse formation.However,it is still unclear how the Crmp2 loss affects neuronal circuit function and plasticity.By conducting in vivo and ex vivo electrophysiological recording in the mouse primary visual cortex(V1),we reveal that CRMP2 exerts a key regulation on the timing of postnatal critical period(CP)for experience-dependent circuit plasticity of sensory cortex.In the developing V1,the Crmp2 deficiency induces not only a delayed maturation of visual tuning functions but also a precocious CP for visual input-induced ocular dominance plasticity and its induction activity–coincident binocular inputs right after eye-opening.Mechanistically,the Crmp2 deficiency accelerates the maturation process of cortical inhibitory transmission and subsequently promotes an early emergence of balanced excitatory-inhibitory cortical circuits during the postnatal development.Moreover,the precocious CP plasticity results in deteriorated binocular depth perception in adulthood.Thus,these findings suggest that the Crmp2 deficiency dysregulates the timing of CP for experience-dependent refinement of circuit connections and further leads to impaired sensory perception in later life.