Artificial hawk-eye camera for foveated, tetrachromatic, and dynamic vision

With the rapid development of drones and autonomous vehicles, miniaturized and lightweight vision sensors that can track targets are of great interests. Limited by the flat structure, conventional image sensors apply a large number of lenses to achieve corresponding functions, increasing the overall volume and weight of the system.

Hawk‐eye‐inspired perception algorithm of stereo vision for obtaining orchard 3D point cloud navigation map

The binocular stereo vision is the lowest cost sensor for obtaining 3D information.Considering the weakness of long‐distance measurement and stability,the improvement of accuracy and stability of stereo vision is urgently required for application of precision agriculture.To address the challenges of stereo vision long‐distance measurement and stable perception without hardware upgrade,inspired by hawk eyes,higher resolution perception and the adaptive HDR(High Dynamic Range)were introduced in this paper.Simulating the function from physiological structure of‘deep fovea’and‘shallow fovea’of hawk eye,the higher resolution reconstruction method in this paper was aimed at ac-curacy improving.Inspired by adjustment of pupils,the adaptive HDR method was proposed for high dynamic range optimisation and stable perception.In various light conditions,compared with default stereo vision,the accuracy of proposed algorithm was improved by 28.0%evaluated by error ratio,and the stability was improved by 26.56%by disparity accuracy.For fixed distance measurement,the maximum improvement was 78.6%by standard deviation.Based on the hawk‐eye‐inspired perception algorithm,the point cloud of orchard was improved both in quality and quantity.The hawk‐eye‐inspired perception algorithm contributed great advance in binocular 3D point cloud recon-struction in orchard navigation map.

Prevalence and risk factors for eye diseases, blindness, and low vision in Lhasa, Tibet

AIM: To determine the prevalence and risk factors for eye diseases, blindness, and low vision in Tibet, and to assist the development of eye disease prevention and treatment schemes.METHODS: We carried out a survey of eye diseases among a population living at high altitude. A total of 1 115 Tibetan permanent residents aged 40 years or older from the towns and villages of Qushui County, Lhasa Prefecture, Tibet Autonomous Region, participated in this study. All participants completed a detailed questio-nnaire, and underwent presenting and pinhole visual acuity tests,and a comprehensive ophthalmic examination.RESULTS: There were 187 blind eyes (8.43%), 231 eyes with low vision (10.41% ). The leading cause of visual impairment was cataract of 55.0% (101/187) blindness and of 50.2% (116/231) low vision, followed by fundus lesions of 22.9% blindness and 23.8% low vision, while only a low prevalence of glaucoma of 9.6% blindness and 1.7% low vision was observed. The analysis of 2 219 eyes showed that the most common external eye disease was pterygium (27.2%) in Tibet.CONCLUSION: The high prevalence of blindness and low vision in the Tibetan population at high altitude is a serious public health issue. There is a need to establish and maintain an appropriate effective eye care program in Tibet.

NeuroBiometric:An Eye Blink Based Biometric Authentication System Using an Event-Based Neuromorphic Vision Sensor

The rise of the Internet and identity authentication systems has brought convenience to people's lives but has also introduced the potential risk of privacy leaks.Existing biometric authentication systems based on explicit and static features bear the risk of being attacked by mimicked data.This work proposes a highly efficient biometric authentication system based on transient eye blink signals that are precisely captured by a neuromorphic vision sensor with microsecond-level temporal resolution.The neuromorphic vision sensor only transmits the local pixel-level changes induced by the eye blinks when they occur,which leads to advantageous characteristics such as an ultra-low latency response.We first propose a set of effective biometric features describing the motion,speed,energy and frequency signal of eye blinks based on the microsecond temporal resolution of event densities.We then train the ensemble model and non-ensemble model with our Neuro Biometric dataset for biometrics authentication.The experiments show that our system is able to identify and verify the subjects with the ensemble model at an accuracy of 0.948 and with the non-ensemble model at an accuracy of 0.925.The low false positive rates(about 0.002)and the highly dynamic features are not only hard to reproduce but also avoid recording visible characteristics of a user's appearance.The proposed system sheds light on a new path towards safer authentication using neuromorphic vision sensors.

New self-calibration approach to space robots based on hand-eye vision

To overcome the influence of on-orbit extreme temperature environment on the tool pose(position and orientation) accuracy of a space robot,a new self-calibration method based on a measurement camera(hand-eye vision) attached to its end-effector was presented.Using the relative pose errors between the two adjacent calibration positions of the space robot,the cost function of the calibration was built,which was different from the conventional calibration method.The particle swarm optimization algorithm(PSO) was used to optimize the function to realize the geometrical parameter identification of the space robot.The above calibration method was carried out through self-calibration simulation of a six-DOF space robot whose end-effector was equipped with hand-eye vision.The results showed that after calibration there was a significant improvement of tool pose accuracy in a set of independent reference positions,which verified the feasibility of the method.At the same time,because it was unnecessary for this method to know the transformation matrix from the robot base to the calibration plate,it reduced the complexity of calibration model and shortened the error propagation chain,which benefited to improve the calibration accuracy.

AB034. Knowledge and understanding of eye disease among older adults with vision impairment

Background:By 2026,projections indicate that 1/5 Canadians will be over the age of 65.This shift in demographics will be accompanied by an increase in age-related eye disease.Survey studies have reported vision loss as a major medical concern among older adults,but there is little information on older adults’awareness and knowledge of age-related eye diseases.A lack of knowledge can lead to missed or delayed treatment and/or lifestyle modification.This study aims to assess the knowledge and understanding older adults have of their own eye disease and its prognosis.Methods:Participants over the age of 50 with a visual impairment were recruited from the MAB-Mackay Rehabilitation Centre,the Low Vision Self-Help Association(LVSHA)of the West Island and through word of mouth.Visual acuity and contrast sensitivity were measured using the ETDRS charts and Mars Charts,respectively.Optical coherence tomography(OCT)/scanning laser ophthalmoscopy was used to take cross-sectional images of participant retinas.Participants were asked to name their visual diagnoses and describe them in their own words.Participant diagnoses were compared to diagnoses determined by an optometrist or ophthalmologist.Results:To date,this study has recruited 26 participants(7M,19F)over the age of 50 years(range,51-95 years).Many participants(73%)were able to name their visual diagnoses,articulate their symptoms,and discuss their treatment and prognosis.The majority of these individuals(67%)were clients of the MAB-Mackay or participants in the LVSHA.Of the 27%(4M,4F)who were unclear or had misunderstood their diagnoses,half were participants in a low vision support group,but they had multiple visual diagnoses and it was the congenital or trauma-related visual impairments acquired before joining the MAB-Mackay or LVSHA that remained unclear.The other 4 individuals who misunderstood their diagnoses were not involved with any low vision or rehabilitation organizations.Conclusions:Visual impairment is sometimes dismissed as part of aging.A lack of awareness and knowledge can lead to missed or delayed treatment and/or lifestyle modifications.The preliminary results of this study demonstrate the important role organizations like the MAB-Mackay and LVSHA play in education and adaptation to low vision for older adults.Individuals with a better understanding of their own diagnoses are more likely to follow through with doctor-recommendations and have successful treatment or slowed progression.

Prevalences and causes of vision impairment in elderly Chinese: a socioeconomic perspective of a comparative report nested in Jiangsu Eye Study

AIM：To survey the prevalence and causes of visual impairment/blindness among elderly Chinese from different socioeconomic status in community-based design.METHODS：Cluster-sampling randomly selected residents from Binhu and Funing District,two areas representing different socioeconomic levels in China with Binhu in an advanced status and Funing in lessdeveloped area.The participants subjected to ophthalmic examination.The presenting visual acuity（PVA） and best-corrected visual acuity（BCVA） were recorded.Visual impairment and blindness were defined according to World Health Organization criteria.The causes of visual impairment/blindness were identified by ophthalmic examination and/or questionnaire.The socioeconomic status included the per capita gross domestic product,numbers of hospital with ophthalmic service and the number of ophthalmologists per 1 million residents.RESULTS：We successfully included 12 867 participants form 2 areas in this study.The prevalence of PVA impairment（〈20/63 to ≥20/400） in the better eye was 5.4% in Binhu and 23.6% in Funing,while the prevalence of blindness（〈20/400） was 0.9% in Binhu and 2.3% in Funing.With BCVA,the prevalence of visual impairment was 2.4% in Binhu and 6.4% in Funing,while the prevalence of blindness was 0.8% in Binhu and 1.6% in Funing.The participants with older age and female gender had higher prevalence in visual impairment and blindness.The highest prevalences of vision impairment and blindness evaluated by BCVA at 〉80y age group reached 20.4% and 6.3% respectively.The prevalences of vision impairment and blindness evaluated by BCVA were 3.5% and 1.0% in male and 5.0% and 1.3% in female.The above differences were statistically significant（P〈0.05）.The predominant causes of visual impairment and blindness were cataract,retinal disorders and uncorrected refractive error in both areas.The socioeconomic status was associated with visual impairment and blindness.CONCLUSION：This community-based study build a sufficient sample size for an ophthalmic survey.Our data show the disparities on socioeconomic development and genders in visual impairment and blindness in China.Special emphasis of ophthalmic service should be placed on females and less-developed area.

DISTANCE MEASURING MODELING AND ERROR ANALYSIS OF DUALCCD VISION SYSTEM SIMULATING HUMAN EYES AND NECK

A dual-CCD simulating human eyes and neck (DSHEN) vision system is putforward. Its structure and principle are introduced. The DSREN vision system can perform somemovements simulating human eyes and neck by means of four rotating joints, and realize preciseobject recognizing and distance measuring in all orientations. The mathematic model of the DSHENvision system is built, and its movement equation is solved. The coordinate error and measureprecision affected by the movement parameters are analyzed by means of intersection measuringmethod. So a theoretic foundation for further research on automatic object recognizing and precisetarget tracking is provided.

Clinical Observation of Recombinant Bovine Basic Fibroblast Growth Factor Eye Gel Combined with Tobramycin Dexamethasone Eye Drops in the Treatment of Dry Eye Syndrome in Patients after Cataract Surgery

Objective:To evaluate the therapeutic effect of recombinant bovine basic fibroblast growth factor(rbFGF)eye gel combined with tobramycin-dexamethasone(TOB-Dex)eye drops on dry eye syndrome(DES)after cataract surgery.Methods:86 patients with DES after cataract surgery,admitted from November 2021 to November 2023,were randomly divided into groups.The observation group included 43 patients treated with rbFGF eye gel combined with TOB-Dex eye drops.The reference group included 43 patients treated with TOB-Dex eye drops alone.Multiple indicators,including total effective rate and clinical symptom scores,were compared between the two groups.Results:The total effective rate in the observation group was higher than in the reference group(P<0.05).Before treatment,there were no differences in clinical symptom scores,serum factors,or disease severity scores between the two groups(P>0.05).Three weeks after treatment,the observation group had lower clinical symptom scores,serum factors,and disease severity scores compared to the reference group(P<0.05).The adverse reaction rate in the observation group was lower than in the reference group(P<0.05).Conclusion:rbFGF eye gel combined with TOB-Dex eye drops can improve the clinical efficacy for patients with DES after cataract surgery,alleviate disease symptoms,reduce inflammatory responses,and have fewer adverse reactions.

EyeScreen:A Vision-Based Gesture Interaction System

EyeScreen is a vision-based interaction system which provides a natural gesture interface for humancomputer interaction （HCI） by tracking human fingers and recognizing gestures. Multi-view video images are captured by two cameras facing a computer screen, which can be used to detect clicking actions of a fingertip and improve the recognition rate. The system enables users to directly interact with rendered objects on the screen. Robustness of the system has been verified by extensive experiments with different user scenarios. EyeScreen can be used in many applications such as intelligent interaction and digital entertainment.

Analyze interleukin-1β,interleukin-6,and tumor necrosis factor-αlevels in dry eye and the therapeutic effect of cyclosporine A

BACKGROUND Dry eye is a common eye disease.Artificial tears supplements are widely used for the treatment of dry eyes.However,multiple adverse effects have been observed in patients receiving long-term treatment with artificial tears,which may affect the therapeutic effect.AIM To analyze the characteristics of interleukin-1β(IL-1β),interleukin-6(IL-6),and tumor necrosis factor-alpha(TNF-α)levels in patients with dry eye and the therapeutic effect of artificial tears combined with cyclosporine A.METHODS A total of 124 dry eye patients treated at The First People’s Hospital of Xining from April 2020 to April 2022 were selected as the observation group,while 20 healthy individuals served as the control group during the same period.Levels of inflammatory markers,including IL-1β,IL-6,and TNF-α,were analyzed.The observation group was further divided into a study group and a control group,each consisting of 62 patients.The control group received artificial tears,whereas the study group received a combination of artificial tears and cyclosporine A.Inflammatory markers,Schirmer’s test(SIT),tear break-up time(TBUT),corneal fluorescein staining(CFS),National Eye Institute Visual Function Questionnaire-25(NEI-VFQ-25)scores,and adverse events(AEs)were compared between the two groups.RESULTS The observation group exhibited significantly elevated serum levels of IL-1β,IL-6,and TNF-αin comparison to the healthy group.Following treatment,the study group demonstrated substantial reductions in IL-1β,IL-6,and TNF-αlevels relative to the control group.Moreover,after treatment,the study group experienced a marked decrease in CFS scores and significant increases in both SIT and BUT levels when compared to the control group.Additionally,significant improvements were observed in the primary symptom of dry eye and secondary symptoms such as photophobia,foreign body sensation,fatigue,red eye,and burning sensation within the study group.Furthermore,post-treatment NEI-VFQ-25 scores across all dimensions exhibited significant enhancements in the study group compared to the control group(P<0.05).It is noteworthy that significant AEs were reported in both groups throughout the treatment period.CONCLUSION Cyclosporine A combined with artificial tears is effective in treating dry eye,yielding enhanced outcomes by improving SIT and TBUT levels,reducing CFS scores,and ameliorating vision-related quality of life.

Efficacy of recombinant human epidermal growth factor plus sodium hyaluronate eye drops in diabetic dry eye post-cataract surgery

BACKGROUND Dry eye syndrome(DES)after diabetic cataract surgery can seriously affect the patient’s quality of life.Therefore,effective alleviation of symptoms in patients with this disease has important clinical significance.AIM To explore the clinical effect of recombinant human epidermal growth factor(rhEGF)plus sodium hyaluronate(SH)eye drops on DES after cataract surgery in patients with diabetes.METHODS We retrospectively evaluated 82 patients with diabetes who experienced DES after cataract surgery at Tianjin Beichen Hospital,Affiliated Hospital of Nankai University between April 2021 and April 2023.They were classified into an observation group(42 cases,rhEGF+SH eye drops)and a control group(40 cases,SH eye drops alone),depending on the different treatment schemes.The therapeutic efficacy,dry eye symptom score,tear film breakup time(TFBUT),basic tear secretion score[assessed using Schirmer I test(SIt)],corneal fluorescein staining(FL)score,tear inflammatory markers,adverse reactions during treat-ment,and treatment satisfaction were compared between the two groups.RESULTS Therapeutic efficacy was higher in the observation group compared with the control group.Both groups showed improved TFBUT and dry eye,as well as improved SIt and FL scores after treatment,with a more pronounced improvement in the observation group.Although no marked differences in adverse reactions were observed between the two groups,treatment satisfaction was higher in the observation group.CONCLUSION rhEGF+SH eye drops rendered clinical benefits to patients by effectively ameliorating dry eye and visual impairment with favorable efficacy,fewer adverse reactions,and high safety levels.Thus,this treatment should be promoted in clinical practice.

基于Vision Transformer的虹膜——人脸多特征融合识别研究

为了提高生物特征识别系统的准确性和鲁棒性,本文研究基于计算机视觉的虹膜—人脸多特征融合识别方法。本文对面部图像中虹膜区域进行提取以及预处理,采用对比度增强和归一化操作,加强了特征提取的一致性,提升了图像质量。为了获取丰富的深度特征,本文使用Vision Transformer模型对预处理后的虹膜和面部图像进行特征提取。利用多头注意力机制将虹膜和面部的多模态特征信息进行融合,再利用全连接层进行分类识别。试验结果表明,该方法识别性能优秀,识别准确性显著提升。

Prevalence and Factors Associated with Dry Eyes Syndrome in Glaucomatous Patients on Anti-Glaucoma Eye Drops Followed up at the Garoua Regional Hospital-Northern Cameroon

Background: Dry eye and glaucoma are two common pathologies in the elderly, and are very often associated. This association suggests a link between them and between their treatments. Our purpose for this study is to determine the prevalence of dry eye in our glaucoma patients treated with eye drops and deduce the factors associated with it. Patients and Methods: We conducted a cross-sectional, analytical study from October 2022 to September 2023 in the ophthalmology department of Garoua Regional Hospital in glaucoma patients aged over 15 years able to answer the Ocular Surface Disease Index (OSDI) questionnaires and treated with antiglaucoma eye drops for more than 3 months. These patients underwent a complete ophthalmological examination and a tear film break-up time test. Results: A total of 73 patients (146 eyes) were examined. The average age of the patients was 47.2 ± 16.5 years, with a male predominance of 54.8%. The prevalence of dry eye syndrome in our patients according to the OSDI score was 56.2% (95% CI) (44.8;67.6). The prevalence of dry eye syndrome on clinical examination of the BUT in the right eye was 83.7% (95% CI) (75.1;92.1) and 79.4% (70.2;88.7) in the left eye. The duration of antiglaucoma treatment was the factor associated with dry eye syndrome (p < 0.05) in glaucoma patients in our setting. Conclusion: Dry Eye Syndrome is common in glaucoma patients on drops in our setting. Treatment duration of more than 1 year seems to be associated with dry eyes.

基于Vision Transformer的小麦病害图像识别算法

小麦白粉病、赤霉病和锈病是危害小麦产量的三大病害。为提高小麦病害图像的识别准确率,构建一种基于Vision Transformer的小麦病害图像识别算法。首先,通过田间拍摄的方式收集包含小麦白粉病、赤霉病和锈病3种病害在内的小麦病害图像,并对原始图像进行预处理,建立小麦病害图像识别数据集;然后,基于改进的Vision Transformer构建小麦病害图像识别算法,分析不同迁移学习方式和数据增强对模型识别效果的影响。试验可知,全参数迁移学习和数据增强能明显提高Vision Transformer模型的收敛速度和识别精度。最后,在相同时间条件下,对比Vision Transformer、AlexNet和VGG16算法在相同数据集上的表现。试验结果表明,Vision Transformer模型对3种小麦病害图像的平均识别准确率为96.81%,相较于AlexNet和VGG16模型识别准确率分别提高6.68%和4.94%。

细粒度图像分类上Vision Transformer的发展综述

细粒度图像分类(fine-grained image classification,FGIC)一直是计算机视觉领域中的重要问题。与传统图像分类任务相比,FGIC的挑战在于类间对象极其相似,使任务难度进一步增加。随着深度学习的发展,Vision Transformer(ViT)模型在视觉领域掀起热潮,并被引入到FGIC任务中。介绍了FGIC任务所面临的挑战,分析了ViT模型及其特性。主要根据模型结构全面综述了基于ViT的FGIC算法,包括特征提取、特征关系构建、特征注意和特征增强四方面内容,对每种算法进行了总结,并分析了它们的优缺点。通过对不同ViT模型在相同公用数据集上进行模型性能比较,以验证它们在FGIC任务上的有效性。最后指出了目前研究的不足,并提出未来研究方向,以进一步探索ViT在FGIC中的潜力。

基于Vision Transformer的阿尔茨海默病分类研究

为了有效地提升对阿尔茨海默病(AD)的磁共振成像(MRI)图像分类准确率,提出一种LC(Layer-Cut)-ViT方法。该方法通过引入Vision Transformer(ViT)的自注意力机制对MRI图像进行层切分,使模型能更好地理解图像的全局信息,同时突出切片间的特征关系。此外,通过配准、颅骨分离算法提取MRI图像的脑部组织部分,进一步提升模型的性能。实验结果显示,所提方法对阿尔茨海默病的MRI图像具有较好的分类能力。

基于Vision Transformer和迁移学习的家庭领域哭声识别

针对SVM等传统机器学习算法准确率低和当前使用CNN处理家庭领域哭声识别在不同婴儿间出现泛化能力差的问题,提出了一种基于Vision Transformer和迁移学习的婴儿哭声音频分类算法。首先,为实现数据集样本的扩增,采用了包括梅尔频谱转换和数据增强的数据预处理技术,进而达到了增强模型鲁棒性的目的。而后,在微调后的Vision Transformer模型上进行迁移学习训练,同时,训练过程中利用了LookAhead优化器来不断调整模型参数以避免过拟合,最终实验实现了对婴儿哭声音频的自动分类。实验结果表明,本实验模型相比其他深度学习模型具有更高的精确率和更快的收敛速度,同时还能有效地学习到婴儿哭声中更具区分性的特征。可以在新生儿监护、听力筛查和异常检测等领域中发挥重要作用。

基于Vision Transformer和卷积注入的车辆重识别

针对车辆重识别中提取特征鲁棒性不高的问题,本文提出基于Vision Transformer的车辆重识别方法。首先,利用注意力机制提出目标导向映射模块,并结合辅助信息嵌入模块,抑制由不同视角、相机拍摄及无效背景引入的噪声。其次,以Vision Transformer远距离建模能力为基础提出通道感知模块,通过并行设计模型能够同时获取图像块之间和图像通道之间的特征,在关注图像块之间关联的基础上,进一步构建通道之间的关联。最后,利用卷积神经网络的局部归纳偏置,将全局特征向量输入到卷积注入模块中进行细化,并与全局特征联合优化,以构建鲁棒性的车辆特征。为了验证提出方法的有效性,在Ve⁃Ri776、VehicleID和VeRi-Wild数据集上分别进行了实验验证。实验结果证明,本文的方法取得了良好的效果。

Psychometric validation of the Chinese version of the dry eye-related quality-of-life score questionnaire

AIM:To psychometrically validate the Chinese version of the dry eye-related quality-of-life score questionnaire(DEQSCHN)among Chinese patients with dry eye.METHODS:This study involved 231 participants,including 191 with dry eye disease(DED)comprising the dry eye disease group,and 40 healthy participants forming the control group.Participants were required to complete the DEQS-CHN,and Chinese dry eye questionnaire and undergo clinical tests including the fluorescein breakup time(FBUT),corneal fluorescein staining(CFS),and Schirmer I test.To assess the internal consistency and retest reliability,Cronbach’sαand the intraclass correlation coefficient(ICC)were employed.Content validity was assessed by item-level content validity index(ICV)and an average scale-level content validity index(S-CVI/Ave).Construct validity was assessed by confirmatory factor analysis.The concurrent validity was assessed by calculating correlations between DEQS-CHN and Chinese dry eye questionnaire.Discriminative validity was evaluated through nonparametric tests,with receiver operating characteristic(ROC)curve serving as conclusive indicators of the questionnaire’s distinguishing capability.RESULTS:The Cronbach’sαcoefficients for frequency and degree of ocular symptoms,impact on daily life,and summary score were 0.736,0.704,0.811,0.818,0.861,and 0.860,respectively,and the ICC were 0.611,0.677,0.715,0.769,0.711,and 0.779,respectively.All I-CVI scores ranged from 0.833 to 1.000,with an S-CVI/Ave of 0.956.Confirmatory factor analysis results exhibited a wellfitting model consistent with the original questionnaire[χ^(2)/df=2.653,incremental fit index(IFI)=0.924,comparative fit index(CFI)=0.924,Tucker-Lewis index(TLI)=0.909,and root mean square error of approximation(RMSEA)=0.065].There was a moderate positive correlation between the DEQS-CHN and the Chinese dry eye questionnaire(r^(2)=0.588).The dry eye group demonstrated significantly higher scores compared to the control group,and the area under the curve(AUC)value was 0.8092.CONCLUSION:The DEQS-CHN has been demonstrated as a valid and reliable instrument for assessing the impact of dry eye disease on the quality of life among Chinese individuals with DED.