Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block,and it plays a crucial role in environmental perception...Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block,and it plays a crucial role in environmental perception.Conventional learning-based visual semantic segmentation approaches count heavily on largescale training data with dense annotations and consistently fail to estimate accurate semantic labels for unseen categories.This obstruction spurs a craze for studying visual semantic segmentation with the assistance of few/zero-shot learning.The emergence and rapid progress of few/zero-shot visual semantic segmentation make it possible to learn unseen categories from a few labeled or even zero-labeled samples,which advances the extension to practical applications.Therefore,this paper focuses on the recently published few/zero-shot visual semantic segmentation methods varying from 2D to 3D space and explores the commonalities and discrepancies of technical settlements under different segmentation circumstances.Specifically,the preliminaries on few/zeroshot visual semantic segmentation,including the problem definitions,typical datasets,and technical remedies,are briefly reviewed and discussed.Moreover,three typical instantiations are involved to uncover the interactions of few/zero-shot learning with visual semantic segmentation,including image semantic segmentation,video object segmentation,and 3D segmentation.Finally,the future challenges of few/zero-shot visual semantic segmentation are discussed.展开更多
Dear Editor,This letter is concerned with visual perception closely related to heterogeneous images.Facing the huge challenge brought by different image modalities,we propose a visual perception framework based on het...Dear Editor,This letter is concerned with visual perception closely related to heterogeneous images.Facing the huge challenge brought by different image modalities,we propose a visual perception framework based on heterogeneous image knowledge,i.e.,the domain knowledge associated with specific vision tasks,to better address the corresponding visual perception problems.展开更多
AIM:To investigate the prevalence of visual impairment(VI)and provide an estimation of uncorrected refractive errors in school-aged children,conducted by optometry students as a community service.METHODS:The study was...AIM:To investigate the prevalence of visual impairment(VI)and provide an estimation of uncorrected refractive errors in school-aged children,conducted by optometry students as a community service.METHODS:The study was cross-sectional.Totally 3343 participants were included in the study.The initial examination involved assessing the uncorrected distance visual acuity(UDVA)and visual acuity(VA)while using a+2.00 D lens.The inclusion criteria for a subsequent comprehensive cycloplegic eye examination,performed by an optometrist,were as follows:a UDVA<0.6 decimal(0.20 logMAR)and/or a VA with+2.00 D≥0.8 decimal(0.96 logMAR).RESULTS:The sample had a mean age of 10.92±2.13y(range 4 to 17y),and 51.3%of the children were female(n=1715).The majority of the children(89.7%)fell within the age range of 8 to 14y.Among the ethnic groups,the highest representation was from the Luhya group(60.6%)followed by Luo(20.4%).Mean logMAR UDVA choosing the best eye for each student was 0.29±0.17(range 1.70 to 0.22).Out of the total,246 participants(7.4%)had a full eye examination.The estimated prevalence of myopia(defined as spherical equivalent≤-0.5 D)was found to be 1.45%of the total sample.While around 0.18%of the total sample had hyperopia value exceeding+1.75 D.Refractive astigmatism(cil<-0.75 D)was found in 0.21%(7/3343)of the children.The VI prevalence was 1.26%of the total sample.Among our cases of VI,76.2%could be attributed to uncorrected refractive error.Amblyopia was detected in 0.66%(22/3343)of the screened children.There was no statistically significant correlation observed between age or gender and refractive values.CONCLUSION:The primary cause of VI is determined to be uncorrected refractive errors,with myopia being the most prevalent refractive error observed.These findings underscore the significance of early identification and correction of refractive errors in school-aged children as a means to alleviate the impact of VI.展开更多
Glaucoma is a leading cause of irreve rsible blindness wo rldwide,and previous studies have shown that,in addition to affecting the eyes,it also causes abnormalities in the brain.However,it is not yet clear how the pr...Glaucoma is a leading cause of irreve rsible blindness wo rldwide,and previous studies have shown that,in addition to affecting the eyes,it also causes abnormalities in the brain.However,it is not yet clear how the primary visual cortex(V1)is altered in glaucoma.This study used DBA/2J mice as a model for spontaneous secondary glaucoma.The aim of the study was to compare the electrophysiological and histomorphological chara cteristics of neurons in the V1between 9-month-old DBA/2J mice and age-matched C57BL/6J mice.We conducted single-unit recordings in the V1 of light-anesthetized mice to measure the visually induced responses,including single-unit spiking and gamma band oscillations.The morphology of layerⅡ/Ⅲneurons was determined by neuronal nuclear antigen staining and Nissl staining of brain tissue sections.Eighty-seven neurons from eight DBA/2J mice and eighty-one neurons from eight C57BL/6J mice were examined.Compared with the C57BL/6J group,V1 neurons in the DBA/2J group exhibited weaker visual tuning and impaired spatial summation.Moreove r,fewer neuro ns were observed in the V1 of DBA/2J mice compared with C57BL/6J mice.These findings suggest that DBA/2J mice have fewer neurons in the VI compared with C57BL/6J mice,and that these neurons have impaired visual tuning.Our findings provide a better understanding of the pathological changes that occur in V1 neuron function and morphology in the DBA/2J mouse model.This study might offer some innovative perspectives regarding the treatment of glaucoma.展开更多
Image captioning has gained increasing attention in recent years.Visual characteristics found in input images play a crucial role in generating high-quality captions.Prior studies have used visual attention mechanisms...Image captioning has gained increasing attention in recent years.Visual characteristics found in input images play a crucial role in generating high-quality captions.Prior studies have used visual attention mechanisms to dynamically focus on localized regions of the input image,improving the effectiveness of identifying relevant image regions at each step of caption generation.However,providing image captioning models with the capability of selecting the most relevant visual features from the input image and attending to them can significantly improve the utilization of these features.Consequently,this leads to enhanced captioning network performance.In light of this,we present an image captioning framework that efficiently exploits the extracted representations of the image.Our framework comprises three key components:the Visual Feature Detector module(VFD),the Visual Feature Visual Attention module(VFVA),and the language model.The VFD module is responsible for detecting a subset of the most pertinent features from the local visual features,creating an updated visual features matrix.Subsequently,the VFVA directs its attention to the visual features matrix generated by the VFD,resulting in an updated context vector employed by the language model to generate an informative description.Integrating the VFD and VFVA modules introduces an additional layer of processing for the visual features,thereby contributing to enhancing the image captioning model’s performance.Using the MS-COCO dataset,our experiments show that the proposed framework competes well with state-of-the-art methods,effectively leveraging visual representations to improve performance.The implementation code can be found here:https://github.com/althobhani/VFDICM(accessed on 30 July 2024).展开更多
Visual system is vital to human beings.Unfortunately,the optic nerve lacks the ability to regenerate after injury.Therefo re,long-distance regeneration of the optic nerve is a major unsolved medical problem in the wor...Visual system is vital to human beings.Unfortunately,the optic nerve lacks the ability to regenerate after injury.Therefo re,long-distance regeneration of the optic nerve is a major unsolved medical problem in the world(Laha et al.,2017).Recently,Li and So groups' study showed that the bioactive material(ciliary neurotrophic factor[CNTF]-chitosan) could promote long-distance regeneration of the completely transected optic nerve in adult rats and partially restored the visual functions(Liu et al.,2023).This study sheds light on the clinical potential for repairing the severely injured optic nerve.展开更多
BACKGROUND Cataracts pose a significant clinical burden due to their complex pathogenesis.In recent years,an increase in cataracts coexisting with myopia has heightened the incidence of retinopathy and posterior vitre...BACKGROUND Cataracts pose a significant clinical burden due to their complex pathogenesis.In recent years,an increase in cataracts coexisting with myopia has heightened the incidence of retinopathy and posterior vitreous detachment.Additionally,symptoms of ocular axis elongation,lens nucleus hardening,and vitreous liquefaction have become more prevalent.While conventional extracapsular cataract extraction is commonly employed,it often yields suboptimal visual outcomes.Subsequent advancements in cataract phacoemulsification and lens implantation surgeries have gained widespread acceptance for their ability to improve refraction and significantly improve uncorrected visual acuity.AIM To investigate the effect of capsular treatment after phacoemulsification lens implantation in myopic patients with cataract.METHODS We selected 110 patients(with 134 eyes)with myopia and cataracts treated.These patients were categorized into two groups:an observation group(57 patients with 70 eyes)and a control group(53 patients with 64 eyes).The control group underwent cataract phacoemulsification and lens implantation,while the observation group received a refined capsular treatment based on the control group’s procedure.We assessed the differences in visual acuity and quality between the two groups before and after surgery.RESULTS At six months post-operation,the observation group exhibited significantly improved far vision,intermediate vision,near vision,lower objective scattering index,higher Modulation transfer function cut-off frequency,and overall vision metrics at different contrast levels(100%,20%and 9%)compared to the control group(P<0.05).The total score of the National Eye Institute Visual Function Questionnaire in the observation group at 6 months after operation was significantly higher than that in the control group(P<0.05).No significant difference in the incidence of adverse reactions was observed between the observation group and control group(P>0.05).CONCLUSION Capsular treatment demonstrates efficacy in improving visual acuity and quality after phacoemulsification lens implantation in myopic patients with cataracts,warranting its clinical application.展开更多
Dear Editor,This letter deals with the tracking problem of quadrotors subject to external disturbances and visibility constraints by designing a robust model predictive control(RMPC) scheme. According to the imagebase...Dear Editor,This letter deals with the tracking problem of quadrotors subject to external disturbances and visibility constraints by designing a robust model predictive control(RMPC) scheme. According to the imagebased visual servoing(IBVS) method, a virtual camera is constructed to express image moments of the tracking target.展开更多
基金supported by National Key Research and Development Program of China(2021YFB1714300)the National Natural Science Foundation of China(62233005)+2 种基金in part by the CNPC Innovation Fund(2021D002-0902)Fundamental Research Funds for the Central Universities and Shanghai AI Labsponsored by Shanghai Gaofeng and Gaoyuan Project for University Academic Program Development。
文摘Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block,and it plays a crucial role in environmental perception.Conventional learning-based visual semantic segmentation approaches count heavily on largescale training data with dense annotations and consistently fail to estimate accurate semantic labels for unseen categories.This obstruction spurs a craze for studying visual semantic segmentation with the assistance of few/zero-shot learning.The emergence and rapid progress of few/zero-shot visual semantic segmentation make it possible to learn unseen categories from a few labeled or even zero-labeled samples,which advances the extension to practical applications.Therefore,this paper focuses on the recently published few/zero-shot visual semantic segmentation methods varying from 2D to 3D space and explores the commonalities and discrepancies of technical settlements under different segmentation circumstances.Specifically,the preliminaries on few/zeroshot visual semantic segmentation,including the problem definitions,typical datasets,and technical remedies,are briefly reviewed and discussed.Moreover,three typical instantiations are involved to uncover the interactions of few/zero-shot learning with visual semantic segmentation,including image semantic segmentation,video object segmentation,and 3D segmentation.Finally,the future challenges of few/zero-shot visual semantic segmentation are discussed.
基金supported in part by the National Natural Science Foundation of China(62302161,62303361)the Postdoctoral Innovative Talent Support Program of China(BX20230114)。
文摘Dear Editor,This letter is concerned with visual perception closely related to heterogeneous images.Facing the huge challenge brought by different image modalities,we propose a visual perception framework based on heterogeneous image knowledge,i.e.,the domain knowledge associated with specific vision tasks,to better address the corresponding visual perception problems.
文摘AIM:To investigate the prevalence of visual impairment(VI)and provide an estimation of uncorrected refractive errors in school-aged children,conducted by optometry students as a community service.METHODS:The study was cross-sectional.Totally 3343 participants were included in the study.The initial examination involved assessing the uncorrected distance visual acuity(UDVA)and visual acuity(VA)while using a+2.00 D lens.The inclusion criteria for a subsequent comprehensive cycloplegic eye examination,performed by an optometrist,were as follows:a UDVA<0.6 decimal(0.20 logMAR)and/or a VA with+2.00 D≥0.8 decimal(0.96 logMAR).RESULTS:The sample had a mean age of 10.92±2.13y(range 4 to 17y),and 51.3%of the children were female(n=1715).The majority of the children(89.7%)fell within the age range of 8 to 14y.Among the ethnic groups,the highest representation was from the Luhya group(60.6%)followed by Luo(20.4%).Mean logMAR UDVA choosing the best eye for each student was 0.29±0.17(range 1.70 to 0.22).Out of the total,246 participants(7.4%)had a full eye examination.The estimated prevalence of myopia(defined as spherical equivalent≤-0.5 D)was found to be 1.45%of the total sample.While around 0.18%of the total sample had hyperopia value exceeding+1.75 D.Refractive astigmatism(cil<-0.75 D)was found in 0.21%(7/3343)of the children.The VI prevalence was 1.26%of the total sample.Among our cases of VI,76.2%could be attributed to uncorrected refractive error.Amblyopia was detected in 0.66%(22/3343)of the screened children.There was no statistically significant correlation observed between age or gender and refractive values.CONCLUSION:The primary cause of VI is determined to be uncorrected refractive errors,with myopia being the most prevalent refractive error observed.These findings underscore the significance of early identification and correction of refractive errors in school-aged children as a means to alleviate the impact of VI.
基金supported by the STI 2030-Major Projects 2022ZD0208500(to DY)the National Natural Science Foundation of China,Nos.82072011(to YX),82121003(to DY),82271120(to YS)+2 种基金Sichuan Science and Technology Program,No.2022ZYD0066(to YS)a grant from Chinese Academy of Medical Science,No.2019-12M-5-032(to YS)the Fundamental Research Funds for the Central Universities,No.ZYGX2021YGLH219(to KC)。
文摘Glaucoma is a leading cause of irreve rsible blindness wo rldwide,and previous studies have shown that,in addition to affecting the eyes,it also causes abnormalities in the brain.However,it is not yet clear how the primary visual cortex(V1)is altered in glaucoma.This study used DBA/2J mice as a model for spontaneous secondary glaucoma.The aim of the study was to compare the electrophysiological and histomorphological chara cteristics of neurons in the V1between 9-month-old DBA/2J mice and age-matched C57BL/6J mice.We conducted single-unit recordings in the V1 of light-anesthetized mice to measure the visually induced responses,including single-unit spiking and gamma band oscillations.The morphology of layerⅡ/Ⅲneurons was determined by neuronal nuclear antigen staining and Nissl staining of brain tissue sections.Eighty-seven neurons from eight DBA/2J mice and eighty-one neurons from eight C57BL/6J mice were examined.Compared with the C57BL/6J group,V1 neurons in the DBA/2J group exhibited weaker visual tuning and impaired spatial summation.Moreove r,fewer neuro ns were observed in the V1 of DBA/2J mice compared with C57BL/6J mice.These findings suggest that DBA/2J mice have fewer neurons in the VI compared with C57BL/6J mice,and that these neurons have impaired visual tuning.Our findings provide a better understanding of the pathological changes that occur in V1 neuron function and morphology in the DBA/2J mouse model.This study might offer some innovative perspectives regarding the treatment of glaucoma.
基金supported by the National Natural Science Foundation of China(Nos.U22A2034,62177047)High Caliber Foreign Experts Introduction Plan funded by MOST,and Central South University Research Programme of Advanced Interdisciplinary Studies(No.2023QYJC020).
文摘Image captioning has gained increasing attention in recent years.Visual characteristics found in input images play a crucial role in generating high-quality captions.Prior studies have used visual attention mechanisms to dynamically focus on localized regions of the input image,improving the effectiveness of identifying relevant image regions at each step of caption generation.However,providing image captioning models with the capability of selecting the most relevant visual features from the input image and attending to them can significantly improve the utilization of these features.Consequently,this leads to enhanced captioning network performance.In light of this,we present an image captioning framework that efficiently exploits the extracted representations of the image.Our framework comprises three key components:the Visual Feature Detector module(VFD),the Visual Feature Visual Attention module(VFVA),and the language model.The VFD module is responsible for detecting a subset of the most pertinent features from the local visual features,creating an updated visual features matrix.Subsequently,the VFVA directs its attention to the visual features matrix generated by the VFD,resulting in an updated context vector employed by the language model to generate an informative description.Integrating the VFD and VFVA modules introduces an additional layer of processing for the visual features,thereby contributing to enhancing the image captioning model’s performance.Using the MS-COCO dataset,our experiments show that the proposed framework competes well with state-of-the-art methods,effectively leveraging visual representations to improve performance.The implementation code can be found here:https://github.com/althobhani/VFDICM(accessed on 30 July 2024).
文摘Visual system is vital to human beings.Unfortunately,the optic nerve lacks the ability to regenerate after injury.Therefo re,long-distance regeneration of the optic nerve is a major unsolved medical problem in the world(Laha et al.,2017).Recently,Li and So groups' study showed that the bioactive material(ciliary neurotrophic factor[CNTF]-chitosan) could promote long-distance regeneration of the completely transected optic nerve in adult rats and partially restored the visual functions(Liu et al.,2023).This study sheds light on the clinical potential for repairing the severely injured optic nerve.
文摘BACKGROUND Cataracts pose a significant clinical burden due to their complex pathogenesis.In recent years,an increase in cataracts coexisting with myopia has heightened the incidence of retinopathy and posterior vitreous detachment.Additionally,symptoms of ocular axis elongation,lens nucleus hardening,and vitreous liquefaction have become more prevalent.While conventional extracapsular cataract extraction is commonly employed,it often yields suboptimal visual outcomes.Subsequent advancements in cataract phacoemulsification and lens implantation surgeries have gained widespread acceptance for their ability to improve refraction and significantly improve uncorrected visual acuity.AIM To investigate the effect of capsular treatment after phacoemulsification lens implantation in myopic patients with cataract.METHODS We selected 110 patients(with 134 eyes)with myopia and cataracts treated.These patients were categorized into two groups:an observation group(57 patients with 70 eyes)and a control group(53 patients with 64 eyes).The control group underwent cataract phacoemulsification and lens implantation,while the observation group received a refined capsular treatment based on the control group’s procedure.We assessed the differences in visual acuity and quality between the two groups before and after surgery.RESULTS At six months post-operation,the observation group exhibited significantly improved far vision,intermediate vision,near vision,lower objective scattering index,higher Modulation transfer function cut-off frequency,and overall vision metrics at different contrast levels(100%,20%and 9%)compared to the control group(P<0.05).The total score of the National Eye Institute Visual Function Questionnaire in the observation group at 6 months after operation was significantly higher than that in the control group(P<0.05).No significant difference in the incidence of adverse reactions was observed between the observation group and control group(P>0.05).CONCLUSION Capsular treatment demonstrates efficacy in improving visual acuity and quality after phacoemulsification lens implantation in myopic patients with cataracts,warranting its clinical application.
基金supported by the National Natural Science Foundation of China (U22B2039, 62273281)。
文摘Dear Editor,This letter deals with the tracking problem of quadrotors subject to external disturbances and visibility constraints by designing a robust model predictive control(RMPC) scheme. According to the imagebased visual servoing(IBVS) method, a virtual camera is constructed to express image moments of the tracking target.
