Heterogeneous Image Knowledge Driven Visual Perception

Dear Editor,This letter is concerned with visual perception closely related to heterogeneous images.Facing the huge challenge brought by different image modalities,we propose a visual perception framework based on heterogeneous image knowledge,i.e.,the domain knowledge associated with specific vision tasks,to better address the corresponding visual perception problems.

Bioactive material promotes longdistance regeneration of optic nerve to restore visual functions

Visual system is vital to human beings.Unfortunately,the optic nerve lacks the ability to regenerate after injury.Therefo re,long-distance regeneration of the optic nerve is a major unsolved medical problem in the world(Laha et al.,2017).Recently,Li and So groups' study showed that the bioactive material(ciliary neurotrophic factor[CNTF]-chitosan) could promote long-distance regeneration of the completely transected optic nerve in adult rats and partially restored the visual functions(Liu et al.,2023).This study sheds light on the clinical potential for repairing the severely injured optic nerve.

RMPC-Based Visual Servoing for Trajectory Tracking of Quadrotor UAVs With Visibility

Dear Editor,This letter deals with the tracking problem of quadrotors subject to external disturbances and visibility constraints by designing a robust model predictive control(RMPC) scheme. According to the imagebased visual servoing(IBVS) method, a virtual camera is constructed to express image moments of the tracking target.

Visual Semantic Segmentation Based on Few/Zero-Shot Learning:An Overview

Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block,and it plays a crucial role in environmental perception.Conventional learning-based visual semantic segmentation approaches count heavily on largescale training data with dense annotations and consistently fail to estimate accurate semantic labels for unseen categories.This obstruction spurs a craze for studying visual semantic segmentation with the assistance of few/zero-shot learning.The emergence and rapid progress of few/zero-shot visual semantic segmentation make it possible to learn unseen categories from a few labeled or even zero-labeled samples,which advances the extension to practical applications.Therefore,this paper focuses on the recently published few/zero-shot visual semantic segmentation methods varying from 2D to 3D space and explores the commonalities and discrepancies of technical settlements under different segmentation circumstances.Specifically,the preliminaries on few/zeroshot visual semantic segmentation,including the problem definitions,typical datasets,and technical remedies,are briefly reviewed and discussed.Moreover,three typical instantiations are involved to uncover the interactions of few/zero-shot learning with visual semantic segmentation,including image semantic segmentation,video object segmentation,and 3D segmentation.Finally,the future challenges of few/zero-shot visual semantic segmentation are discussed.

Women in visual neural regeneration research

The year 2024 marks the 60^(th)anniversary of Title IX and 25 years since the New York Times revealed bias against female faculty members at the Massachusetts Institute of Technology.We take an opportunity here to examine the state of gender bias in a relatively new yet already prominent field,neural regeneration in the visual system,for which there is a well-defined context useful for this purpose.The National Eye Institute(NEI)provided the first round of research funding for its Audacious Goals Initiative(AGI)on visual neural regeneration in 2013 and the last round in 2021.Therefore,we focus on this timespan.Data sources included PubMed,the National Science Foundation(NSF),the NEI,the Blue Ridge Institute for Medical Research and data from the major professional organization for eye and vision research,the Association for Research in Vision and Ophthalmology(ARVO).

Recent progress in visualization and digitization of coherent transformation structures and application in high-strength steel

High-strength steels are mainly composed of medium-or low-temperature microstructures,such as bainite or martensite,with coherent transformation characteristics.This type of microstructure has a high density of dislocations and fine crystallographic structural units,which ease the coordinated matching of high strength,toughness,and plasticity.Meanwhile,given its excellent welding perform-ance,high-strength steel has been widely used in major engineering constructions,such as pipelines,ships,and bridges.However,visual-ization and digitization of the effective units of these coherent transformation structures using traditional methods(optical microscopy and scanning electron microscopy)is difficult due to their complex morphology.Moreover,the establishment of quantitative relationships with macroscopic mechanical properties and key process parameters presents additional difficulty.This article reviews the latest progress in microstructural visualization and digitization of high-strength steel,with a focus on the application of crystallographic methods in the development of high-strength steel plates and welding.We obtained the crystallographic data(Euler angle)of the transformed microstruc-tures through electron back-scattering diffraction and combined them with the calculation of inverse transformation from bainite or martensite to austenite to determine the reconstruction of high-temperature parent austenite and orientation relationship(OR)during con-tinuous cooling transformation.Furthermore,visualization of crystallographic packets,blocks,and variants based on actual OR and digit-ization of various grain boundaries can be effectively completed to establish quantitative relationships with alloy composition and key process parameters,thereby providing reverse design guidance for the development of high-strength steel.

Vein visualization enhancement by dual-wavelength phase-locked denoising technology

Visual near-infrared imaging equipment has broad applications in various fields such as venipuncture,facial injections,and safety verification due to its noncontact,compact,and portable design.Currently,most studies utilize near-infrared single-wavelength for image acquisition of veins.However,many substances in the skin,including water,protein,and melanin can create significant background noise,which hinders accurate detection.In this paper,we developed a dual-wavelength imaging system with phase-locked denoising technology to acquire vein image.The signals in the effective region are compared by using the absorption valley and peak of hemoglobin at 700nm and 940nm,respectively.The phase-locked denoising algorithm is applied to decrease the noise and interference of complex surroundings from the images.The imaging results of the vein are successfully extracted in complex noise environment.It is demonstrated that the denoising effect on hand veins imaging can be improved with 57.3%by using our dual-wavelength phase-locked denoising technology.Consequently,this work proposes a novel approach for venous imaging with dual-wavelengths and phase-locked denoising algorithm to extract venous imaging results in complex noisy environment better.

Dynamic SLAM Visual Odometry Based on Instance Segmentation:A Comprehensive Review

Dynamic Simultaneous Localization and Mapping(SLAM)in visual scenes is currently a major research area in fields such as robot navigation and autonomous driving.However,in the face of complex real-world envi-ronments,current dynamic SLAM systems struggle to achieve precise localization and map construction.With the advancement of deep learning,there has been increasing interest in the development of deep learning-based dynamic SLAM visual odometry in recent years,and more researchers are turning to deep learning techniques to address the challenges of dynamic SLAM.Compared to dynamic SLAM systems based on deep learning methods such as object detection and semantic segmentation,dynamic SLAM systems based on instance segmentation can not only detect dynamic objects in the scene but also distinguish different instances of the same type of object,thereby reducing the impact of dynamic objects on the SLAM system’s positioning.This article not only introduces traditional dynamic SLAM systems based on mathematical models but also provides a comprehensive analysis of existing instance segmentation algorithms and dynamic SLAM systems based on instance segmentation,comparing and summarizing their advantages and disadvantages.Through comparisons on datasets,it is found that instance segmentation-based methods have significant advantages in accuracy and robustness in dynamic environments.However,the real-time performance of instance segmentation algorithms hinders the widespread application of dynamic SLAM systems.In recent years,the rapid development of single-stage instance segmentationmethods has brought hope for the widespread application of dynamic SLAM systems based on instance segmentation.Finally,possible future research directions and improvementmeasures are discussed for reference by relevant professionals.

Classification of congenital cataracts based on multidimensional phenotypes and its association with visual outcomes

●AIM:To establish a classification for congenital cataracts that can facilitate individualized treatment and help identify individuals with a high likelihood of different visual outcomes.●METHODS:Consecutive patients diagnosed with congenital cataracts and undergoing surgery between January 2005 and November 2021 were recruited.Data on visual outcomes and the phenotypic characteristics of ocular biometry and the anterior and posterior segments were extracted from the patients’medical records.A hierarchical cluster analysis was performed.The main outcome measure was the identification of distinct clusters of eyes with congenital cataracts.●RESULTS:A total of 164 children(299 eyes)were divided into two clusters based on their ocular features.Cluster 1(96 eyes)had a shorter axial length(mean±SD,19.44±1.68 mm),a low prevalence of macular abnormalities(1.04%),and no retinal abnormalities or posterior cataracts.Cluster 2(203 eyes)had a greater axial length(mean±SD,20.42±2.10 mm)and a higher prevalence of macular abnormalities(8.37%),retinal abnormalities(98.52%),and posterior cataracts(4.93%).Compared with the eyes in Cluster 2(57.14%),those in Cluster 1(71.88%)had a 2.2 times higher chance of good best-corrected visual acuity[<0.7 logMAR;OR(95%CI),2.20(1.25–3.81);P=0.006].●CONCLUSION:This retrospective study categorizes congenital cataracts into two distinct clusters,each associated with a different likelihood of visual outcomes.This innovative classification may enable the personalization and prioritization of early interventions for patients who may gain the greatest benefit,thereby making strides toward precision medicine in the field of congenital cataracts.

基于Visual Components的套筒类零件柔性制造单元的应用研究

为实现多品种中、小批量零件的智能化加工,以套筒类零件加工为研究对象,通过对零件工艺的分析,为满足单元加工、搬运、翻转等功能需求,对数控机床和工业机器人进行选型,实现柔性制造单元的设计。利用Visual Components软件进行单元搭建、仿真优化反馈以提高真实产线运行效率。利用Profinet实现制造单元真实搭建,完成单元安装调试。套筒类零件柔性制造单元的设计为生产线设计提供了新思路。

Utility of real-time 3D visualization system in the early stage of phacoemulsification training

●AIM:To determine the teaching effects of a real-time three dimensional(3D)visualization system in the operating room for early-stage phacoemulsification training.●METHODS:A total of 10 ophthalmology residents of the first-year postgraduate were included.All the residents were novices to cataract surgery.Real-time cataract surgical observations were performed using a custom-built 3D visualization system.The training lasted 4wk(32h)in all.A modified International Council of Ophthalmology’s Ophthalmology Surgical Competency Assessment Rubric(ICO-OSCAR)containing 4 specific steps of cataract surgery was applied.The self-assessment(self)and expert-assessment(expert)were performed through the microsurgical attempts in the wet lab for each participant.●RESULTS:Compared with pre-training assessments(self 3.2±0.8,expert 2.5±0.6),the overall mean scores of posttraining(self 5.2±0.4,expert 4.7±0.6)were significantly improved after real-time observation training of 3D visualization system(P<0.05).Scores of 4 surgical items were significantly improved both self and expert assessment after training(P<0.05).●CONCLUSION:The 3D observation training provides novice ophthalmic residents with a better understanding of intraocular microsurgical techniques.It is a useful tool to improve teaching efficiency of surgical education.

Prevalence of visual impairment and estimation of refractive errors among school children in Kakamega,Kenya

AIM:To investigate the prevalence of visual impairment(VI)and provide an estimation of uncorrected refractive errors in school-aged children,conducted by optometry students as a community service.METHODS:The study was cross-sectional.Totally 3343 participants were included in the study.The initial examination involved assessing the uncorrected distance visual acuity(UDVA)and visual acuity(VA)while using a+2.00 D lens.The inclusion criteria for a subsequent comprehensive cycloplegic eye examination,performed by an optometrist,were as follows:a UDVA<0.6 decimal(0.20 logMAR)and/or a VA with+2.00 D≥0.8 decimal(0.96 logMAR).RESULTS:The sample had a mean age of 10.92±2.13y(range 4 to 17y),and 51.3%of the children were female(n=1715).The majority of the children(89.7%)fell within the age range of 8 to 14y.Among the ethnic groups,the highest representation was from the Luhya group(60.6%)followed by Luo(20.4%).Mean logMAR UDVA choosing the best eye for each student was 0.29±0.17(range 1.70 to 0.22).Out of the total,246 participants(7.4%)had a full eye examination.The estimated prevalence of myopia(defined as spherical equivalent≤-0.5 D)was found to be 1.45%of the total sample.While around 0.18%of the total sample had hyperopia value exceeding+1.75 D.Refractive astigmatism(cil<-0.75 D)was found in 0.21%(7/3343)of the children.The VI prevalence was 1.26%of the total sample.Among our cases of VI,76.2%could be attributed to uncorrected refractive error.Amblyopia was detected in 0.66%(22/3343)of the screened children.There was no statistically significant correlation observed between age or gender and refractive values.CONCLUSION:The primary cause of VI is determined to be uncorrected refractive errors,with myopia being the most prevalent refractive error observed.These findings underscore the significance of early identification and correction of refractive errors in school-aged children as a means to alleviate the impact of VI.

The cardiovascular system at high altitude:A bibliometric and visualization analysis

BACKGROUND When exposed to high-altitude environments,the cardiovascular system undergoes various changes,the performance and mechanisms of which remain controversial.AIM To summarize the latest research advancements and hot research points in the cardiovascular system at high altitude by conducting a bibliometric and visualization analysis.METHODS The literature was systematically retrieved and filtered using the Web of Science Core Collection of Science Citation Index Expanded.A visualization analysis of the identified publications was conducted employing CiteSpace and VOSviewer.RESULTS A total of 1674 publications were included in the study,with an observed annual increase in the number of publications spanning from 1990 to 2022.The United States of America emerged as the predominant contributor,while Universidad Peruana Cayetano Heredia stood out as the institution with the highest publication output.Notably,Jean-Paul Richalet demonstrated the highest productivity among researchers focusing on the cardiovascular system at high altitude.Furthermore,Peter Bärtsch emerged as the author with the highest number of cited articles.Keyword analysis identified hypoxia,exercise,acclimatization,acute and chronic mountain sickness,pulmonary hypertension,metabolism,and echocardiography as the primary research hot research points and emerging directions in the study of the cardiovascular system at high altitude.CONCLUSION Over the past 32 years,research on the cardiovascular system in high-altitude regions has been steadily increasing.Future research in this field may focus on areas such as hypoxia adaptation,metabolism,and cardiopulmonary exercise.Strengthening interdisciplinary and multi-team collaborations will facilitate further exploration of the pathophysiological mechanisms underlying cardiovascular changes in high-altitude environments and provide a theoretical basis for standardized disease diagnosis and treatment.

Enhancing visual security: An image encryption scheme based on parallel compressive sensing and edge detection embedding

A novel image encryption scheme based on parallel compressive sensing and edge detection embedding technology is proposed to improve visual security. Firstly, the plain image is sparsely represented using the discrete wavelet transform.Then, the coefficient matrix is scrambled and compressed to obtain a size-reduced image using the Fisher–Yates shuffle and parallel compressive sensing. Subsequently, to increase the security of the proposed algorithm, the compressed image is re-encrypted through permutation and diffusion to obtain a noise-like secret image. Finally, an adaptive embedding method based on edge detection for different carrier images is proposed to generate a visually meaningful cipher image. To improve the plaintext sensitivity of the algorithm, the counter mode is combined with the hash function to generate keys for chaotic systems. Additionally, an effective permutation method is designed to scramble the pixels of the compressed image in the re-encryption stage. The simulation results and analyses demonstrate that the proposed algorithm performs well in terms of visual security and decryption quality.

Effect of low-degree astigmatism on the objective visual quality

AIM:To evaluate the effect of low-degree astigmatism on objective visual quality through the Optical Quality Analysis System(OQAS).METHODS:This study enrolled 46 participants(aged 23 to 30y,90 eyes)with normal or corrected-to-normal vision.The cylindrical lenses(0,0.5,0.75,1.0,and 1.25 D)were placed at the axial direction(180°,45°,90°,and 135°)in front of the eyes with the best correction to form 16 types of regular low-degree astigmatism.OQAS was used to detect the objective visual quality,recorded as the objective scattering index(OSI),OQAS values at contrasts of 100%,20%,and 9%predictive visual acuity(OV100%,OV20%,and OV9%),modulation transfer function cut-off(MTFcut-off)and Strehl ratio(SR).The mixed effect linear model was used to compare objective visual quality differences between groups and examine associations between astigmatic magnitude and objective visual quality parameters.RESULTS:Apparent negative relationships between the magnitude of low astigmatism and objective visual quality were observed.The increase of OSI per degree of astigmatism at 180°,45°,90°,and 135°axis were 0.38(95%CI:0.35,0.42),0.50(95%CI:0.46,0.53),0.49(95%CI:0.45,0.54)and 0.37(95%CI:0.34,0.41),respectively.The decrease of MTFcut-off per degree of astigmatism at 180°,45°,90°,and 135°axis were-10.30(95%CI:-11.43,-9.16),-12.73(95%CI:-13.62,-11.86),-12.75(95%CI:-13.79,-11.70),and-9.97(95%CI:-10.92,-9.03),respectively.At the same astigmatism degree,OSI at 45°and 90°axis were higher than that at 0°and 135°axis,while MTFcut-off were lower.CONCLUSION:Low astigmatism of only 0.50 D can significantly reduce the objective visual quality.

Changes in visual performance after implantation of different intraocular lenses

AIM:To evaluate the trending visual performance of different intraocular lenses(IOLs)over time after implantation.METHODS:Ninety-one patients received cataract surgery with implantations of monofocal(Mon)IOLs,segmental refractive(SegRef)IOLs,diffractive(Dif)IOLs,and extendeddepth-of-focus(EDoF)IOLs were included.The aberrations and optical quality collected with iTrace and OQAS within postoperative 6mo were followed and compared.RESULTS:Most of the visual parameters improved over the postoperative 6mo.The postoperative visual acuity(POVA)of the Mon IOL,SegRef IOL,and EDoF IOL groups achieved relative stability in earlier states compared with the Dif IOL group.Nevertheless,the overall visual performance of the 3 IOLs continued to upturn in small extents within the postoperative 6mo.The optical quality initially improved in the EDoF IOL group,then in the Mon IOL,SegRef IOL,and Dif IOL groups.POVA and objective visual performance of the Mon IOL and EDoF IOL groups,as well as POVA and visual quality of the Dif IOL group,improved in the postoperative 1mo and stabilized.Within the postoperative 6mo,gradual improvements were observed in the visual acuity and objective visual performance of the SegRef IOL group,as well as in the postoperative optical quality of the Dif IOL group.CONCLUSION:The visual performance is different among eyes implanted with different IOLs.The findings of the current study provide a potential reference for ophthalmologists to choose suitable IOLs for cataract patients in a personalized solution.

Fluorescent Double Network Hydrogels with Ionic Responsiveness and High Mechanical Properties for Visual Detection

We developed a fluorescent double network hydrogel with ionic responsiveness and high mechanical properties for visual detection.The nanocomposite hydrogel of laponite and polyacrylamide serves as the first network,while the ionic cross-linked hydrogel of terbium ions and sodium alginate serves as the second network.The double-network structure,the introduction of nanoparticles and the reversible ionic crosslinked interactions confer high mechanical properties to the hydrogel.Terbium ions are not only used as the ionic cross-linked points,but also used as green emitters to endow hydrogels with fluorescent properties.On the basis of the “antenna effect” of terbium ions and the ion exchange interaction,the fluorescence of the hydrogels can make selective responses to various ions(such as organic acid radical ions,transition metal ions) in aqueous solutions,which enables a convenient strategy for visual detection toward ions.Consequently,the fluorescent double network hydrogel fabricated in this study is promising for use in the field of visual sensor detection.

Importance-aware 3D volume visualization for medical content-based image retrieval-a preliminary study

Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based diagnosis,teaching,and research.Although the retrieval accuracy has largely improved,there has been limited development toward visualizing important image features that indicate the similarity of retrieved images.Despite the prevalence of 3D volumetric data in medical imaging such as computed tomography(CT),current CBIR systems still rely on 2D cross-sectional views for the visualization of retrieved images.Such 2D visualization requires users to browse through the image stacks to confirm the similarity of the retrieved images and often involves mental reconstruction of 3D information,including the size,shape,and spatial relations of multiple structures.This process is time-consuming and reliant on users'experience.Methods In this study,we proposed an importance-aware 3D volume visualization method.The rendering parameters were automatically optimized to maximize the visibility of important structures that were detected and prioritized in the retrieval process.We then integrated the proposed visualization into a CBIR system,thereby complementing the 2D cross-sectional views for relevance feedback and further analyses.Results Our preliminary results demonstrate that 3D visualization can provide additional information using multimodal positron emission tomography and computed tomography(PETCT)images of a non-small cell lung cancer dataset.

Mapping the global research landscape on nonalcoholic fatty liver disease and insulin resistance:A visualization and bibliometric study

BACKGROUND Nonalcoholic fatty liver disease(NAFLD)is a liver condition that is prevalent worldwide and associated with significant health risks and economic burdens.As it has been linked to insulin resistance(IR),this study aimed to perform a bibliometric analysis and visually represent the scientific literature on IR and NAFLD.AIM To map the research landscape to underscore critical areas of focus,influential studies,and future directions of NAFLD and IR.METHODS This study conducted a bibliometric analysis of the literature on IR and NAFLD indexed in the SciVerse Scopus database from 1999 to 2022.The search strategy used terms from the literature and medical subject headings,focusing on terms related to IR and NAFLD.VOSviewer software was used to visualize research trends,collaborations,and key thematic areas.The analysis examined publication type,annual research output,contributing countries and institutions,funding agencies,journal impact factors,citation patterns,and highly cited references.RESULTS This analysis identified 23124 documents on NAFLD,revealing a significant increase in the number of publications between 1999 and 2022.The search retrieved 715 papers on IR and NAFLD,including 573(80.14%)articles and 88(12.31%)reviews.The most productive countries were China(n=134;18.74%),the United States(n=122;17.06%),Italy(n=97;13.57%),and Japan(n=41;5.73%).The leading institutions included the Universitàdegli Studi di Torino,Italy(n=29;4.06%),and the Consiglio Nazionale delle Ricerche,Italy(n=19;2.66%).The top funding agencies were the National Institute of Diabetes and Digestive and Kidney Diseases in the United States(n=48;6.71%),and the National Natural Science Foundation of China(n=37;5.17%).The most active journals in this field were Hepatology(27 publications),the Journal of Hepatology(17 publications),and the Journal of Clinical Endocrinology and Metabolism(13 publications).The main research hotspots were“therapeutic approaches for IR and NAFLD”and“inflammatory and high-fat diet impacts on NAFLD”.CONCLUSION This is the first bibliometric analysis to examine the relationship between IR and NAFLD.In response to the escalating global health challenge of NAFLD,this research highlights an urgent need for a better understanding of this condition and for the development of intervention strategies.Policymakers need to prioritize and address the increasing prevalence of NAFLD.

Photographs and Cartoons: Differences in Interpretation of the Visual Semiotics

This study looks at the interaction between the process of intersemiosis and resemiosis in multimodality. The importance of both phases is widely acknowledged as part of the meaning making process but many practical studies focus on the first rather than the second. In particular this study looks at two groups of images about gender relations in Saudi Arabia following the post-2017 reforms of the male guardianship laws. One group are mostly made up of photographs and the second group of cartoons and posters. One important finding is that the latter tend to be less ambiguous in their semiotic structure than the former. In particular, there are instances in the first group where a standard study of intersemiosis indicates low modality but the image may be seen as inherently plausible by many observers. This suggests that while resemiosis can be applied to a single image it may be more appropriate as a tool when applied to an overall news article or set of images. In the same way that not all individual semiotic modes are complementary in how they build meaning, then it is possible for different images to be supportive, contradictory or unclear when studied in isolation.