Red Deer Optimization with Artificial Intelligence Enabled Image Captioning System for Visually Impaired People

The problem of producing a natural language description of an image for describing the visual content has gained more attention in natural language processing(NLP)and computer vision(CV).It can be driven by applications like image retrieval or indexing,virtual assistants,image understanding,and support of visually impaired people(VIP).Though the VIP uses other senses,touch and hearing,for recognizing objects and events,the quality of life of those persons is lower than the standard level.Automatic Image captioning generates captions that will be read loudly to the VIP,thereby realizing matters happening around them.This article introduces a Red Deer Optimization with Artificial Intelligence Enabled Image Captioning System(RDOAI-ICS)for Visually Impaired People.The presented RDOAI-ICS technique aids in generating image captions for VIPs.The presented RDOAIICS technique utilizes a neural architectural search network(NASNet)model to produce image representations.Besides,the RDOAI-ICS technique uses the radial basis function neural network(RBFNN)method to generate a textual description.To enhance the performance of the RDOAI-ICS method,the parameter optimization process takes place using the RDO algorithm for NasNet and the butterfly optimization algorithm(BOA)for the RBFNN model,showing the novelty of the work.The experimental evaluation of the RDOAI-ICS method can be tested using a benchmark dataset.The outcomes show the enhancements of the RDOAI-ICS method over other recent Image captioning approaches.

IoT-Driven Optimal Lightweight RetinaNet-Based Object Detection for Visually Impaired People

Visual impairment is one of the major problems among people of all age groups across the globe.Visually Impaired Persons(VIPs)require help from others to carry out their day-to-day tasks.Since they experience several problems in their daily lives,technical intervention can help them resolve the challenges.In this background,an automatic object detection tool is the need of the hour to empower VIPs with safe navigation.The recent advances in the Internet of Things(IoT)and Deep Learning(DL)techniques make it possible.The current study proposes IoT-assisted Transient Search Optimization with a Lightweight RetinaNetbased object detection(TSOLWR-ODVIP)model to help VIPs.The primary aim of the presented TSOLWR-ODVIP technique is to identify different objects surrounding VIPs and to convey the information via audio message to them.For data acquisition,IoT devices are used in this study.Then,the Lightweight RetinaNet(LWR)model is applied to detect objects accurately.Next,the TSO algorithm is employed for fine-tuning the hyperparameters involved in the LWR model.Finally,the Long Short-Term Memory(LSTM)model is exploited for classifying objects.The performance of the proposed TSOLWR-ODVIP technique was evaluated using a set of objects,and the results were examined under distinct aspects.The comparison study outcomes confirmed that the TSOLWR-ODVIP model could effectually detect and classify the objects,enhancing the quality of life of VIPs.

Deep Learning Based Audio Assistive System for Visually Impaired People

Vision impairment is a latent problem that affects numerous people across the globe.Technological advancements,particularly the rise of computer processing abilities like Deep Learning(DL)models and emergence of wearables pave a way for assisting visually-impaired persons.The models developed earlier specifically for visually-impaired people work effectually on single object detection in unconstrained environment.But,in real-time scenarios,these systems are inconsistent in providing effective guidance for visually-impaired people.In addition to object detection,extra information about the location of objects in the scene is essential for visually-impaired people.Keeping this in mind,the current research work presents an Efficient Object Detection Model with Audio Assistive System(EODM-AAS)using DL-based YOLO v3 model for visually-impaired people.The aim of the research article is to construct a model that can provide a detailed description of the objects around visually-impaired people.The presented model involves a DL-based YOLO v3 model for multi-label object detection.Besides,the presented model determines the position of object in the scene and finally generates an audio signal to notify the visually-impaired people.In order to validate the detection performance of the presented method,a detailed simulation analysis was conducted on four datasets.The simulation results established that the presented model produces effectual outcome over existing methods.

Vibration-Based Pattern Password Approach for Visually Impaired People

The pattern password method is amongst the most attractive authentication methods and involves drawing a pattern;this is seen as easier than typing a password.However,since people with visual impairments have been increasing their usage of smart devices,this method is inaccessible for them as it requires them to select points on the touch screen.Therefore,this paper exploits the haptic technology by introducing a vibration-based pattern password approach in which the vibration feedback plays an important role.This approach allows visually impaired people to use a pattern password through two developed vibration feedback:pulses,which are counted by the user,and duration,which has to be estimated by the user.In order to make the proposed approach capable to prevent shoulder-surfing attacks,a camouflage pattern approach is applied.An experimental study is conducted to evaluate the proposed approach,the results of which show that the vibration pulses feedback is usable and resistant to shoulder-surfing attacks.

Fuzzy Logic Based Perceptual Image Hashing Algorithm in Malaysian Banknotes Detection System for the Visually Impaired

Visually impaired persons have difficulty in business that dealing with banknote.This paper proposed a Malaysian banknotes detection system using image processing technology and fuzzy logic algorithm for the visually impaired.The Malaysian banknote reader will first capture the inserted banknote image,sending it to the cloud server for image processing via Wi-Fi medium.The cloud server is established to receive the banknote image sending from the banknote reader,processing them using perceptual hashing based image searching and fuzzy logic algorithm,then return the detected banknote’s value results back to the banknote reader.The banknote reader will display the results in terms of voice message played on the mini speaker attached on it,to allow visually impaired persons knowing the banknote’s value.This hardware mechanism reduces the size and costs for the banknote reader carried by the visually impaired persons.Experimental results showed that this Malaysian banknotes detection system reached an accuracy beyond 95%by running test on 600 different worn,torn and new Malaysian banknotes.After the banknote image being taken by the banknote reader’s camera,the system able to detect the banknote value in about 480 mili-seconds to 560 mili-seconds for a single sided banknote recognition.The banknotes detection speed was also comparable with human observers reading banknotes,with the response of 1.0908 second per banknote slight difference reading time.The IoT and image processing concepts were successfully blended and it provides an alternative to aid the visually impaired person their daily business transaction activities in a better way.

Makeup Activates Brain Activity in Visually Impaired Persons: Evaluation by Functional Magnetic Resonance Imaging

Cosmetics are used to improve physical appearance, but the benefits may be limited to people without visual impairment. The importance of attractiveness among blind persons has not been assessed. We investigated the influence of makeup on brain activity of blind persons using functional magnetic resonance imaging (fMRI). Participants were 7 blind females (BFs) who learned to fully apply makeup and 9 mostly age-matched normally sighted females (NSFs). Brain activity was measured using fMRI before and after application of makeup and during a makeup image task in each state. In the default mode network at rest, there was no difference between the BFs and NSFs. However, a lateral visual network to the opposite side was observed in the NSFs, whereas no such network was noted in the BFs. A weak network was noted in the BFs in the occipital fusiform gyrus and temporal occipital fusiform cortex, and an extensive visual area network defect was noted. Also, activity after makeup application was significantly higher in the nucleus accumbens, pallidum, and hippocampus. Activity in the right middle cingulate gyrus, right cerebral white matter, and right anterior cingulate gyrus was higher before makeup in both BFs and NSFs, and the activity was significantly higher and more extensive in the BFs. In conclusion, applying makeup is a personally rewarding activity, even for BFs, as it strongly activates the reward system and the reward/memory system network, even in the absence of a visual area network.

A survey of the information needs of visually impaired library users

Purpose:The research aims to investigate the information needs of visually impaired library users in China in order to increase our understanding of these users and help the Chinese public libraries improve their services for them.Design/methodology/approach:A questionnaire survey was used to study the library users’ information needs.Eleven large public libraries in different areas of China,which were pioneers in implementing services for visually impaired people,were chosen to conduct the survey.Data analysis was based on 97 valid questionnaires retrieved.Findings:Radio and television were still the preferred sources of information for visually impaired users.In information seeking,they had a strong preference for obtaining information in the most convenient way,and accessing a vast amount of information,which was updated quickly.They paid more attention to the information closely related to their work and life.Their purposes of seeking information were mainly for learning,relaxation and intercommunication.Visually impaired users felt some barriers in their access to library services such as a lack of time or a sighted companion who can come along for the trip to the library.Moreover,it was difficult for them to use the Internet to search for information,because many websites do not support the auxiliary software designed especially for visually impaired users or the websites offer only a paid subscriber service.Research limitations:A majority of the respondents were young and middle-aged people and engaged in work.The sample size needs to be enlarged,and different groups of users such as old people and students should be included to yield more useful results.Practical implications:The survey results provide insights into the information needs of the Chinese visually impaired library users.Meanwhile,the research can serve as a reference source for the future studies of the service for visually impaired library users.Originality/value:So far,few studies were conducted to investigate the information needs of visually impaired library users in China.

Educational Assistance Through Modeling in Tsukuba University of Technology-Professional Education for the Hearing or Visually Impaired

The National University Corporation Tsukuba University of Technology（NTUT） is the only institute of higher education for the hearing and the visually impaired in Japan. In our university, hearing or visually impaired students are studying to be technicians after they graduate, toward social independence. From previous experience of higher education for students with disabilities, effects are increased when modeling is used by the teachers involved in professional education. In the Mechanical Engineering Course, we are using modeling, to match the drawing and shape for beginning students. It includes support for enhancing one＇s view, and how to draw out the ability of mechanical engineering students for the basics. For students to study Mechanical Design and Drawing, Modeling of Gear Pump, Jack and Globe Valve are easily shown through drawings and the operation of each mechanism through sample drawings in the textbook. It is possible to make an opportunity to think about the machine mechanism. It will be shown by students＇ works. The assembling of the model triggers the need for form accuracy by making a function, and improves the quality of learning. It is possible that a three-dimensional molding machine can be produced through experiential learning by the model, and modeling with the dimension numerical data. Moreover, it is also embodied in a three-dimensional modeling which results in the image processing programming created. Confirming the improvement of the program through the shape with the quality. In the Department of Synthetic Design, students have chances to realize and self-evaluate from the design of the lamp shade with a complicated shape. In the Faculty of Health Science from Department of Health, high quality teaching of visually-impaired students through the use of bone model teaching materials has become possible in the medical-related courses.

An enhanced functional ability questionnaire(faVIQ) to measure the impact of rehabilitation services on the visually impaired

AIM: To develop a short,enhanced functional ability Quality of Vision(faVIQ) instrument based on previous questionnaires employing comprehensive modern statistical techniques to ensure the use of an appropriate response scale,items and scoring of the visual related difficulties experienced by patients with visual impairment. · METHODS: Items in current quality-of-life questionnaires for the visually impaired were refined by a multi-professional group and visually impaired focus groups. The resulting 76 items were completed by 293 visually impaired patients with stable vision on two occasions separated by a month. The faVIQ scores of 75 patients with no ocular pathology were compared to 75 age and gender matched patients with visual impairment. ·RESULTS: Rasch analysis reduced the faVIQ items to 27. Correlation to standard visual metrics was moderate(r =0.32-0.46) and to the NEI-VFQ was 0.48. The faVIQ was able to clearly discriminate between age and gender matched populations with no ocular pathology and visual impairment with an index of 0.983 and 95% sensitivity and 95% specificity using a cut off of 29.·CONCLUSION: The faVIQ allows sensitive assessment of quality-of-life in the visually impaired and should support studies which evaluate the effectiveness of low vision rehabilitation services.

Development of Mobile App to Support the Mobility of Visually Impaired People

In 2017,it was estimated that the number of persons of all ages visually affected would be two hundred and eighty-five million,of which thirty-nine million are blind.There are several innovative technical solutions available to facilitate the movement of these people.The next big challenge for technical people is to give cost-effective solutions.One of the challenges for people with visual impairments is navigating safely,recognizing obstacles,and moving freely between locations in unfamiliar environments.A new mobile application solution is developed,and the application can be installed in android mobile.The application will visualize the environment with portable cameras and persons with visual impairment directly to the environment.The designed system mainly uses the YOLO3 program to identify and locate the distance between the objects and the camera.Furthermore,it determines the direction of the object.Finally,the system will give the voice command to teach/inform the visually impaired people to navigate the environment.It is a novel work at the global level.The proposed approach is cost-effective and affordable to all strata of society.

Assisting Visually Impaired People to Acquire Targets on a Large Wall-Mounted Display

Large displays have become ubiquitous in our everyday lives, but these displays are designed for sighted people.This paper addresses the need for visually impaired people to access targets on large wall-mounted displays. We developed an assistive interface which exploits mid-air gesture input and haptic feedback, and examined its potential for pointing and steering tasks in human computer interaction（HCI）. In two experiments, blind and blindfolded users performed target acquisition tasks using mid-air gestures and two different kinds of feedback（i.e., haptic feedback and audio feedback）. Our results show that participants perform faster in Fitts＇ law pointing tasks using the haptic feedback interface rather than the audio feedback interface. Furthermore, a regression analysis between movement time（MT） and the index of difficulty（ID）demonstrates that the Fitts＇ law model and the steering law model are both effective for the evaluation of assistive interfaces for the blind. Our work and findings will serve as an initial step to assist visually impaired people to easily access required information on large public displays using haptic interfaces.

Voices for the Visually Impaired

The Mind’s Eye provides soundtracks to normal pleasures for the blind For sightless Liu Jianwen, much of the joy in life is found in an old-style Chinese courtyard compound.

Prevalence of visual impairment and estimation of refractive errors among school children in Kakamega,Kenya

AIM:To investigate the prevalence of visual impairment(VI)and provide an estimation of uncorrected refractive errors in school-aged children,conducted by optometry students as a community service.METHODS:The study was cross-sectional.Totally 3343 participants were included in the study.The initial examination involved assessing the uncorrected distance visual acuity(UDVA)and visual acuity(VA)while using a+2.00 D lens.The inclusion criteria for a subsequent comprehensive cycloplegic eye examination,performed by an optometrist,were as follows:a UDVA<0.6 decimal(0.20 logMAR)and/or a VA with+2.00 D≥0.8 decimal(0.96 logMAR).RESULTS:The sample had a mean age of 10.92±2.13y(range 4 to 17y),and 51.3%of the children were female(n=1715).The majority of the children(89.7%)fell within the age range of 8 to 14y.Among the ethnic groups,the highest representation was from the Luhya group(60.6%)followed by Luo(20.4%).Mean logMAR UDVA choosing the best eye for each student was 0.29±0.17(range 1.70 to 0.22).Out of the total,246 participants(7.4%)had a full eye examination.The estimated prevalence of myopia(defined as spherical equivalent≤-0.5 D)was found to be 1.45%of the total sample.While around 0.18%of the total sample had hyperopia value exceeding+1.75 D.Refractive astigmatism(cil<-0.75 D)was found in 0.21%(7/3343)of the children.The VI prevalence was 1.26%of the total sample.Among our cases of VI,76.2%could be attributed to uncorrected refractive error.Amblyopia was detected in 0.66%(22/3343)of the screened children.There was no statistically significant correlation observed between age or gender and refractive values.CONCLUSION:The primary cause of VI is determined to be uncorrected refractive errors,with myopia being the most prevalent refractive error observed.These findings underscore the significance of early identification and correction of refractive errors in school-aged children as a means to alleviate the impact of VI.

Uncorrected refractive errors are important causes of avoidable visual impairment in Hungary: re-evaluation of two existing national data sets

·AIM: To review existing data for the prevalence of corrected, uncorrected, and inadequately corrected refractive errors and spectacle wear in Hungary.·METHODS: Data from two nationwide cross-sectional studies were analysed. The Rapid Assessment of Avoidable Blindness study collected population-based representative national data on the prevalence of visual impairment due to uncorrected refractive errors and spectacle coverage in 3523 people aged ≥50y(Group I). The Comprehensive Health Test Program of Hungary provided data on the use of spectacles in 80 290 people aged ≥18y(Group Ⅱ).·RESULTS: In Group I, almost half of the survey population showed refractive errors for distant vision, about 10% of which were uncorrected(3.2% of all male participants and 5.0% of females). The distance spectacle coverage was 90.7%(91.9% in males;90.2% in females). The proportion of inadequate distance spectacles was found to be 33.1%. Uncorrected presbyopia was found in 15.7% of participants. In all age groups(Group Ⅱ), 65.4% of females and 56.0% of males used distance spectacles,and approximately 28.9% of these spectacles were found to be inappropriate for dioptric power(with 0.5 dioptres or more). The prevalence of inaccurate distance spectacles was significantly higher in older age groups(71y and above) in both sexes.·CONCLUSION: According to this population-based data, uncorrected refractive errors are not rare in Hungary. Despite recent national initiatives, fur ther steps are required to reduce uncorrected refractive errors and associated negative effects on vision, such as avoidable visual impairment.

Ocular manifestations and quality of life in patients after hematopoietic stem cell transplantation

AIM:To explore the relationship between ocular and systemic conditions and the impact of ocular complications on the quality of life(QOL)in patients after allogeneic hematopoietic stem cell transplantation(ALLO-HSCT).METHODS:Forty-four patients with severe hematopoietic disease were enrolled after ALLO-HSCT at our center from July 2018 to October 2020.They completed two questionnaires:the Ocular Surface Disease Index(OSDI)and the quality-of-life scale for Chinese patients with visual impairment(SQOL-DV1).Ocular conditions and systemic conditions were also assessed.RESULTS:Eye damage was correlated with total bilirubin(P=0.005),and gamma-glutamyl transferase(GGT)(P=0.021).There was no significant correlation between the overall QOL score and OSDI(P=0.8226)or SQOLDV1(P=0.9526)scores.The OSDI and the overall QOL score were not correlated with ocular conditions,including best-corrected visual acuity(BCVA),intraocular pressure,Schirmer tear test II,sodium fluorescein staining,tear film breakup time,and tear meniscus height.SQOLDV1 was correlated with BCVA(P=0.0007),sodium fluorescein staining(P=0.007),and tear film breakup time(P=0.0146).CONCLUSION:In some patients,early ocular symptoms are not evident after ALLO-HSCT,while ocular surface complications can be observed after a comprehensive ophthalmological examination.Especially for those with elevated total bilirubin or GGT,regular ophthalmic follow-up visits are essential to diagnose and treat ocular graft versus host disease(o GVHD),especially for patients with elevated total bilirubin or GGT.

Deep learning-based automated grading of visual impairment in cataract patients using fundus images

Cataract is the leading cause of visual impairment globally.The scarcity and uneven distribution of ophthalmologists seriously hinder early visual impairment grading for cataract patients in the clin-ic.In this study,a deep learning-based automated grading system of visual impairment in cataract patients is proposed using a multi-scale efficient channel attention convolutional neural network(MECA_CNN).First,the efficient channel attention mechanism is applied in the MECA_CNN to extract multi-scale features of fundus images,which can effectively focus on lesion-related regions.Then,the asymmetric convolutional modules are embedded in the residual unit to reduce the infor-mation loss of fine-grained features in fundus images.In addition,the asymmetric loss function is applied to address the problem of a higher false-negative rate and weak generalization ability caused by the imbalanced dataset.A total of 7299 fundus images derived from two clinical centers are em-ployed to develop and evaluate the MECA_CNN for identifying mild visual impairment caused by cataract(MVICC),moderate to severe visual impairment caused by cataract(MSVICC),and nor-mal sample.The experimental results demonstrate that the MECA_CNN provides clinically meaning-ful performance for visual impairment grading in the internal test dataset:MVICC(accuracy,sensi-tivity,and specificity;91.3%,89.9%,and 92%),MSVICC(93.2%,78.5%,and 96.7%),and normal sample(98.1%,98.0%,and 98.1%).The comparable performance in the external test dataset is achieved,further verifying the effectiveness and generalizability of the MECA_CNN model.This study provides a deep learning-based practical system for the automated grading of visu-al impairment in cataract patients,facilitating the formulation of treatment strategies in a timely man-ner and improving patients’vision prognosis.

Inclusive Architecture:Landscape Codesign in Children’s Playgrounds

Children’s playgrounds are open spaces,the basis for children’s recreation,important for the inclusion and mobility of visually impaired children in the social environment,through inclusive urban facilities that stimulate new experiences for their cognitive development.In this context,the use of co-design with visually impaired people,in the design processes of children’s playgrounds,assumes an importance for an inclusive project based on their experiences.Thus,it aimed to promote a project together,to provide more comfort and safety to users.It presents as main results as better colors,materials and types of toys for children with visual impairment to be competent in a playground including from the application of methods,tools and resources in the co-design process.

Model of Verbal Communication with Blind Patient:Application in Nursing Appointment

It was aimed at validating the applicability of the Model of Verbal Communication with blind people in nursing appointment in the stages of the nursing process. A methodology of quantitative study was used with 30 nurses and 30 blind people who participated in the study, divided in control and experimental groups. 30 nursing appointments took place;they were recorded and analyzed by three judges. The experimental group had excellent performance in following protocol (95.6%);taking notes informing the reason for silence (93.4%);and avoiding long silence (100%). In interventions, it presented excellence in all the items, in the evaluation stage, there were no bad/terrible actions. In none of the actions the control group presented better performance than the experimental one. The use of the Model is recommended in nursing appointment with blind patient.

Open globe injury in Hospital Universiti Sains Malaysia- a 10-year review

AIM:To identify the aetiology of open globe injuries at Hospital Universiti Sains Malaysia over a period of 10y and the prognostic factors for visual outcome.METHODS:Retrospective review of medical records of open globe injury cases that presented from January2000 to December 2009.Classification of open globe injury was based on the Birmingham Eye Trauma Terminology(BETT).Records were obtained with hospital permission via the in-house electronic patient management system,and the case notes of all patients with a diagnosis of open globe injury were scrutinised.Patients with prior ocular trauma,pre-existing ocular conditions affecting the visual acuity,contrast sensitivity,central vision or corneal thickness,as well as those with a history of previous intraocular or refractive surgery were excluded.Analysis of data was with SPSS version20.0.Ordinal logistic regression analysis was used to examine the association between prognostic factors and visual outcome.RESULTS:This study involved 220 patients(n=222eyes).The most common place of injury was the home(51.8%),followed by the workplace(23.4%).Among children aged less than 16y of age,domestic-related injury was the predominant cause(54.6%),while in those aged 16y and above,occupational injuries were the most common cause(40.0%).Most eyes(76.5%)had an initial visual acuity worse than 3/60,and in half of these,the visual acuity improved.The visual outcome was found to be significantly associated with the initial visual acuity(P【0.005),posterior extent of wound(P【0.001),length of wound(P【0.001),presence of hyphaema(P【0.001)and presence of vitreous prolapse(P【0.005).CONCLUSION:The most common causes of open globe injury are domestic accidents and occupational injuries.Significant prognostic factors for final visual outcome in patients with open globe injury are initial visual acuity,posterior extent and length of wound,presence of hyphaema and presence of vitreous prolapse.Awareness of the factors predicting a poor visual outcome may be helpful during counselling of patients with open globe injuries.

Population-based survey of prevalence,causes,and risk factors for blindness and visual impairment in an aging Chinese metropolitan population

AIM： To assess the prevalence, causes, and risk factors for blindness and visual impairment among elderly （〉60 years of age） Chinese people in a metropolitan area of Shanghai, China. METHODS： Random cluster sampling was conducted to identify participants among residents ≥60 years of age living in the Xietu Block, Xuhui District, Shanghai, China. Presenting visual acuity （PVA） and best-corrected visual acuity （BCVA） were checked by the Early Treatment Diabetic Retinopathy Study （ETDRS） visual chart. All eligible participants underwent a comprehensive eye examination. Blindness and visual impairment were defined according to World Health Organization （WHO） criteria. RESULTS： A total of 4190 persons （1688 men and 2502 women） participated in the study, and the response rate was 91.1%. Based on PVA, the prevalence of blindness was 1.1% and that of visual impairment was 7.6%. Based on BCVA, the prevalence of blindness and visual impairment decreased to 0.9% and 3.9%, respectively. Older （〉80 years of age） women, with low educational levels and smoking habits, exhibited a significantly greater chance for blindness and visual impairment than did those with high educational levels and no smoking habits （P〈0.05）. Based on PVA and BCVA, the main causes of blindness were cataract, myopic maculopathy, and age-related macular degeneration （AMD）. CONCLUSION： Our findings help to identify the population in need of intervention, to highlight the need for additional eye healthcare services in urban China.