Deep Learning Based Audio Assistive System for Visually Impaired People

Vision impairment is a latent problem that affects numerous people across the globe.Technological advancements,particularly the rise of computer processing abilities like Deep Learning(DL)models and emergence of wearables pave a way for assisting visually-impaired persons.The models developed earlier specifically for visually-impaired people work effectually on single object detection in unconstrained environment.But,in real-time scenarios,these systems are inconsistent in providing effective guidance for visually-impaired people.In addition to object detection,extra information about the location of objects in the scene is essential for visually-impaired people.Keeping this in mind,the current research work presents an Efficient Object Detection Model with Audio Assistive System(EODM-AAS)using DL-based YOLO v3 model for visually-impaired people.The aim of the research article is to construct a model that can provide a detailed description of the objects around visually-impaired people.The presented model involves a DL-based YOLO v3 model for multi-label object detection.Besides,the presented model determines the position of object in the scene and finally generates an audio signal to notify the visually-impaired people.In order to validate the detection performance of the presented method,a detailed simulation analysis was conducted on four datasets.The simulation results established that the presented model produces effectual outcome over existing methods.

Red Deer Optimization with Artificial Intelligence Enabled Image Captioning System for Visually Impaired People

The problem of producing a natural language description of an image for describing the visual content has gained more attention in natural language processing(NLP)and computer vision(CV).It can be driven by applications like image retrieval or indexing,virtual assistants,image understanding,and support of visually impaired people(VIP).Though the VIP uses other senses,touch and hearing,for recognizing objects and events,the quality of life of those persons is lower than the standard level.Automatic Image captioning generates captions that will be read loudly to the VIP,thereby realizing matters happening around them.This article introduces a Red Deer Optimization with Artificial Intelligence Enabled Image Captioning System(RDOAI-ICS)for Visually Impaired People.The presented RDOAI-ICS technique aids in generating image captions for VIPs.The presented RDOAIICS technique utilizes a neural architectural search network(NASNet)model to produce image representations.Besides,the RDOAI-ICS technique uses the radial basis function neural network(RBFNN)method to generate a textual description.To enhance the performance of the RDOAI-ICS method,the parameter optimization process takes place using the RDO algorithm for NasNet and the butterfly optimization algorithm(BOA)for the RBFNN model,showing the novelty of the work.The experimental evaluation of the RDOAI-ICS method can be tested using a benchmark dataset.The outcomes show the enhancements of the RDOAI-ICS method over other recent Image captioning approaches.

IoT-Driven Optimal Lightweight RetinaNet-Based Object Detection for Visually Impaired People

Visual impairment is one of the major problems among people of all age groups across the globe.Visually Impaired Persons(VIPs)require help from others to carry out their day-to-day tasks.Since they experience several problems in their daily lives,technical intervention can help them resolve the challenges.In this background,an automatic object detection tool is the need of the hour to empower VIPs with safe navigation.The recent advances in the Internet of Things(IoT)and Deep Learning(DL)techniques make it possible.The current study proposes IoT-assisted Transient Search Optimization with a Lightweight RetinaNetbased object detection(TSOLWR-ODVIP)model to help VIPs.The primary aim of the presented TSOLWR-ODVIP technique is to identify different objects surrounding VIPs and to convey the information via audio message to them.For data acquisition,IoT devices are used in this study.Then,the Lightweight RetinaNet(LWR)model is applied to detect objects accurately.Next,the TSO algorithm is employed for fine-tuning the hyperparameters involved in the LWR model.Finally,the Long Short-Term Memory(LSTM)model is exploited for classifying objects.The performance of the proposed TSOLWR-ODVIP technique was evaluated using a set of objects,and the results were examined under distinct aspects.The comparison study outcomes confirmed that the TSOLWR-ODVIP model could effectually detect and classify the objects,enhancing the quality of life of VIPs.

Vibration-Based Pattern Password Approach for Visually Impaired People

The pattern password method is amongst the most attractive authentication methods and involves drawing a pattern;this is seen as easier than typing a password.However,since people with visual impairments have been increasing their usage of smart devices,this method is inaccessible for them as it requires them to select points on the touch screen.Therefore,this paper exploits the haptic technology by introducing a vibration-based pattern password approach in which the vibration feedback plays an important role.This approach allows visually impaired people to use a pattern password through two developed vibration feedback:pulses,which are counted by the user,and duration,which has to be estimated by the user.In order to make the proposed approach capable to prevent shoulder-surfing attacks,a camouflage pattern approach is applied.An experimental study is conducted to evaluate the proposed approach,the results of which show that the vibration pulses feedback is usable and resistant to shoulder-surfing attacks.

Study on Accessible Long-Term Care Mobile Application for Visually Impaired Users

A result revealed by the Department of Statistics, 29,000 elderly people have registered for Visually Impaired Card in 2014, which was 51.2% of all visually impaired people. With annual growth rate of 1.56%, this number increased yearly by 1,100 people. According to WHO, 285 million people worldwide were estimated to be visually impaired, which is 4.24% of overall population in 2012. From age distribution point of view, most visually impaired people, accounted for 2.76% of overall population, were above age 50. In average, there are 7 visually impaired people in every 100 people above 50 years old. In Taiwan, 549,000 people over age 50 are estimated to be visually impaired. Therefore we expect there is a large amount of visually impaired people. The main purpose of this research is to collect adaptability information on the cognitive model of senior visually impaired people on their work status, social participation status, and leisure activities via questionnaire survey. Furthermore, descriptive video service is used to as an accessible long-term care application for visually impaired senior users. To solve disability circumstances and improve home care quality through visually impaired APP POe （proof-of-concept）. The result of this research will serve as an important basis for other researches in related study field, a reference for practice application. As a result in encouraging profit-seeking enterprises design a user oriented products. And even be an opening for mobile accessibility services benchmark on technology social care for disability and senior users.

Fuzzy Logic Based Perceptual Image Hashing Algorithm in Malaysian Banknotes Detection System for the Visually Impaired

Visually impaired persons have difficulty in business that dealing with banknote.This paper proposed a Malaysian banknotes detection system using image processing technology and fuzzy logic algorithm for the visually impaired.The Malaysian banknote reader will first capture the inserted banknote image,sending it to the cloud server for image processing via Wi-Fi medium.The cloud server is established to receive the banknote image sending from the banknote reader,processing them using perceptual hashing based image searching and fuzzy logic algorithm,then return the detected banknote’s value results back to the banknote reader.The banknote reader will display the results in terms of voice message played on the mini speaker attached on it,to allow visually impaired persons knowing the banknote’s value.This hardware mechanism reduces the size and costs for the banknote reader carried by the visually impaired persons.Experimental results showed that this Malaysian banknotes detection system reached an accuracy beyond 95%by running test on 600 different worn,torn and new Malaysian banknotes.After the banknote image being taken by the banknote reader’s camera,the system able to detect the banknote value in about 480 mili-seconds to 560 mili-seconds for a single sided banknote recognition.The banknotes detection speed was also comparable with human observers reading banknotes,with the response of 1.0908 second per banknote slight difference reading time.The IoT and image processing concepts were successfully blended and it provides an alternative to aid the visually impaired person their daily business transaction activities in a better way.

Makeup Activates Brain Activity in Visually Impaired Persons: Evaluation by Functional Magnetic Resonance Imaging

Cosmetics are used to improve physical appearance, but the benefits may be limited to people without visual impairment. The importance of attractiveness among blind persons has not been assessed. We investigated the influence of makeup on brain activity of blind persons using functional magnetic resonance imaging (fMRI). Participants were 7 blind females (BFs) who learned to fully apply makeup and 9 mostly age-matched normally sighted females (NSFs). Brain activity was measured using fMRI before and after application of makeup and during a makeup image task in each state. In the default mode network at rest, there was no difference between the BFs and NSFs. However, a lateral visual network to the opposite side was observed in the NSFs, whereas no such network was noted in the BFs. A weak network was noted in the BFs in the occipital fusiform gyrus and temporal occipital fusiform cortex, and an extensive visual area network defect was noted. Also, activity after makeup application was significantly higher in the nucleus accumbens, pallidum, and hippocampus. Activity in the right middle cingulate gyrus, right cerebral white matter, and right anterior cingulate gyrus was higher before makeup in both BFs and NSFs, and the activity was significantly higher and more extensive in the BFs. In conclusion, applying makeup is a personally rewarding activity, even for BFs, as it strongly activates the reward system and the reward/memory system network, even in the absence of a visual area network.

A survey of the information needs of visually impaired library users

Purpose:The research aims to investigate the information needs of visually impaired library users in China in order to increase our understanding of these users and help the Chinese public libraries improve their services for them.Design/methodology/approach:A questionnaire survey was used to study the library users’ information needs.Eleven large public libraries in different areas of China,which were pioneers in implementing services for visually impaired people,were chosen to conduct the survey.Data analysis was based on 97 valid questionnaires retrieved.Findings:Radio and television were still the preferred sources of information for visually impaired users.In information seeking,they had a strong preference for obtaining information in the most convenient way,and accessing a vast amount of information,which was updated quickly.They paid more attention to the information closely related to their work and life.Their purposes of seeking information were mainly for learning,relaxation and intercommunication.Visually impaired users felt some barriers in their access to library services such as a lack of time or a sighted companion who can come along for the trip to the library.Moreover,it was difficult for them to use the Internet to search for information,because many websites do not support the auxiliary software designed especially for visually impaired users or the websites offer only a paid subscriber service.Research limitations:A majority of the respondents were young and middle-aged people and engaged in work.The sample size needs to be enlarged,and different groups of users such as old people and students should be included to yield more useful results.Practical implications:The survey results provide insights into the information needs of the Chinese visually impaired library users.Meanwhile,the research can serve as a reference source for the future studies of the service for visually impaired library users.Originality/value:So far,few studies were conducted to investigate the information needs of visually impaired library users in China.

Educational Assistance Through Modeling in Tsukuba University of Technology-Professional Education for the Hearing or Visually Impaired

The National University Corporation Tsukuba University of Technology（NTUT） is the only institute of higher education for the hearing and the visually impaired in Japan. In our university, hearing or visually impaired students are studying to be technicians after they graduate, toward social independence. From previous experience of higher education for students with disabilities, effects are increased when modeling is used by the teachers involved in professional education. In the Mechanical Engineering Course, we are using modeling, to match the drawing and shape for beginning students. It includes support for enhancing one＇s view, and how to draw out the ability of mechanical engineering students for the basics. For students to study Mechanical Design and Drawing, Modeling of Gear Pump, Jack and Globe Valve are easily shown through drawings and the operation of each mechanism through sample drawings in the textbook. It is possible to make an opportunity to think about the machine mechanism. It will be shown by students＇ works. The assembling of the model triggers the need for form accuracy by making a function, and improves the quality of learning. It is possible that a three-dimensional molding machine can be produced through experiential learning by the model, and modeling with the dimension numerical data. Moreover, it is also embodied in a three-dimensional modeling which results in the image processing programming created. Confirming the improvement of the program through the shape with the quality. In the Department of Synthetic Design, students have chances to realize and self-evaluate from the design of the lamp shade with a complicated shape. In the Faculty of Health Science from Department of Health, high quality teaching of visually-impaired students through the use of bone model teaching materials has become possible in the medical-related courses.

An enhanced functional ability questionnaire(faVIQ) to measure the impact of rehabilitation services on the visually impaired

AIM: To develop a short,enhanced functional ability Quality of Vision(faVIQ) instrument based on previous questionnaires employing comprehensive modern statistical techniques to ensure the use of an appropriate response scale,items and scoring of the visual related difficulties experienced by patients with visual impairment. · METHODS: Items in current quality-of-life questionnaires for the visually impaired were refined by a multi-professional group and visually impaired focus groups. The resulting 76 items were completed by 293 visually impaired patients with stable vision on two occasions separated by a month. The faVIQ scores of 75 patients with no ocular pathology were compared to 75 age and gender matched patients with visual impairment. ·RESULTS: Rasch analysis reduced the faVIQ items to 27. Correlation to standard visual metrics was moderate(r =0.32-0.46) and to the NEI-VFQ was 0.48. The faVIQ was able to clearly discriminate between age and gender matched populations with no ocular pathology and visual impairment with an index of 0.983 and 95% sensitivity and 95% specificity using a cut off of 29.·CONCLUSION: The faVIQ allows sensitive assessment of quality-of-life in the visually impaired and should support studies which evaluate the effectiveness of low vision rehabilitation services.

Development of Mobile App to Support the Mobility of Visually Impaired People

In 2017,it was estimated that the number of persons of all ages visually affected would be two hundred and eighty-five million,of which thirty-nine million are blind.There are several innovative technical solutions available to facilitate the movement of these people.The next big challenge for technical people is to give cost-effective solutions.One of the challenges for people with visual impairments is navigating safely,recognizing obstacles,and moving freely between locations in unfamiliar environments.A new mobile application solution is developed,and the application can be installed in android mobile.The application will visualize the environment with portable cameras and persons with visual impairment directly to the environment.The designed system mainly uses the YOLO3 program to identify and locate the distance between the objects and the camera.Furthermore,it determines the direction of the object.Finally,the system will give the voice command to teach/inform the visually impaired people to navigate the environment.It is a novel work at the global level.The proposed approach is cost-effective and affordable to all strata of society.

Assisting Visually Impaired People to Acquire Targets on a Large Wall-Mounted Display

Large displays have become ubiquitous in our everyday lives, but these displays are designed for sighted people.This paper addresses the need for visually impaired people to access targets on large wall-mounted displays. We developed an assistive interface which exploits mid-air gesture input and haptic feedback, and examined its potential for pointing and steering tasks in human computer interaction（HCI）. In two experiments, blind and blindfolded users performed target acquisition tasks using mid-air gestures and two different kinds of feedback（i.e., haptic feedback and audio feedback）. Our results show that participants perform faster in Fitts＇ law pointing tasks using the haptic feedback interface rather than the audio feedback interface. Furthermore, a regression analysis between movement time（MT） and the index of difficulty（ID）demonstrates that the Fitts＇ law model and the steering law model are both effective for the evaluation of assistive interfaces for the blind. Our work and findings will serve as an initial step to assist visually impaired people to easily access required information on large public displays using haptic interfaces.

Voices for the Visually Impaired

The Mind’s Eye provides soundtracks to normal pleasures for the blind For sightless Liu Jianwen, much of the joy in life is found in an old-style Chinese courtyard compound.

Prevalence of visual impairment and estimation of refractive errors among school children in Kakamega,Kenya

AIM:To investigate the prevalence of visual impairment(VI)and provide an estimation of uncorrected refractive errors in school-aged children,conducted by optometry students as a community service.METHODS:The study was cross-sectional.Totally 3343 participants were included in the study.The initial examination involved assessing the uncorrected distance visual acuity(UDVA)and visual acuity(VA)while using a+2.00 D lens.The inclusion criteria for a subsequent comprehensive cycloplegic eye examination,performed by an optometrist,were as follows:a UDVA<0.6 decimal(0.20 logMAR)and/or a VA with+2.00 D≥0.8 decimal(0.96 logMAR).RESULTS:The sample had a mean age of 10.92±2.13y(range 4 to 17y),and 51.3%of the children were female(n=1715).The majority of the children(89.7%)fell within the age range of 8 to 14y.Among the ethnic groups,the highest representation was from the Luhya group(60.6%)followed by Luo(20.4%).Mean logMAR UDVA choosing the best eye for each student was 0.29±0.17(range 1.70 to 0.22).Out of the total,246 participants(7.4%)had a full eye examination.The estimated prevalence of myopia(defined as spherical equivalent≤-0.5 D)was found to be 1.45%of the total sample.While around 0.18%of the total sample had hyperopia value exceeding+1.75 D.Refractive astigmatism(cil<-0.75 D)was found in 0.21%(7/3343)of the children.The VI prevalence was 1.26%of the total sample.Among our cases of VI,76.2%could be attributed to uncorrected refractive error.Amblyopia was detected in 0.66%(22/3343)of the screened children.There was no statistically significant correlation observed between age or gender and refractive values.CONCLUSION:The primary cause of VI is determined to be uncorrected refractive errors,with myopia being the most prevalent refractive error observed.These findings underscore the significance of early identification and correction of refractive errors in school-aged children as a means to alleviate the impact of VI.

Prevalence and Factors Associated with Refractive Errors among University Students at Mbarara University of Science and Technology, Uganda

Introduction: WHO estimated that uncorrected refractive errors are the leading cause of visual impairment and second leading cause of blindness globally. University students are prone to developing refractive errors due to their curriculum that requires a lot of near work affecting their performance and quality of life unknowingly. Genetic and environmental factors are thought to play a role in the development of refractive errors. This study addresses the paucity of knowledge about refractive errors among university students in East Africa, providing a foundation for further research. Objectives: To determine the prevalence and factors associated with refractive errors among students in the Faculty of Medicine at Mbarara University of Science and Technology. Methodology: This was a cross-sectional descriptive and analytical study in which 368 undergraduate students selected using random sampling were assessed for refractive errors from March 2021-July 2021. Eligible participants were recruited and their VA assessment done after answering a questionnaire. Students whose VA improved on pin hole had subjective retinoscopy and results were compiled and imported to STATA 14 for analysis. Results: The prevalence of refractive errors was 26.36% with (95% CI) among university students especially myopia. Myopia is most predominant at 60%, followed by 37% Astigmatism and hyperopia of 3% among medical students. Astigmatism consisted of largely myopic astigmatism 72% (26) and 28% (10) compound/mixed astigmatism only. Student positive family history of refractive error was found to have a statistically significant relationship with refractive errors with AOR 1.68 (1.04 - 2.72) (95% CI) and P (0.032). Conclusion: The prevalence of refractive errors among university students, especially myopia, was found to be high and family history was associated with students having refractive errors.

Inclusive Architecture:Landscape Codesign in Children’s Playgrounds

Children’s playgrounds are open spaces,the basis for children’s recreation,important for the inclusion and mobility of visually impaired children in the social environment,through inclusive urban facilities that stimulate new experiences for their cognitive development.In this context,the use of co-design with visually impaired people,in the design processes of children’s playgrounds,assumes an importance for an inclusive project based on their experiences.Thus,it aimed to promote a project together,to provide more comfort and safety to users.It presents as main results as better colors,materials and types of toys for children with visual impairment to be competent in a playground including from the application of methods,tools and resources in the co-design process.

Model of Verbal Communication with Blind Patient:Application in Nursing Appointment

It was aimed at validating the applicability of the Model of Verbal Communication with blind people in nursing appointment in the stages of the nursing process. A methodology of quantitative study was used with 30 nurses and 30 blind people who participated in the study, divided in control and experimental groups. 30 nursing appointments took place;they were recorded and analyzed by three judges. The experimental group had excellent performance in following protocol (95.6%);taking notes informing the reason for silence (93.4%);and avoiding long silence (100%). In interventions, it presented excellence in all the items, in the evaluation stage, there were no bad/terrible actions. In none of the actions the control group presented better performance than the experimental one. The use of the Model is recommended in nursing appointment with blind patient.

Open globe injury in Hospital Universiti Sains Malaysia- a 10-year review

AIM:To identify the aetiology of open globe injuries at Hospital Universiti Sains Malaysia over a period of 10y and the prognostic factors for visual outcome.METHODS:Retrospective review of medical records of open globe injury cases that presented from January2000 to December 2009.Classification of open globe injury was based on the Birmingham Eye Trauma Terminology(BETT).Records were obtained with hospital permission via the in-house electronic patient management system,and the case notes of all patients with a diagnosis of open globe injury were scrutinised.Patients with prior ocular trauma,pre-existing ocular conditions affecting the visual acuity,contrast sensitivity,central vision or corneal thickness,as well as those with a history of previous intraocular or refractive surgery were excluded.Analysis of data was with SPSS version20.0.Ordinal logistic regression analysis was used to examine the association between prognostic factors and visual outcome.RESULTS:This study involved 220 patients(n=222eyes).The most common place of injury was the home(51.8%),followed by the workplace(23.4%).Among children aged less than 16y of age,domestic-related injury was the predominant cause(54.6%),while in those aged 16y and above,occupational injuries were the most common cause(40.0%).Most eyes(76.5%)had an initial visual acuity worse than 3/60,and in half of these,the visual acuity improved.The visual outcome was found to be significantly associated with the initial visual acuity(P【0.005),posterior extent of wound(P【0.001),length of wound(P【0.001),presence of hyphaema(P【0.001)and presence of vitreous prolapse(P【0.005).CONCLUSION:The most common causes of open globe injury are domestic accidents and occupational injuries.Significant prognostic factors for final visual outcome in patients with open globe injury are initial visual acuity,posterior extent and length of wound,presence of hyphaema and presence of vitreous prolapse.Awareness of the factors predicting a poor visual outcome may be helpful during counselling of patients with open globe injuries.

Population-based survey of prevalence,causes,and risk factors for blindness and visual impairment in an aging Chinese metropolitan population

AIM： To assess the prevalence, causes, and risk factors for blindness and visual impairment among elderly （〉60 years of age） Chinese people in a metropolitan area of Shanghai, China. METHODS： Random cluster sampling was conducted to identify participants among residents ≥60 years of age living in the Xietu Block, Xuhui District, Shanghai, China. Presenting visual acuity （PVA） and best-corrected visual acuity （BCVA） were checked by the Early Treatment Diabetic Retinopathy Study （ETDRS） visual chart. All eligible participants underwent a comprehensive eye examination. Blindness and visual impairment were defined according to World Health Organization （WHO） criteria. RESULTS： A total of 4190 persons （1688 men and 2502 women） participated in the study, and the response rate was 91.1%. Based on PVA, the prevalence of blindness was 1.1% and that of visual impairment was 7.6%. Based on BCVA, the prevalence of blindness and visual impairment decreased to 0.9% and 3.9%, respectively. Older （〉80 years of age） women, with low educational levels and smoking habits, exhibited a significantly greater chance for blindness and visual impairment than did those with high educational levels and no smoking habits （P〈0.05）. Based on PVA and BCVA, the main causes of blindness were cataract, myopic maculopathy, and age-related macular degeneration （AMD）. CONCLUSION： Our findings help to identify the population in need of intervention, to highlight the need for additional eye healthcare services in urban China.

Frequency of presenting visual acuity and visual impairment in Chinese college students

AIM:To obtain the baseline data on presenting visual acuity(PVA)and evaluate the prevalence and associated factors for visual impairment based on PVA in 9070 Chinese college students.METHODS:The freshmen at a university in southern China,including 6527 undergraduate students and 2543 graduate students,were investigated for some sociodemographic characteristics and underwent routine medical examination,including measuring PVA,height,and weight.Visual impairment was defined according to the new World Health Organization criteria for blindness and visual impairment.RESULTS:In 9070 college students,the mean PVA in the better eye was 0.094±0.163 log MAR.The prevalence of visual impairment based on PVA was 2.7%.Only 38.3%college students had normal visual acuity[PVA equal to 0 log MAR(20/20)in both eyes].There were 69.8%of students wearing spectacles.Logistic regression showed that home region(non-Guangdong provinces,P<0.0001,OR=1.70)was risk factor for visual impairment while BMI(P=0.001,OR=0.92)was protective factor from visual impairment.Ethnicity(Han Chinese,P<0.0001,OR=3.17)was risk factor for wearing spectacles while age(P=0.01,OR=0.90)was protective factor from wearing spectacles.CONCLUSION:This study provides the baseline data on PVA and the prevalence of visual impairment in Chinese college students.Our analyses reveal that BMI and home region are associated factors for visual impairment based on PVA,while age and ethnicity are associated factors for wearing spectacles.