Fusion of color and hallucinated depth features for enhanced multimodal deep learning-based damage segmentation

Recent advances in computer vision and deep learning have shown that the fusion of depth information can significantly enhance the performance of RGB-based damage detection and segmentation models.However,alongside the advantages,depth-sensing also presents many practical challenges.For instance,the depth sensors impose an additional payload burden on the robotic inspection platforms limiting the operation time and increasing the inspection cost.Additionally,some lidar-based depth sensors have poor outdoor performance due to sunlight contamination during the daytime.In this context,this study investigates the feasibility of abolishing depth-sensing at test time without compromising the segmentation performance.An autonomous damage segmentation framework is developed,based on recent advancements in vision-based multi-modal sensing such as modality hallucination(MH)and monocular depth estimation(MDE),which require depth data only during the model training.At the time of deployment,depth data becomes expendable as it can be simulated from the corresponding RGB frames.This makes it possible to reap the benefits of depth fusion without any depth perception per se.This study explored two different depth encoding techniques and three different fusion strategies in addition to a baseline RGB-based model.The proposed approach is validated on computer-generated RGB-D data of reinforced concrete buildings subjected to seismic damage.It was observed that the surrogate techniques can increase the segmentation IoU by up to 20.1%with a negligible increase in the computation cost.Overall,this study is believed to make a positive contribution to enhancing the resilience of critical civil infrastructure.

Effectiveness of anti-psychiatric treatment on visual and haptic perceptual disorder for a patient with Alzheimer’s disease: A case report

BACKGROUND Perception is frequently impaired in patients with Alzheimer’s disease(AD).Several patients exhibit visual or haptic hallucinations.CASE SUMMARY A 71-year-old Chinese man presented with visual and haptic hallucinations he had been experiencing for 2 weeks.The clinical manifestations were the feeling of insects crawling and biting the limbs and geison.He looked for the insects while itching and scratching,which led to skin breakage on the limbs.He was treated with topical and anti-allergic drugs in several dermatology departments without any significant improvement.After admission,the patient was administered risperidone(0.5 mg)and duloxetine(2 mg/day).One week later,the dose of risperidone was increased to 2 mg/day,and that of duloxetine was increased to 60 mg/day.After 2 weeks of treatment,the patient’s sensation of insects crawling and biting disappeared,and his mood stabilized.CONCLUSION This patient manifested psychiatric behavioral symptoms caused by AD brain atrophy.It was important to re-evaluate the patient’s cognitive-psychological status when the patient repeatedly went to the hospital for treatment.Follow-up attention to cognitive function and the consideration of perceptual deficits as early manifestations of AD should be considered.

Classification of musical hallucinations and the characters along with neural-molecular mechanisms of musical hallucinations associated with psychiatric disorders

BACKGROUND Musical hallucinations(MH)involve the false perception of music in the absence of external stimuli which links with different etiologies.The pathomechanisms of MH encompass various conditions.The etiological classification of MH is of particular importance and offers valuable insights to understand MH,and further to develop the effective treatment of MH.Over the recent decades,more MH cases have been reported,revealing newly identified medical and psychiatric causes of MH.Functional imaging studies reveal that MH activates a wide array of brain regions.An up-to-date analysis on MH,especially on MH comorbid psychiatric conditions is warranted.AIM To propose a new classification of MH;to study the age and gender differences of MH in mental disorders;and neuropathology of MH.METHODS Literatures searches were conducted using keywords such as“music hallucination,”“music hallucination and mental illness,”“music hallucination and gender difference,”and“music hallucination and psychiatric disease”in the databases of PubMed,Google Scholar,and Web of Science.MH cases were collected and categorized based on their etiologies.The t-test and ANOVA were employed(P<0.05)to compare the age differences of MH different etiological groups.Function neuroimaging studies of neural networks regulating MH and their possible molecular mechanisms were discussed.RESULTS Among the 357 yielded publications,294 MH cases were collected.The average age of MH cases was 67.9 years,with a predominance of females(66.8%females vs 33.2%males).MH was classified into eight groups based on their etiological mechanisms.Statistical analysis of MH cases indicates varying associations with psychiatric diagnoses.CONCLUSION We carried out a more comprehensive review of MH studies.For the first time according to our knowledge,we demonstrated the psychiatric conditions linked and/or associated with MH from statistical,biological and molecular point of view.

Legal and Ethical Perspectives on Artificial Intelligence

People are enormously nervous about Artificial Intelligence.Although many are constructive and want to move forward,many want more answers from a business perspective,a legal perspective,and an economic perspective.Just today,another class action lawsuit was filed in California.This paper will address concerns and hopefully help you understand Artificial Intelligence better.From these perspectives,you may decide how you feel and think about Artificial Intelligence based on the information presented in this paper and other research.

The Relationship between Exercise and Psychotic Symptoms in College Students: A Cross-Sectional Analysis

An increasing number of studies have suggested that increased physical activity is associated with less mental illness.However,the relationship between exercise and psychotic experiences(PEs)is still unknown.The purpose of this study was to explore the relationship between exercise and PEs in college students in the United States.Data from the Health Mind Survey(2020–2021 round)were analyzed.Respondents included 137,916 college students who were asked about exercise and PEs(lifetime psychotic experiences,delusions,and hallucinations).A multivariate logistic regression analysis was used to investigate the relationship between exercise and PEs while controlling for demographic characteristics.There was a significant correlation between exercise and PEs among college students.Compared to students who exercised less than one hour per week,students who exercisedfive or more hours per week had fewer lifetime psychotic experiences.This samefinding obtained for both male and female college students.Thefindings from the present study indicate that exercising forfive or more hours each week is most correlated with decreased PEs among college students.However,experimental studies are required to extend and confirm ourfindings and determine the causality of this relationship.

Understanding Anger and Effective Anger Management Techniques(A Short Review)

This article explores the complex topic of rage and its important concomitant,anger management.Anger is a natural emotion that is experienced in many ways.Its triggers,body reactions,and mental components are all examined.Developing techniques for efficient anger management begins with an understanding of the nature of rage.This short review emphasizes the significance of anger management,stressing its critical role in preserving mental and physical health,stimulating personal development,and preserving relationships.Anger that is out of control can have serious ramifications,such as long-term stress,poor decision-making,damaged relationships,and legal issues.In order to provide readers with practical knowledge,an extensive range of effective strategies for managing anger is provided.These techniques include deep breathing,cognitive restructuring,self-awareness,and physical practices including progressive muscle relaxation and exercise.Other essential elements of anger control are stress reduction,obtaining professional help,and developing effective communication skills.The conclusion highlights the transformative potential of anger management,highlighting that the key to effectively managing and utilizing this powerful emotion is not about repressing anger.By putting these strategies into practice and seeing anger as a chance for development and transformation,people can start down the path to greater wellbeing,more wholesome relationships,and a more peaceful life.

Face hallucination via compressive sensing

Face hallucination or super-resolution is an inverse problem which is underdetermined,and the compressive sensing(CS)theory provides an effective way of seeking inverse problem solutions.In this paper,a novel compressive sensing based face hallucination method is presented,which is comprised of three steps:dictionary learning、sparse coding and solving maximum a posteriori(MAP)formulation.In the first step,the K-SVD dictionary learning algorithm is adopted to obtain a dictionary which can sparsely represent high resolution(HR)face image patches.In the second step,we seek the sparsest representation for each low-resolution(LR)face image paches input using the learned dictionary,super resolution image blocks are obtained from the sparsest coefficients and dictionaries,which then are assembled into super-resolution(SR)image.Finally,MAP formulation is introduced to satisfy the consistency restrictive condition and obtain the higher quality HR images.The experimental results demonstrate that our approach can achieve better super-resolution faces compared with other state-of-the-art method.

An Analysis of Mystical Experience in Sophy' s Hysterical Hallucination in Darkness Visible

In William Golding' s Darkness Visible,Sophy' s experience of " hysterical hallucination" plays an important role in the the matic expression.They point directly to the evil nature of man.Although the specific content of hallucinations is different,they possess a common characteristic-mystical experience.They worth further research.This paper examines Sophy' s mystical experience in her hyster ical hallucination,so as to find out the functions of mystical experience and its influences on the novel' s thematic expression.

An Analysis of Hysterical Hallucination of Simon in Lord of the Flies

Golding gave hallucination to characters when they are suffering from hysteria.This paper researches the relation between Simon' s hysteria with hallucination and the revelation of the theme,and finds out that this clinical symptom turns to be the window for Golding to tell his theme.

Repetitive transcranial magnetic stimulation for hallucination in schizophrenia spectrum disorders A meta-analysis

OBJECTIVE： This study assessed the efficacy and tolerability of repetitive transcranial magnetic stimulation for treatment of auditory hallucination of patients with schizophrenia spectrum disorders. DATA SOURCES： Online literature retrieval was conducted using PubMed, ISI Web of Science, EMBASE, Medline and Cochrane Central Register of Controlled Trials databases from January 1985 to May 2012. Key words were ＂transcranial magnetic stimulation＂, ＂TMS＂, ＂repetitive tran- scranial magnetic stimulation＂, and ＂hallucination＂. STUDY SELECTION： Selected studies were randomized controlled trials assessing therapeutic ef- ficacy of repetitive transcranial magnetic stimulation for hallucination in patients with schizophrenia spectrum disorders. Experimental intervention was low-frequency repetitive transcranial magnetic stimulation in left temporoparietal cortex for treatment of auditory hallucination in schizophrenia spectrum disorders. Control groups received sham stimulation. MAIN OUTCOME MEASURES： The primary outcome was total scores of Auditory Hallucinations Rating Scale, Auditory Hallucination Subscale of Psychotic Symptom Rating Scale, Positive and Negative Symptom Scale-Auditory Hallucination item, and Hallucination Change Scale. Secondary outcomes included response rate, global mental state, adverse effects and cognitive function. RESULTS： Seventeen studies addressing repetitive transcranial magnetic stimulation for treatment of schizophrenia spectrum disorders were screened, with controls receiving sham stimulation. All data were completely effective, involving 398 patients. Overall mean weighted effect size for repeti- tive transcranial magnetic stimulation versus sham stimulation was statistically significant （MD = -0.42, 95%C/： -0.64 to -0.20, P = 0.000 2）. Patients receiving repetitive transcranial magnetic stimulation responded more frequently than sham stimulation （OR = 2.94, 95%C/： 1.39 to 6.24, P =0.005）. No significant differences were found between active repetitive transcranial magnetic stimulation and sham stimulation for positive or negative symptoms. Compared with sham stimulation, active repeti- tive transcranial magnetic stimulation had equivocal outcome in cognitive function and commonly caused headache and facial muscle twitching. CONCLUSION： Repetitive transcranial magnetic stimulation is a safe and effective treatment for auditory hallucination in schizophrenia spectrum disorders,

Transcranial direct current stimulation for auditory verbal hallucinations:a systematic review of clinical trials

Transcranial direct current stimulation(tDCS)has been reportedly beneficial for different neurodegenerative disorders.tDCS has been reported as a potential adjunctive or alternative treatment for auditory verbal hallucination(AVH).This study aims to review the effects of tDCS on AVH in patients with schizophrenia through combining the evidence from randomized clinical trials(RCTs).The databases of PsycINFO(2000–2019),PubMed(2000–2019),EMBASE(2000–2019),CINAHL(2000–2019),Web of Science(2000–2019),and Scopus(2000–2019)were systematically searched.The clinical trials with RCT design were selected for final analysis.A total of nine RCTs were eligible and included in the review.Nine RCTs were included in the final analysis.Among them,six RCTs reported a significant reduction of AVH after repeated sessions of tDCS,whereas three RCTs did not show any advantage of active tDCS over sham tDCS.The current studies showed an overall decrease of approximately 28%of AVH after active tDCS and 10%after sham tDCS.The tDCS protocols targeting the sensorimotor frontal-parietal network showed greater treatment effects compared with the protocols targeting other regions.In this regard,cathodal tDCS over the left temporoparietal area showed inhibitory effects on AVHs.The most effective tDCS protocol on AVHs was twice-daily sessions(2 mA,20-minute duration)over 5 consecutive days(10 sessions)with the anode over the left dorsolateral prefrontal cortex and the cathode over the left temporal area.Some patient-specific and diseasespecific factors such as young age,nonsmoking status,and higher frequencies of AVHs seemed to be the predictors of treatment response.Taken together,the results of tDCS as an alternative treatment option for AVH show controversy among current literatures,since not all studies were positive.However,the studies targeting the same site of the brain showed that the tDCS could be a promising treatment option to reduce AVH.Further RCTs,with larger sample sizes,should be conducted to reach a conclusion on the efficacy of tDCS for AVH and to develop an effective therapeutic protocol for clinical setting.

Cognitive behavioural therapy for auditory hallucinations in schizophrenia:A review

AIM To provide an updated of recent findings about efficacy of cognitive-behavior therapy(CBT) in reduction of command hallucinations.METHODS Pub Med/MEDLINE,Cochrane Library,the Cumulative Index to Nursing and Allied Health Literature,PsycI NFO,Clinical Trial.gov searches were performed using the keywords "hallucinations","behavioural therapy" and " cognitive therapy" in order to identify relevant articles published during the years of 2011 to 2016.No language limits were used.Studies conducted within control group,reviews,editorials,were excluded.Data on efficacy,acceptability and tolerability were extracted by three authors independently.Disagreements were resolved in a consensus meeting or by another reviewer.RESULTS A total of eight articles were eligible for inclusion.Two are randomized clinical trials(RCTs) and six are observational studies.The two RCTs included showed a greater efficacy of CBT compared to standard care on auditory hallucinations(AHs).Nevertheless,they considered different CBT models,particularly Treatment of Resistant Command Hallucinations and Cognitive Therapy for Command Hallucinations.As regards non RCT-studies,all papers included showed reduction on frequency and severity of AHs and distress related to them.However,the lack of content details within non-RCTs studies decreased their comparability.In terms of predictive variables,our findings show that negative symptoms at baseline appeared to be the strongest predictor of the treatment efficacy.Indeed,negative symptoms showed a significant negative correlation on outcome.CONCLUSION Although more conclusive studies are still needed,we found some preliminary evidence for the efficacy of CBT in the treatment of command hallucinations.

Auditory hallucinations: A review of the ERC “VOICE” project

In this invited review I provide a selective overview of recent research on brain mechanisms and cognitive processes involved in auditory hallucinations. The review is focused on research carried out in the "VOICE" ERC Advanced Grant Project, funded by the European Research Council, but I also review and discuss the literature in general. Auditory hallucinations are suggested to be perceptual phenomena, with a neuronal origin in the speech perception areas in the temporal lobe. The phenomenology of auditory hallucinations is conceptualized along three domains, or dimensions; a perceptual dimension, experienced as someone speaking to the patient; a cognitive dimension, experienced as an inability to inhibit, or ignore the voices, and an emotional dimension, experienced as the "voices" having primarily a negative, or sinister, emotional tone. I will review cognitive, imaging, and neurochemistry data related to these dimensions, primarily the first two. The reviewed data are summarized in a model that sees auditory hallucinations as initiated from temporal lobe neuronal hyper-activation that draws attentional focus inward, and which is not inhibited due to frontal lobe hypo-activation. It is further suggested that this is maintained through abnormal glutamate and possibly gamma-amino-butyric-acid transmitter mediation, which could point towards new pathways for pharmacological treatment. A final section discusses new methods of acquiring quantitative data on the phenomenology and subjective experience of auditory hallucination that goes beyond standard interview questionnaires, by suggesting an iP hone/iP od app.

Abnormal Local Activity and Functional Dysconnectivity in Patients with Schizophrenia Having Auditory Verbal Hallucinations

Auditory verbal hallucination(AVH)is emphasized as a pathological hallmark of schizophrenia.Neuroimaging studies provide evidence linking AVH to overlapping functional abnormalities in distributed networks.However,no clear conclusion has still been reached.This study aimed to further explore the brain activity of patients with schizophrenia having AVH from both local activity(LA)and functional connectivity(FC)insights,while excluding confounding factors from other positive symptoms.A total of 42 patients with AVH(AVH patients group,APG),26 without AVH(non-AVH patients group,NPG),and 82 normal controls(NC)underwent resting-state functional magnetic resonance imaging(fMRI).LA measures,including regional homogeneity(ReHo)and fractional amplitude of low-frequency fluctuations(fALFF),and FC measures were evaluated to understand the neuroimaging mechanism of AVH.APG showed increased ReHo and fALFF in the bilateral putamen(Put)compared with NPG and NC.FC analysis(using bilateral putamen as seeds)revealed that all patients showed abnormal FC of multiple resting state network regions,including the anterior and post cingulate cortex,middle frontal gyrus,inferior parietal gyrus,and left angular gyrus.Interestingly,APG showed significantly decreased FC of insula extending to the superior temporal gyrus and inferior frontal gyrus compared with NPG and NC.The present findings suggested a significant correlation of abnormal LA and dysfunctional putamen-auditory cortical connectivity with the neuropathological mechanism of AVH,providing evidence for the functional disconnection hypothesis of schizophrenia.

Multimodal morphometry and functional magnetic resonance imaging in schizophrenia and auditory hallucinations

AIM: To validate a multimodal [structural and functional magnetic resonance (MR)] approach as coincidence brain clusters are hypothesized to correlate with clinical severity of auditory hallucinations. METHODS: Twenty-two patients meeting Diagnostic and Statistical Manual of Mental Disorders (fourth edition, DSM-IV) criteria for schizophrenia and experiencing persistent hallucinations together with 28 healthy controls were evaluated with structural and functional MR imaging with an auditory paradigm designed to replicate those emotions related to the patients’ hallucinatory experiences. Coincidence maps were obtained by combining structural maps of gray matter reduction with emotional functional increased activation. Abnormal areas were correlated with the brief psychiatric rating scale (BPRS) and the psychotic symptom rating scale (PSYRATS) scales. RESULTS: The coincidence analysis showed areas with coexistence gray matter reductions and emotional activation in bilateral middle temporal and superior temporal gyri. Significant negative correlations between BPRS and PSYRATS scales were observed. BPRS scores were negatively correlated in the middle temporal gyrus (right) (t = 6.86, P = 0.001), while negative PSYRATS correlation affected regions in both the superior temporal gyrus (left) (t = 7.85, P = 0.001) and middle temporal gyrus (left) (t = 4.97, P = 0.002). CONCLUSION: Our data identify left superior and middle temporal gyri as relevant areas for the understanding of auditory hallucinations in schizophrenia. The use of multimodal approaches, sharing structural and functional information, may demonstrate areas specifically linked to the severity of auditory hallucinations.

Super-Resolution for Face Image with an Improved K-NN Search Strategy

Recently, neighbor embedding based face super-resolution(SR) methods have shown the ability for achieving high-quality face images, those methods are based on the assumption that the same neighborhoods are preserved in both low-resolution(LR) training set and high-resolution(HR) training set. However, due to the "one-to-many" mapping between the LR image and HR ones in practice, the neighborhood relationship of the LR patch in LR space is quite different with that of the HR counterpart, that is to say the neighborhood relationship obtained is not true. In this paper, we explore a novel and effective re-identified K-nearest neighbor(RIKNN) method to search neighbors of LR patch. Compared with other methods, our method uses the geometrical information of LR manifold and HR manifold simultaneously. In particular, it searches K-NN of LR patch in the LR space and refines the searching results by re-identifying in the HR space, thus giving rise to accurate K-NN and improved performance. A statistical analysis of the influence of the training set size and nearest neighbor number is given, experimental results on some public face databases show the superiority of our proposed scheme over state-of-the-art face hallucination approaches in terms of subjective and objective results as well as computational complexity.

40 Hz Auditory Steady State Response to Linguistic Features of Stimuli during Auditory Hallucinations

The auditory steady state response （ASSR） may reflect activity from different regions of the brain, depending on the modulation frequency used. In general, responses induced by low rates （_〈40 Hz） emanate mostly from central structures of the brain, and responses from high rates （〉80 Hz） emanate mostly from the peripheral auditory nerve or brainstem structures. Besides, it was reported that the gamma band ASSR （30-90 Hz） played an important role in working memory, speech understanding and recognition. This paper investigated the 40 Hz ASSR evoked by modulated speech and reversed speech. The speech was Chinese phrase voice, and the noise-like reversed speech was obtained by temporally reversing the speech. Both auditory stimuli were modulated with a frequency of 40 Hz. Ten healthy subjects and 5 patients with hallucination symptom participated in the experiment. Results showed re- duction in left auditory cortex response when healthy subjects listened to the reversed speech compared with the speech. In contrast, when the patients who experienced auditory hallucinations listened to the reversed speech, the auditory cortex of left hemispheric responded more actively. The ASSR results were consistent with the behavior results of patients. Therefore, the gamma band ASSR is expected to be helpful for rapid and objective diagnosis of hallucination in clinic.

An Integrative Account of Neural Network Interaction: Neuro-Messenger Theory

Neural interaction is realized by information exchange. It seemed that the information amount does not keep constant and may be reduced during the travel between neural nodes. In addition, recent research of neural coding has suggested that neural information could be represented by parsimonious spiking pattern, named sparse coding. Based on the above observation, neuro-messenger theory (NMT) is proposed to explicate the communicative process between the source and the target neural nodes. Neuro-messenger is a sparse code which does not have to carry every detail of the dynamics in source node. Other formats of neural coding (e.g., temporal and rate coding) could be the precursors of neuro-messengers, and the repeated spatiotemporal patterns buried in the ongoing brain activities may be the circulated neuro-messengers from diverse origins. Referred to chaos/complexity theory, information can be recovered at target node where neuro-messenger serves as a facilitator to locate the trajectory at proper attractor, and hence the associated psychological entity. In contrast to conventional concepts of encoding and decoding, the processes of encoding in source node, issuing neuro-messengers, and recovering information at target node are summarized as “three-facet coding scheme”. The design of neuro-messenger enables the brain to utilize energy in an efficient and economical way. NMT may have substantial implication in several major psychiatric disorders. Some psychiatric conditions could be mediated by abnormal neuro-messengers that coerce the regional neuro-dynamics to delve into maladaptive attractors and hence the characteristic symptoms.

Emerging role of psychosis in Parkinson's disease:From clinical relevance to molecular mechanisms

Parkinson's disease(PD)is the second most common neurodegenerative disease.Psychosis is one of the common psychiatric presentations in the natural course of PD.PD psychosis is an important non-motor symptom,which is strongly correlated with a poor prognosis.Increasing attention is being given to PD psychosis.In this opinion review,we summarized and analyzed the identification,screening,epidemiology,mechanisms,risk factors,and therapeutic approaches of PD psychosis based on the current clinical evidence.PD psychosis tends to have a negative effect on patients'quality of life and increases the burden of family caregiving.Screening and identification in the early stage of disease is crucial for establishing tailored therapeutic strategies and predicting the long-term outcome.Development of PD psychosis is believed to involve a combination of exogenous and endogenous mechanisms including imbalance of neurotransmitters,structural and network changes,genetic profiles,cognitive impairment,and antiparkinsonian medications.The therapeutic strategy for PD psychosis includes reducing or ceasing the use of dopaminergic drug,antipsychotics,cholinesterase inhibitors,and non-pharmacological interventions.Ongoing clinical trials are expected to provide new insights for tailoring therapy for PD psychosis.Future research based on novel biomarkers and genetic factors may help inform individualized therapeutic strategies.

Functional and Neural Mechanisms of Out-of-Body Experiences: Importance of Retinogeniculo-Cortical Oscillations

Current research on the various forms of autoscopic phenomena addresses the clinical and neurological correlates of out-of-body experiences, autoscopic hallucinations, and heautoscopy. Yet most of this research is based on functional magnetic resonance imaging results and focuses predominantly on abnormal cortical activity. Previously we proposed that visual consciousness resulted from the dynamic retinogeniculo-cortical oscillations, such that the photoreceptors dynamically integrated with visual and other vision-associated cortices, and was theorized to be mapped out by photoreceptor discs and rich retinal networks which synchronized with the retinotopic mapping and the associated cortex. The feedback from neural input that is received from the thalamus and cortex via retinogeniculo-cortical oscillations and sent to the retina is multifold higher than feed-forward input to the cortex. This can effectively translate into out-of-body experiences projected onto the screen formed by the retina as it is perceived via feedback and feed-forward oscillations from the reticular thalamic nucleus, or “internal searchlight”. This article explores the role of the reticular thalamic nucleus and the retinogeniculo-cortical oscillations as pivotal internal components in vision and various autoscopic phenomena.