Music Emotion Recognition Based on Feature Fusion Broad Learning Method

With the rapid development in the field of artificial intelligence and natural language processing(NLP),research on music retrieval has gained importance.Music messages express emotional signals.The emotional classification of music can help in conveniently organizing and retrieving music.It is also the premise of using music for psychological intervention and physiological adjustment.A new chord-to-vector method was proposed,which converted the chord information of music into a chord vector of music and combined the weight of the Mel-frequency cepstral coefficient(MFCC) and residual phase(RP) with the feature fusion of a cochleogram.The music emotion recognition and classification training was carried out using the fusion of a convolution neural network and bidirectional long short-term memory(BiLSTM).In addition,based on the self-collected dataset,a comparison of the proposed model with other model structures was performed.The results show that the proposed method achieved a higher recognition accuracy compared with other models.

Knowledge-enriched joint-learning model for implicit emotion cause extraction

Emotion cause extraction(ECE)task that aims at extracting potential trigger events of certain emotions has attracted extensive attention recently.However,current work neglects the implicit emotion expressed without any explicit emotional keywords,which appears more frequently in application scenarios.The lack of explicit emotion information makes it extremely hard to extract emotion causes only with the local context.Moreover,an entire event is usually across multiple clauses,while existing work merely extracts cause events at clause level and cannot effectively capture complete cause event information.To address these issues,the events are first redefined at the tuple level and a span-based tuple-level algorithm is proposed to extract events from different clauses.Based on it,a corpus for implicit emotion cause extraction that tries to extract causes of implicit emotions is constructed.The authors propose a knowledge-enriched jointlearning model of implicit emotion recognition and implicit emotion cause extraction tasks(KJ-IECE),which leverages commonsense knowledge from ConceptNet and NRC_VAD to better capture connections between emotion and corresponding cause events.Experiments on both implicit and explicit emotion cause extraction datasets demonstrate the effectiveness of the proposed model.

A Method of Multimodal Emotion Recognition in Video Learning Based on Knowledge Enhancement

With the popularity of online learning and due to the significant influence of emotion on the learning effect,more and more researches focus on emotion recognition in online learning.Most of the current research uses the comments of the learning platform or the learner’s expression for emotion recognition.The research data on other modalities are scarce.Most of the studies also ignore the impact of instructional videos on learners and the guidance of knowledge on data.Because of the need for other modal research data,we construct a synchronous multimodal data set for analyzing learners’emotional states in online learning scenarios.The data set recorded the eye movement data and photoplethysmography(PPG)signals of 68 subjects and the instructional video they watched.For the problem of ignoring the instructional videos on learners and ignoring the knowledge,a multimodal emotion recognition method in video learning based on knowledge enhancement is proposed.This method uses the knowledge-based features extracted from instructional videos,such as brightness,hue,saturation,the videos’clickthrough rate,and emotion generation time,to guide the emotion recognition process of physiological signals.This method uses Convolutional Neural Networks(CNN)and Long Short-Term Memory(LSTM)networks to extract deeper emotional representation and spatiotemporal information from shallow features.The model uses multi-head attention(MHA)mechanism to obtain critical information in the extracted deep features.Then,Temporal Convolutional Network(TCN)is used to learn the information in the deep features and knowledge-based features.Knowledge-based features are used to supplement and enhance the deep features of physiological signals.Finally,the fully connected layer is used for emotion recognition,and the recognition accuracy reaches 97.51%.Compared with two recent researches,the accuracy improved by 8.57%and 2.11%,respectively.On the four public data sets,our proposed method also achieves better results compared with the two recent researches.The experiment results show that the proposed multimodal emotion recognition method based on knowledge enhancement has good performance and robustness.

A Multi-Modal Deep Learning Approach for Emotion Recognition

In recent years,research on facial expression recognition(FER)under mask is trending.Wearing a mask for protection from Covid 19 has become a compulsion and it hides the facial expressions that is why FER under the mask is a difficult task.The prevailing unimodal techniques for facial recognition are not up to the mark in terms of good results for the masked face,however,a multi-modal technique can be employed to generate better results.We proposed a multi-modal methodology based on deep learning for facial recognition under a masked face using facial and vocal expressions.The multimodal has been trained on a facial and vocal dataset.We have used two standard datasets,M-LFW for the masked dataset and CREMA-D and TESS dataset for vocal expressions.The vocal expressions are in the form of audio while the faces data is in image form that is why the data is heterogenous.In order to make the data homogeneous,the voice data is converted into images by taking spectrogram.A spectrogram embeds important features of the voice and it converts the audio format into the images.Later,the dataset is passed to the multimodal for training.neural network and the experimental results demonstrate that the proposed multimodal algorithm outsets unimodal methods and other state-of-the-art deep neural network models.

Parameter Tuned Machine Learning Based Emotion Recognition on Arabic Twitter Data

Arabic is one of the most spoken languages across the globe.However,there are fewer studies concerning Sentiment Analysis(SA)in Arabic.In recent years,the detected sentiments and emotions expressed in tweets have received significant interest.The substantial role played by the Arab region in international politics and the global economy has urged the need to examine the sentiments and emotions in the Arabic language.Two common models are available:Machine Learning and lexicon-based approaches to address emotion classification problems.With this motivation,the current research article develops a Teaching and Learning Optimization with Machine Learning Based Emotion Recognition and Classification(TLBOML-ERC)model for Sentiment Analysis on tweets made in the Arabic language.The presented TLBOML-ERC model focuses on recognising emotions and sentiments expressed in Arabic tweets.To attain this,the proposed TLBOMLERC model initially carries out data pre-processing and a Continuous Bag Of Words(CBOW)-based word embedding process.In addition,Denoising Autoencoder(DAE)model is also exploited to categorise different emotions expressed in Arabic tweets.To improve the efficacy of the DAE model,the Teaching and Learning-based Optimization(TLBO)algorithm is utilized to optimize the parameters.The proposed TLBOML-ERC method was experimentally validated with the help of an Arabic tweets dataset.The obtained results show the promising performance of the proposed TLBOML-ERC model on Arabic emotion classification.

Deep Learning to Find Key Brain Electrode Positions in Emotional EEG

At present, the channels used for EEG acquisition are more than 16, which makes it difficult to wear EEG caps and has poor contact. Therefore, it brings difficulties to the collection of brain waves is not conducive to converting research into applications. It is a well worth studying work in researching how to find the key brain electrode in the existing brain wave, which will greatly reduce the number of EEG acquisition points during application, making it easier to translate the research into practical application. This paper takes emotional EEG as an example to study how to find the key brain electrode points of emotional EEG with deep learning method. Firstly, using the least square regression algorithm to calculate the characteristic coefficients of each electrode point;secondly, according to the law of the characteristic coefficient value, grouping the key EEG poles for experiment. In the grouping experiment, the Conv1d-GRU model used to train and verify the EEG data of the corresponding electrode points. Finally, from the results of various grouping experiments, it concluded that the selection method of the key EEG level points should be the electrode points with positive characteristic coefficient, and the accuracy of verification is 97.6%. With experiments, it confirmed that there are key electrode points in the detection of emotional EEG by 16-channel OpenBCI. There are only six key electrode points of emotional EEG;that is to say, the EEG data collected by only six key electrode points can identify seven kinds of emotional EEG. .

Relationships Between Achievement Emotions, Motivation and Language Learning Strategies of High, Mid and Low English Language Achievers

Overseas research has shown that achievement emotions have direct relationships with ＂achievement outcome＂ and＂achievement activities＂. The purpose of the present study aimed to compare the relationships betweenachievement emotions, motivation, and language learning strategies of high, mid and low achievers in Englishlanguage learning at an international university in a southern province in China. Quantitative data were collectedthrough a questionnaire survey of 74 （16 males, 58 females） TESL major students. Results indicated that studentsin general experienced more positive than negative achievement emotions; more intrinsically rather thanextrinsically motivated to learn English; and quite frequently used a variety of learning strategies to overcome theirlearning difficulties. However, Year Four low-achievers experienced more negative achievement emotions. Theyseldom used metacognitive, affective and social learning strategies, and they had lower degrees of intrinsicmotivation. Implications for institutional support for at risk students are discussed.

A Multi-scale Attention-based Facial Emotion Recognition Method Based on Deep Learning

Recently,people have been paying more and more attention to mental health,such as depression,autism,and other common mental diseases.In order to achieve a mental disease diagnosis,intelligent methods have been actively studied.However,the existing models suffer the accuracy degradation caused by the clarity and occlusion of human faces in practical applications.This paper,thus,proposes a multi-scale feature fusion network that obtains feature information at three scales by locating the sentiment region in the image,and integrates global feature information and local feature information.In addition,a focal cross-entropy loss function is designed to improve the network's focus on difficult samples during training,enhance the training effect,and increase the model recognition accuracy.Experimental results on the challenging RAF_DB dataset show that the proposed model exhibits better facial expression recognition accuracy than existing techniques.

Multimodal Emotion Recognition with Transfer Learning of Deep Neural Network

Due to the lack of large-scale emotion databases,it is hard to obtain comparable improvement in multimodal emotion recognition of the deep neural network by deep learning,which has made great progress in other areas.We use transfer learning to improve its performance with pretrained models on largescale data.Audio is encoded using deep speech recognition networks with 500 hours’speech and video is encoded using convolutional neural networks with over 110,000 images.The extracted audio and visual features are fed into Long Short-Term Memory to train models respectively.Logistic regression and ensemble method are performed in decision level fusion.The experiment results indicate that 1)audio features extracted from deep speech recognition networks achieve better performance than handcrafted audio features;2)the visual emotion recognition obtains better performance than audio emotion recognition;3)the ensemble method gets better performance than logistic regression and prior knowledge from micro-F1 value further improves the performance and robustness,achieving accuracy of 67.00%for“happy”,54.90%for“an?gry”,and 51.69%for“sad”.

A survey on deep learning for textual emotion analysis in social networks

Textual Emotion Analysis(TEA)aims to extract and analyze user emotional states in texts.Various Deep Learning(DL)methods have developed rapidly,and they have proven to be successful in many fields such as audio,image,and natural language processing.This trend has drawn increasing researchers away from traditional machine learning to DL for their scientific research.In this paper,we provide an overview of TEA based on DL methods.After introducing a background for emotion analysis that includes defining emotion,emotion classification methods,and application domains of emotion analysis,we summarize DL technology,and the word/sentence representation learning method.We then categorize existing TEA methods based on text structures and linguistic types:text-oriented monolingual methods,text conversations-oriented monolingual methods,text-oriented cross-linguistic methods,and emoji-oriented cross-linguistic methods.We close by discussing emotion analysis challenges and future research trends.We hope that our survey will assist readers in understanding the relationship between TEA and DL methods while also improving TEA development.

BERT-CNN: A Deep Learning Model for Detecting Emotions from Text

Due to the widespread usage of social media in our recent daily lifestyles,sentiment analysis becomes an important field in pattern recognition and Natural Language Processing(NLP).In this field,users’feedback data on a specific issue are evaluated and analyzed.Detecting emotions within the text is therefore considered one of the important challenges of the current NLP research.Emotions have been widely studied in psychology and behavioral science as they are an integral part of the human nature.Emotions describe a state of mind of distinct behaviors,feelings,thoughts and experiences.The main objective of this paper is to propose a new model named BERT-CNN to detect emotions from text.This model is formed by a combination of the Bidirectional Encoder Representations from Transformer(BERT)and the Convolutional Neural networks(CNN)for textual classification.This model embraces the BERT to train the word semantic representation language model.According to the word context,the semantic vector is dynamically generated and then placed into the CNN to predict the output.Results of a comparative study proved that the BERT-CNN model overcomes the state-of-art baseline performance produced by different models in the literature using the semeval 2019 task3 dataset and ISEAR datasets.The BERTCNN model achieves an accuracy of 94.7%and an F1-score of 94%for semeval2019 task3 dataset and an accuracy of 75.8%and an F1-score of 76%for ISEAR dataset.

Performance Evaluation of Supervised Machine Learning Techniques for Efficient Detection of Emotions from Online Content

Emotion detection from the text is a challenging problem in the text analytics.The opinion mining experts are focusing on the development of emotion detection applications as they have received considerable attention of online community including users and business organization for collecting and interpreting public emotions.However,most of the existing works on emotion detection used less efficient machine learning classifiers with limited datasets,resulting in performance degradation.To overcome this issue,this work aims at the evaluation of the performance of different machine learning classifiers on a benchmark emotion dataset.The experimental results show the performance of different machine learning classifiers in terms of different evaluation metrics like precision,recall ad f-measure.Finally,a classifier with the best performance is recommended for the emotion classification.

Text-Based Intelligent Learning Emotion System

Nowadays, millions of users use many social media systems every day. These services produce massive messages, which play a vital role in the social networking paradigm. As we see, an intelligent learning emotion system is desperately needed for detecting emotion among these messages. This system could be suitable in understanding users’ feelings towards particular discussion. This paper proposes a text-based emotion recognition approach that uses personal text data to recognize user’s current emotion. The proposed approach applies Dominant Meaning Technique to recognize user’s emotion. The paper reports promising experiential results on the tested dataset based on the proposed algorithm.

The Research about the Role and influence of Teacher emotional support in Online Learning Environment

At the beginning of 2020,the“COVID-19”came out.Affected by the outbreaks,the universities have to carry out online teaching.Online learning provides students with full freedom and personalized learning space,but at the same time,it also brings problems such as weak feelings between teachers and students and lack of learning experience.To solve these problems,this paper adopts the methods of questionnaire survey,experimental control and behavioral modeling.This paper studies how teachers’emotional support behavior affects students’learning process and learning emotion in online learning environment,and proposes that teachers’emotional support behavior is appealed and desired by students.Positive teachers’emotional support behavior can promote students’learning process and improve students’learning emotion.

Faster Region Convolutional Neural Network(FRCNN)Based Facial Emotion Recognition

Facial emotion recognition(FER)has become a focal point of research due to its widespread applications,ranging from human-computer interaction to affective computing.While traditional FER techniques have relied on handcrafted features and classification models trained on image or video datasets,recent strides in artificial intelligence and deep learning(DL)have ushered in more sophisticated approaches.The research aims to develop a FER system using a Faster Region Convolutional Neural Network(FRCNN)and design a specialized FRCNN architecture tailored for facial emotion recognition,leveraging its ability to capture spatial hierarchies within localized regions of facial features.The proposed work enhances the accuracy and efficiency of facial emotion recognition.The proposed work comprises twomajor key components:Inception V3-based feature extraction and FRCNN-based emotion categorization.Extensive experimentation on Kaggle datasets validates the effectiveness of the proposed strategy,showcasing the FRCNN approach’s resilience and accuracy in identifying and categorizing facial expressions.The model’s overall performance metrics are compelling,with an accuracy of 98.4%,precision of 97.2%,and recall of 96.31%.This work introduces a perceptive deep learning-based FER method,contributing to the evolving landscape of emotion recognition technologies.The high accuracy and resilience demonstrated by the FRCNN approach underscore its potential for real-world applications.This research advances the field of FER and presents a compelling case for the practicality and efficacy of deep learning models in automating the understanding of facial emotions.

Exploration of the Integration of Positive Emotions and Flow Experience in STEAM Education

STEAM(science,technology,engineering,arts,and mathematics)education aims to cultivate innovative talents with multidimensional literacy through interdisciplinary integration and innovative practice.However,lack of student motivation has emerged as a key factor hindering its effectiveness.This study explores the integrated application of positive emotions and flow experience in STEAM education from the perspective of positive psychology.It systematically explains how these factors enhance learning motivation and promote knowledge internalization,proposing feasible pathways for instructional design,resource provision,environment creation,and team building.The study provides theoretical insights and practical guidance for transforming STEAM education in the new era.

On the Conflict between Rationality and Emotion in Seize the Day

Saul Bellow'work mainly describes the human who cannot find the standpoint in American society, and they dangled between the ideal and the reality, insisting the belief of love. Seize the Day presents a several-hour experience of a middle-aged man who had lost his job, was estranged from his wife and children, and deserted by his father. With the double writing methods of narrative and recollection, the author reveals thriftily how individual was threatened by social prejudice and the important position of money. He extremely pays attention to the conflict between emotion and rationality to show people's anxiety and contradiction in today's America.

Emotion Deduction from Social Media Text Data Using Machine Learning Algorithm

Emotion represents the feeling of an individual in a given situation. There are various ways to express the emotions of an individual. It can be categorized into verbal expressions, written expressions, facial expressions and gestures. Among these various ways of expressing the emotion, the written method is a challenging task to extract the emotions, as the data is in the form of textual dat. Finding the different kinds of emotions is also a tedious task as it requires a lot of pre preparations of the textual data taken for the research. This research work is carried out to analyse and extract the emotions hidden in text data. The text data taken for the analysis is from the social media dataset. Using the raw text data directly from the social media will not serve the purpose. Therefore, the text data has to be pre-processed and then utilised for further processing. Pre-processing makes the text data more efficient and would infer valuable insights of the emotions hidden in it. The preprocessing steps also help to manage the text data for identifying the emotions conveyed in the text. This work proposes to deduct the emotions taken from the social media text data by applying the machine learning algorithm. Finally, the usefulness of the emotions is suggested for various stake holders, to find the attitude of individuals at that moment, the data is produced. .

Deep Broad Learning for Emotion Classification in Textual Conversations

Emotion classification in textual conversations focuses on classifying the emotion of each utterance from textual conversations.It is becoming one of the most important tasks for natural language processing in recent years.However,it is a challenging task for machines to conduct emotion classification in textual conversations because emotions rely heavily on textual context.To address the challenge,we propose a method to classify emotion in textual conversations,by integrating the advantages of deep learning and broad learning,namely DBL.It aims to provide a more effective solution to capture local contextual information(i.e.,utterance-level)in an utterance,as well as global contextual information(i.e.,speaker-level)in a conversation,based on Convolutional Neural Network(CNN),Bidirectional Long Short-Term Memory(Bi-LSTM),and broad learning.Extensive experiments have been conducted on three public textual conversation datasets,which show that the context in both utterance-level and speaker-level is consistently beneficial to the performance of emotion classification.In addition,the results show that our proposed method outperforms the baseline methods on most of the testing datasets in weighted-average F1.