Multimodal sentiment analysis utilizes multimodal data such as text,facial expressions and voice to detect people’s attitudes.With the advent of distributed data collection and annotation,we can easily obtain and sha...Multimodal sentiment analysis utilizes multimodal data such as text,facial expressions and voice to detect people’s attitudes.With the advent of distributed data collection and annotation,we can easily obtain and share such multimodal data.However,due to professional discrepancies among annotators and lax quality control,noisy labels might be introduced.Recent research suggests that deep neural networks(DNNs)will overfit noisy labels,leading to the poor performance of the DNNs.To address this challenging problem,we present a Multimodal Robust Meta Learning framework(MRML)for multimodal sentiment analysis to resist noisy labels and correlate distinct modalities simultaneously.Specifically,we propose a two-layer fusion net to deeply fuse different modalities and improve the quality of the multimodal data features for label correction and network training.Besides,a multiple meta-learner(label corrector)strategy is proposed to enhance the label correction approach and prevent models from overfitting to noisy labels.We conducted experiments on three popular multimodal datasets to verify the superiority of ourmethod by comparing it with four baselines.展开更多
[Objective] The research aimed to study the influence of automatic station data on the sequence continuity of historical meteorological data. [Method] Based on the temperature data which were measured by the automatic...[Objective] The research aimed to study the influence of automatic station data on the sequence continuity of historical meteorological data. [Method] Based on the temperature data which were measured by the automatic meteorological station and the corresponding artificial observation data during January-December in 2001, the monthly average, maximum and minimum temperatures in the automatic station were compared with the corresponding artificial observation temperature data in the parallel observation period by using the contrast difference and the standard deviation of difference value. The difference between the automatic station and the artificial data, the variation characteristics were understood. Meanwhile, the significance test and analysis of annual average value were carried out by the data sequence during 1990-2009. The influence of automatic station replacing the artificial observation on the sequence continuity of historical temperature data was discussed. [Result] Although the two temperature data in the parallel observation period had the certain difference, the difference was in the permitted range of automatic station difference value on average. The difference of individual month surpassed the permitted range of automatic station difference value. The significance test showed that the annual average temperature and the annual average minimum temperature which were observed in the automatic station had the difference with the historical data. It had the certain influence on the annual temperature sequence, but the difference wasn’t significant as a whole. When the automatic observation combined with the artificial observation to use, the sequence needed carry out the homogeneous test and correction. [Conclusion] The research played the important role on guaranteeing the monorail running of automatic station, optimizing the meteorological surface observation system, improving the climate sequence continuity of meteorological element and the reliability of climate statistics.展开更多
In order to provide important parameters for schedule designing, decision-making bases for transit operation management and references for passengers traveling by bus, bus transit travel time reliability is analyzed a...In order to provide important parameters for schedule designing, decision-making bases for transit operation management and references for passengers traveling by bus, bus transit travel time reliability is analyzed and evaluated based on automatic vehicle location (AVL) data. Based on the statistical analysis of the bus transit travel time, six indices including the coefficient of variance, the width of travel time distribution, the mean commercial speed, the congestion frequency, the planning time index and the buffer time index are proposed. Moreover, a framework for evaluating bus transit travel time reliability is constructed. Finally, a case study on a certain bus route in Suzhou is conducted. Results show that the proposed evaluation index system is simple and intuitive, and it can effectively reflect the efficiency and stability of bus operations. And a distinguishing feature of bus transit travel time reliability is the temporal pattern. It varies across different time periods.展开更多
Driver state sensing technologies, such as vehicular systems, start to be widely considered by automotive manufacturers. To reduce the cost and minimize the intrusiveness towards driving, the majority of these systems...Driver state sensing technologies, such as vehicular systems, start to be widely considered by automotive manufacturers. To reduce the cost and minimize the intrusiveness towards driving, the majority of these systems rely on the in-cabin camera(s) and other optical sensors. With their great capabilities in detecting and intervening of driver distraction and inattention,these technologies may become key components in future vehicle safety and control systems. However, to the best of our knowledge,currently, there is no common standard available to objectively compare the performance of these technologies. Thus, it is imperative to develop one standardized process for evaluation purposes.In this paper, we propose one systematic and standardized evaluation process after successfully addressing three difficulties:1) defining and selecting the important influential individual and environmental factors, 2) countering the effects of individual differences and randomness in driver behaviors, and 3) building a reliable in-vehicle driver head motion tracking tool to collect ground-truth motion data. We have collected data on a large scale on a commercial driver state-sensing platform. For each subject, 30 to 40 minutes of head motion data was collected and included variables, such as lighting conditions, head/face features,and camera locations. The collected data was analyzed based on a proposed performance measure. The results show that the developed process can efficiently evaluate an individual camerabased driver state sensing product, which builds a common base for comparing the performance of different systems.展开更多
The inter-class face classification problem is more reasonable than the intra-class classification problem.To address this issue,we have carried out empirical research on classifying Indian people to their geographica...The inter-class face classification problem is more reasonable than the intra-class classification problem.To address this issue,we have carried out empirical research on classifying Indian people to their geographical regions.This work aimed to construct a computational classification model for classifying Indian regional face images acquired from south and east regions of India,referring to human vision.We have created an Automated Human Intelligence System(AHIS)to evaluate human visual capabilities.Analysis of AHIS response showed that face shape is a discriminative feature among the other facial features.We have developed a modified convolutional neural network to characterize the human vision response to improve face classification accuracy.The proposed model achieved mean F1 and Matthew Correlation Coefficient(MCC)of 0.92 and 0.84,respectively,on the validation set,outperforming the traditional Convolutional Neural Network(CNN).The CNN-Contoured Face(CNN-FC)model is developed to train contoured face images to investigate the influence of face shape.Finally,to cross-validate the accuracy of these models,the traditional CNN model is trained on the same dataset.With an accuracy of 92.98%,the Modified-CNN(M-CNN)model has demonstrated that the proposed method could facilitate the tangible impact in intra-classification problems.A novel Indian regional face dataset is created for supporting this supervised classification work,and it will be available to the research community.展开更多
基金supported by STI 2030-Major Projects 2021ZD0200400National Natural Science Foundation of China(62276233 and 62072405)Key Research Project of Zhejiang Province(2023C01048).
文摘Multimodal sentiment analysis utilizes multimodal data such as text,facial expressions and voice to detect people’s attitudes.With the advent of distributed data collection and annotation,we can easily obtain and share such multimodal data.However,due to professional discrepancies among annotators and lax quality control,noisy labels might be introduced.Recent research suggests that deep neural networks(DNNs)will overfit noisy labels,leading to the poor performance of the DNNs.To address this challenging problem,we present a Multimodal Robust Meta Learning framework(MRML)for multimodal sentiment analysis to resist noisy labels and correlate distinct modalities simultaneously.Specifically,we propose a two-layer fusion net to deeply fuse different modalities and improve the quality of the multimodal data features for label correction and network training.Besides,a multiple meta-learner(label corrector)strategy is proposed to enhance the label correction approach and prevent models from overfitting to noisy labels.We conducted experiments on three popular multimodal datasets to verify the superiority of ourmethod by comparing it with four baselines.
文摘[Objective] The research aimed to study the influence of automatic station data on the sequence continuity of historical meteorological data. [Method] Based on the temperature data which were measured by the automatic meteorological station and the corresponding artificial observation data during January-December in 2001, the monthly average, maximum and minimum temperatures in the automatic station were compared with the corresponding artificial observation temperature data in the parallel observation period by using the contrast difference and the standard deviation of difference value. The difference between the automatic station and the artificial data, the variation characteristics were understood. Meanwhile, the significance test and analysis of annual average value were carried out by the data sequence during 1990-2009. The influence of automatic station replacing the artificial observation on the sequence continuity of historical temperature data was discussed. [Result] Although the two temperature data in the parallel observation period had the certain difference, the difference was in the permitted range of automatic station difference value on average. The difference of individual month surpassed the permitted range of automatic station difference value. The significance test showed that the annual average temperature and the annual average minimum temperature which were observed in the automatic station had the difference with the historical data. It had the certain influence on the annual temperature sequence, but the difference wasn’t significant as a whole. When the automatic observation combined with the artificial observation to use, the sequence needed carry out the homogeneous test and correction. [Conclusion] The research played the important role on guaranteeing the monorail running of automatic station, optimizing the meteorological surface observation system, improving the climate sequence continuity of meteorological element and the reliability of climate statistics.
基金The Soft Science Research Project of Ministry of Housing and Urban-Rural Development of China (No. 2008-k5-14)
文摘In order to provide important parameters for schedule designing, decision-making bases for transit operation management and references for passengers traveling by bus, bus transit travel time reliability is analyzed and evaluated based on automatic vehicle location (AVL) data. Based on the statistical analysis of the bus transit travel time, six indices including the coefficient of variance, the width of travel time distribution, the mean commercial speed, the congestion frequency, the planning time index and the buffer time index are proposed. Moreover, a framework for evaluating bus transit travel time reliability is constructed. Finally, a case study on a certain bus route in Suzhou is conducted. Results show that the proposed evaluation index system is simple and intuitive, and it can effectively reflect the efficiency and stability of bus operations. And a distinguishing feature of bus transit travel time reliability is the temporal pattern. It varies across different time periods.
基金supported by Ford Motor Company Research and Innovation Center
文摘Driver state sensing technologies, such as vehicular systems, start to be widely considered by automotive manufacturers. To reduce the cost and minimize the intrusiveness towards driving, the majority of these systems rely on the in-cabin camera(s) and other optical sensors. With their great capabilities in detecting and intervening of driver distraction and inattention,these technologies may become key components in future vehicle safety and control systems. However, to the best of our knowledge,currently, there is no common standard available to objectively compare the performance of these technologies. Thus, it is imperative to develop one standardized process for evaluation purposes.In this paper, we propose one systematic and standardized evaluation process after successfully addressing three difficulties:1) defining and selecting the important influential individual and environmental factors, 2) countering the effects of individual differences and randomness in driver behaviors, and 3) building a reliable in-vehicle driver head motion tracking tool to collect ground-truth motion data. We have collected data on a large scale on a commercial driver state-sensing platform. For each subject, 30 to 40 minutes of head motion data was collected and included variables, such as lighting conditions, head/face features,and camera locations. The collected data was analyzed based on a proposed performance measure. The results show that the developed process can efficiently evaluate an individual camerabased driver state sensing product, which builds a common base for comparing the performance of different systems.
文摘The inter-class face classification problem is more reasonable than the intra-class classification problem.To address this issue,we have carried out empirical research on classifying Indian people to their geographical regions.This work aimed to construct a computational classification model for classifying Indian regional face images acquired from south and east regions of India,referring to human vision.We have created an Automated Human Intelligence System(AHIS)to evaluate human visual capabilities.Analysis of AHIS response showed that face shape is a discriminative feature among the other facial features.We have developed a modified convolutional neural network to characterize the human vision response to improve face classification accuracy.The proposed model achieved mean F1 and Matthew Correlation Coefficient(MCC)of 0.92 and 0.84,respectively,on the validation set,outperforming the traditional Convolutional Neural Network(CNN).The CNN-Contoured Face(CNN-FC)model is developed to train contoured face images to investigate the influence of face shape.Finally,to cross-validate the accuracy of these models,the traditional CNN model is trained on the same dataset.With an accuracy of 92.98%,the Modified-CNN(M-CNN)model has demonstrated that the proposed method could facilitate the tangible impact in intra-classification problems.A novel Indian regional face dataset is created for supporting this supervised classification work,and it will be available to the research community.