Multimodal sentiment analysis utilizes multimodal data such as text,facial expressions and voice to detect people’s attitudes.With the advent of distributed data collection and annotation,we can easily obtain and sha...Multimodal sentiment analysis utilizes multimodal data such as text,facial expressions and voice to detect people’s attitudes.With the advent of distributed data collection and annotation,we can easily obtain and share such multimodal data.However,due to professional discrepancies among annotators and lax quality control,noisy labels might be introduced.Recent research suggests that deep neural networks(DNNs)will overfit noisy labels,leading to the poor performance of the DNNs.To address this challenging problem,we present a Multimodal Robust Meta Learning framework(MRML)for multimodal sentiment analysis to resist noisy labels and correlate distinct modalities simultaneously.Specifically,we propose a two-layer fusion net to deeply fuse different modalities and improve the quality of the multimodal data features for label correction and network training.Besides,a multiple meta-learner(label corrector)strategy is proposed to enhance the label correction approach and prevent models from overfitting to noisy labels.We conducted experiments on three popular multimodal datasets to verify the superiority of ourmethod by comparing it with four baselines.展开更多
[Objective] The research aimed to study the influence of automatic station data on the sequence continuity of historical meteorological data. [Method] Based on the temperature data which were measured by the automatic...[Objective] The research aimed to study the influence of automatic station data on the sequence continuity of historical meteorological data. [Method] Based on the temperature data which were measured by the automatic meteorological station and the corresponding artificial observation data during January-December in 2001, the monthly average, maximum and minimum temperatures in the automatic station were compared with the corresponding artificial observation temperature data in the parallel observation period by using the contrast difference and the standard deviation of difference value. The difference between the automatic station and the artificial data, the variation characteristics were understood. Meanwhile, the significance test and analysis of annual average value were carried out by the data sequence during 1990-2009. The influence of automatic station replacing the artificial observation on the sequence continuity of historical temperature data was discussed. [Result] Although the two temperature data in the parallel observation period had the certain difference, the difference was in the permitted range of automatic station difference value on average. The difference of individual month surpassed the permitted range of automatic station difference value. The significance test showed that the annual average temperature and the annual average minimum temperature which were observed in the automatic station had the difference with the historical data. It had the certain influence on the annual temperature sequence, but the difference wasn’t significant as a whole. When the automatic observation combined with the artificial observation to use, the sequence needed carry out the homogeneous test and correction. [Conclusion] The research played the important role on guaranteeing the monorail running of automatic station, optimizing the meteorological surface observation system, improving the climate sequence continuity of meteorological element and the reliability of climate statistics.展开更多
In order to provide important parameters for schedule designing, decision-making bases for transit operation management and references for passengers traveling by bus, bus transit travel time reliability is analyzed a...In order to provide important parameters for schedule designing, decision-making bases for transit operation management and references for passengers traveling by bus, bus transit travel time reliability is analyzed and evaluated based on automatic vehicle location (AVL) data. Based on the statistical analysis of the bus transit travel time, six indices including the coefficient of variance, the width of travel time distribution, the mean commercial speed, the congestion frequency, the planning time index and the buffer time index are proposed. Moreover, a framework for evaluating bus transit travel time reliability is constructed. Finally, a case study on a certain bus route in Suzhou is conducted. Results show that the proposed evaluation index system is simple and intuitive, and it can effectively reflect the efficiency and stability of bus operations. And a distinguishing feature of bus transit travel time reliability is the temporal pattern. It varies across different time periods.展开更多
Driver state sensing technologies, such as vehicular systems, start to be widely considered by automotive manufacturers. To reduce the cost and minimize the intrusiveness towards driving, the majority of these systems...Driver state sensing technologies, such as vehicular systems, start to be widely considered by automotive manufacturers. To reduce the cost and minimize the intrusiveness towards driving, the majority of these systems rely on the in-cabin camera(s) and other optical sensors. With their great capabilities in detecting and intervening of driver distraction and inattention,these technologies may become key components in future vehicle safety and control systems. However, to the best of our knowledge,currently, there is no common standard available to objectively compare the performance of these technologies. Thus, it is imperative to develop one standardized process for evaluation purposes.In this paper, we propose one systematic and standardized evaluation process after successfully addressing three difficulties:1) defining and selecting the important influential individual and environmental factors, 2) countering the effects of individual differences and randomness in driver behaviors, and 3) building a reliable in-vehicle driver head motion tracking tool to collect ground-truth motion data. We have collected data on a large scale on a commercial driver state-sensing platform. For each subject, 30 to 40 minutes of head motion data was collected and included variables, such as lighting conditions, head/face features,and camera locations. The collected data was analyzed based on a proposed performance measure. The results show that the developed process can efficiently evaluate an individual camerabased driver state sensing product, which builds a common base for comparing the performance of different systems.展开更多
The purpose of this study is to analyze the household waste reduction effect of sorted collection of recyclable waste in Japan using a panel data analysis, which considers time-series and cross-section data simultaneo...The purpose of this study is to analyze the household waste reduction effect of sorted collection of recyclable waste in Japan using a panel data analysis, which considers time-series and cross-section data simultaneously. Also, the study shows the effect of the type of sorted items on the quantity of household waste disposed. We used the data attained from 103 cities recorded over three years, and applied the quantity of total waste disposed, the quantity of combustible waste, the quantity of other waste (waste excluding combustible and recyclable waste), and the quantity of combustible plus other waste as objective variables, respectively, in the models. The result suggests that when the number of sorted items is increased marginally, the quantity of household waste decreases by about 0.5%-3.3% or 1.28-4.17 grams per capita per day. In addition, it is shown that sorting out white trays is effective in reducing the quantity of combustible waste. Sorting out paper containers and packages is also effective in reducing the quantity of other waste and combustible plus other waste.展开更多
In recent years, maritime transportation has played an important role in global economy development. As a result, ship traffic has become more congested. Moreover, ship navigation is susceptible to weather and environ...In recent years, maritime transportation has played an important role in global economy development. As a result, ship traffic has become more congested. Moreover, ship navigation is susceptible to weather and environmental conditions, and in some cases, it may become dangerous. Therefore, vessels are subjected to high-risk navigation conditions. To understand the latent risk of ship navigation, this study focused on the actual ship behavior. Thus, an analysis of ship behavior was carded out using historical ship navigation based on automatic identification system data. Consequently, a dynamic analysis of the speed and encounter situation was performed. One of the main results of this work was the understanding of the latent risk involved in ships navigating the Seto Inland Sea, which is one of the most congested routes in Japan. Moreover, the risk areas were obtained, and visualized using a geographical information system. The obtained results can be applied to ensure safe navigation and the development of a safe and efficient navigation model.展开更多
The inter-class face classification problem is more reasonable than the intra-class classification problem.To address this issue,we have carried out empirical research on classifying Indian people to their geographica...The inter-class face classification problem is more reasonable than the intra-class classification problem.To address this issue,we have carried out empirical research on classifying Indian people to their geographical regions.This work aimed to construct a computational classification model for classifying Indian regional face images acquired from south and east regions of India,referring to human vision.We have created an Automated Human Intelligence System(AHIS)to evaluate human visual capabilities.Analysis of AHIS response showed that face shape is a discriminative feature among the other facial features.We have developed a modified convolutional neural network to characterize the human vision response to improve face classification accuracy.The proposed model achieved mean F1 and Matthew Correlation Coefficient(MCC)of 0.92 and 0.84,respectively,on the validation set,outperforming the traditional Convolutional Neural Network(CNN).The CNN-Contoured Face(CNN-FC)model is developed to train contoured face images to investigate the influence of face shape.Finally,to cross-validate the accuracy of these models,the traditional CNN model is trained on the same dataset.With an accuracy of 92.98%,the Modified-CNN(M-CNN)model has demonstrated that the proposed method could facilitate the tangible impact in intra-classification problems.A novel Indian regional face dataset is created for supporting this supervised classification work,and it will be available to the research community.展开更多
基金supported by STI 2030-Major Projects 2021ZD0200400National Natural Science Foundation of China(62276233 and 62072405)Key Research Project of Zhejiang Province(2023C01048).
文摘Multimodal sentiment analysis utilizes multimodal data such as text,facial expressions and voice to detect people’s attitudes.With the advent of distributed data collection and annotation,we can easily obtain and share such multimodal data.However,due to professional discrepancies among annotators and lax quality control,noisy labels might be introduced.Recent research suggests that deep neural networks(DNNs)will overfit noisy labels,leading to the poor performance of the DNNs.To address this challenging problem,we present a Multimodal Robust Meta Learning framework(MRML)for multimodal sentiment analysis to resist noisy labels and correlate distinct modalities simultaneously.Specifically,we propose a two-layer fusion net to deeply fuse different modalities and improve the quality of the multimodal data features for label correction and network training.Besides,a multiple meta-learner(label corrector)strategy is proposed to enhance the label correction approach and prevent models from overfitting to noisy labels.We conducted experiments on three popular multimodal datasets to verify the superiority of ourmethod by comparing it with four baselines.
文摘[Objective] The research aimed to study the influence of automatic station data on the sequence continuity of historical meteorological data. [Method] Based on the temperature data which were measured by the automatic meteorological station and the corresponding artificial observation data during January-December in 2001, the monthly average, maximum and minimum temperatures in the automatic station were compared with the corresponding artificial observation temperature data in the parallel observation period by using the contrast difference and the standard deviation of difference value. The difference between the automatic station and the artificial data, the variation characteristics were understood. Meanwhile, the significance test and analysis of annual average value were carried out by the data sequence during 1990-2009. The influence of automatic station replacing the artificial observation on the sequence continuity of historical temperature data was discussed. [Result] Although the two temperature data in the parallel observation period had the certain difference, the difference was in the permitted range of automatic station difference value on average. The difference of individual month surpassed the permitted range of automatic station difference value. The significance test showed that the annual average temperature and the annual average minimum temperature which were observed in the automatic station had the difference with the historical data. It had the certain influence on the annual temperature sequence, but the difference wasn’t significant as a whole. When the automatic observation combined with the artificial observation to use, the sequence needed carry out the homogeneous test and correction. [Conclusion] The research played the important role on guaranteeing the monorail running of automatic station, optimizing the meteorological surface observation system, improving the climate sequence continuity of meteorological element and the reliability of climate statistics.
基金The Soft Science Research Project of Ministry of Housing and Urban-Rural Development of China (No. 2008-k5-14)
文摘In order to provide important parameters for schedule designing, decision-making bases for transit operation management and references for passengers traveling by bus, bus transit travel time reliability is analyzed and evaluated based on automatic vehicle location (AVL) data. Based on the statistical analysis of the bus transit travel time, six indices including the coefficient of variance, the width of travel time distribution, the mean commercial speed, the congestion frequency, the planning time index and the buffer time index are proposed. Moreover, a framework for evaluating bus transit travel time reliability is constructed. Finally, a case study on a certain bus route in Suzhou is conducted. Results show that the proposed evaluation index system is simple and intuitive, and it can effectively reflect the efficiency and stability of bus operations. And a distinguishing feature of bus transit travel time reliability is the temporal pattern. It varies across different time periods.
基金supported by Ford Motor Company Research and Innovation Center
文摘Driver state sensing technologies, such as vehicular systems, start to be widely considered by automotive manufacturers. To reduce the cost and minimize the intrusiveness towards driving, the majority of these systems rely on the in-cabin camera(s) and other optical sensors. With their great capabilities in detecting and intervening of driver distraction and inattention,these technologies may become key components in future vehicle safety and control systems. However, to the best of our knowledge,currently, there is no common standard available to objectively compare the performance of these technologies. Thus, it is imperative to develop one standardized process for evaluation purposes.In this paper, we propose one systematic and standardized evaluation process after successfully addressing three difficulties:1) defining and selecting the important influential individual and environmental factors, 2) countering the effects of individual differences and randomness in driver behaviors, and 3) building a reliable in-vehicle driver head motion tracking tool to collect ground-truth motion data. We have collected data on a large scale on a commercial driver state-sensing platform. For each subject, 30 to 40 minutes of head motion data was collected and included variables, such as lighting conditions, head/face features,and camera locations. The collected data was analyzed based on a proposed performance measure. The results show that the developed process can efficiently evaluate an individual camerabased driver state sensing product, which builds a common base for comparing the performance of different systems.
文摘The purpose of this study is to analyze the household waste reduction effect of sorted collection of recyclable waste in Japan using a panel data analysis, which considers time-series and cross-section data simultaneously. Also, the study shows the effect of the type of sorted items on the quantity of household waste disposed. We used the data attained from 103 cities recorded over three years, and applied the quantity of total waste disposed, the quantity of combustible waste, the quantity of other waste (waste excluding combustible and recyclable waste), and the quantity of combustible plus other waste as objective variables, respectively, in the models. The result suggests that when the number of sorted items is increased marginally, the quantity of household waste decreases by about 0.5%-3.3% or 1.28-4.17 grams per capita per day. In addition, it is shown that sorting out white trays is effective in reducing the quantity of combustible waste. Sorting out paper containers and packages is also effective in reducing the quantity of other waste and combustible plus other waste.
文摘In recent years, maritime transportation has played an important role in global economy development. As a result, ship traffic has become more congested. Moreover, ship navigation is susceptible to weather and environmental conditions, and in some cases, it may become dangerous. Therefore, vessels are subjected to high-risk navigation conditions. To understand the latent risk of ship navigation, this study focused on the actual ship behavior. Thus, an analysis of ship behavior was carded out using historical ship navigation based on automatic identification system data. Consequently, a dynamic analysis of the speed and encounter situation was performed. One of the main results of this work was the understanding of the latent risk involved in ships navigating the Seto Inland Sea, which is one of the most congested routes in Japan. Moreover, the risk areas were obtained, and visualized using a geographical information system. The obtained results can be applied to ensure safe navigation and the development of a safe and efficient navigation model.
文摘The inter-class face classification problem is more reasonable than the intra-class classification problem.To address this issue,we have carried out empirical research on classifying Indian people to their geographical regions.This work aimed to construct a computational classification model for classifying Indian regional face images acquired from south and east regions of India,referring to human vision.We have created an Automated Human Intelligence System(AHIS)to evaluate human visual capabilities.Analysis of AHIS response showed that face shape is a discriminative feature among the other facial features.We have developed a modified convolutional neural network to characterize the human vision response to improve face classification accuracy.The proposed model achieved mean F1 and Matthew Correlation Coefficient(MCC)of 0.92 and 0.84,respectively,on the validation set,outperforming the traditional Convolutional Neural Network(CNN).The CNN-Contoured Face(CNN-FC)model is developed to train contoured face images to investigate the influence of face shape.Finally,to cross-validate the accuracy of these models,the traditional CNN model is trained on the same dataset.With an accuracy of 92.98%,the Modified-CNN(M-CNN)model has demonstrated that the proposed method could facilitate the tangible impact in intra-classification problems.A novel Indian regional face dataset is created for supporting this supervised classification work,and it will be available to the research community.