Data augmentation in microscopic images for material data mining

Recent progress in material data mining has been driven by high-capacity models trained on large datasets.However,collecting experimental data(real data)has been extremely costly owing to the amount of human effort and expertise required.Here,we develop a novel transfer learning strategy to address problems of small or insufficient data.This strategy realizes the fusion of real and simulated data and the augmentation of training data in a data mining procedure.For a specific task of grain instance image segmentation,this strategy aims to generate synthetic data by fusing the images obtained from simulating the physical mechanism of grain formation and the“image style”information in real images.The results show that the model trained with the acquired synthetic data and only 35%of the real data can already achieve competitive segmentation performance of a model trained on all of the real data.Because the time required to perform grain simulation and to generate synthetic data are almost negligible as compared to the effort for obtaining real data,our proposed strategy is able to exploit the strong prediction power of deep learning without significantly increasing the experimental burden of training data preparation.

Multiple feature fusion for unimodal emotion recognition

A new semi-serial fusion method of multiple feature based on learning using privileged information(LUPI) model was put forward.The exploitation of LUPI paradigm permits the improvement of the learning accuracy and its stability,by additional information and computations using optimization methods.The execution time is also reduced,by sparsity and dimension of testing feature.The essence of improvements obtained using multiple features types for the emotion recognition(speech expression recognition),is particularly applicable when there is only one modality but still need to improve the recognition.The results show that the LUPI in unimodal case is effective when the size of the feature is considerable.In comparison to other methods using one type of features or combining them in a concatenated way,this new method outperforms others in recognition accuracy,execution reduction,and stability.

Author Correction:Data augmentation in microscopic images for material data mining

The original version of this article omitted the following from the Acknowledgements:“This work was supported by Beijing Top Discipline for Artificial Intelligent Science and Engineering,University of Science and Technology Beijing”.This has now been corrected in both the PDF and HTML versions of the article.