Semi-supervised learning based probabilistic latent semantic analysis for automatic image annotation

In recent years,multimedia annotation problem has been attracting significant research attention in multimedia and computer vision areas,especially for automatic image annotation,whose purpose is to provide an efficient and effective searching environment for users to query their images more easily. In this paper,a semi-supervised learning based probabilistic latent semantic analysis( PLSA) model for automatic image annotation is presenred. Since it's often hard to obtain or create labeled images in large quantities while unlabeled ones are easier to collect,a transductive support vector machine( TSVM) is exploited to enhance the quality of the training image data. Then,different image features with different magnitudes will result in different performance for automatic image annotation. To this end,a Gaussian normalization method is utilized to normalize different features extracted from effective image regions segmented by the normalized cuts algorithm so as to reserve the intrinsic content of images as complete as possible. Finally,a PLSA model with asymmetric modalities is constructed based on the expectation maximization( EM) algorithm to predict a candidate set of annotations with confidence scores. Extensive experiments on the general-purpose Corel5k dataset demonstrate that the proposed model can significantly improve performance of traditional PLSA for the task of automatic image annotation.

Automatic"Ground Truth"Annotation and Industrial Workpiece Dataset Generation for Deep Learning

In industry,it is becoming common to detect and recognize industrial workpieces using deep learning methods.In this field,the lack of datasets is a big problem,and collecting and annotating datasets in this field is very labor intensive.The researchers need to perform dataset annotation if a dataset is generated by themselves.It is also one of the restrictive factors that the current method based on deep learning cannot expand well.At present,there are very few workpiece datasets for industrial fields,and the existing datasets are generated from ideal workpiece computer aided design(CAD)models,for which few actual workpiece images were collected and utilized.We propose an automatic industrial workpiece dataset generation method and an automatic ground truth annotation method.Included in our methods are three algorithms that we proposed:a point cloud based spatial plane segmentation algorithm to segment the workpieces in the real scene and to obtain the annotation information of the workpieces in the images captured in the real scene;a random multiple workpiece generation algorithm to generate abundant composition datasets with random rotation workpiece angles and positions;and a tangent vector based contour tracking and completion algorithm to get improved contour images.With our procedures,annotation information can be obtained using the algorithms proposed in this paper.Upon completion of the annotation process,a json format file is generated.Faster R-CNN(Faster R-convolutional neural network),SSD(single shot multibox detector)and YOLO(you only look once:unified,real-time object detection)are trained using the datasets proposed in this paper.The experimental results show the effectiveness and integrity of this dataset generation and annotation method.

Rapid Profiling and Characterization of the Multicomponents from the Root and Rhizome of Salvia miltiorrhiza by Ultra-High Performance Liquid Chromatography/Ion Mobility-Quadrupole Time-of-Flight Mass Spectrometry in Combination with Computational Peak Annotation Workflows

Herbal components characterization represents a challenging task because of the co-existing of multiple classes of naturally occurring compounds with wide spans of polarity,molecular mass,and the ubiquitous isomerism.The root and rhizome of Salvia miltiorrhiza have been utilized as a reputable traditional Chinese medicine Salviae Miltiorrhizae Radix et Rhizoma(Dan-Shen)in the treatment of cardiovascular disease.Herein,a dimensionenhanced ultra-high performance liquid chromatography/ion mobility/quadrupole time-of-flight mass spectrometry approach in combination with intelligent peak annotation workflows was established aimed to rapidly characterize the multicomponents from S.miltiorrhiza.Due to the sufficient optimization,satisfactory chromatography separation was enabled on an HSS T3 column within 33 min using 0.1%formic acid in water(A)and acetonitrile(B)as the mobile phase,while the data-independent HDMS^(E) in both the negative and positive electrospray ionization modes was utilized for the high-coverage MS^(2) data acquisition.Streamlined automatic peak annotation by searching an in-house library(recording 198 known compounds)followed by the subsequent confirming steps(e.g.,comparison with the reference compounds,fragmentation pathways analysis,and retention behavior comparison,etc.),allowed us to identify or tentatively characterize a total of 86 components(including 50 terpenoids,21 phenolic acids,and 15 others)from S.miltiorrhiza.Importantly,three-dimensional structure information,such as the retention time,MS^(1) and MS^(2) data,and collision cross section(CCS),was provided,which can facilitate the more reliable characterization of herbal components.