Improving Targeted Multimodal Sentiment Classification with Semantic Description of Images

Targeted multimodal sentiment classification(TMSC)aims to identify the sentiment polarity of a target mentioned in a multimodal post.The majority of current studies on this task focus on mapping the image and the text to a high-dimensional space in order to obtain and fuse implicit representations,ignoring the rich semantic information contained in the images and not taking into account the contribution of the visual modality in the multimodal fusion representation,which can potentially influence the results of TMSC tasks.This paper proposes a general model for Improving Targeted Multimodal Sentiment Classification with Semantic Description of Images(ITMSC)as a way to tackle these issues and improve the accu-racy of multimodal sentiment analysis.Specifically,the ITMSC model can automatically adjust the contribution of images in the fusion representation through the exploitation of semantic descriptions of images and text similarity relations.Further,we propose a target-based attention module to capture the target-text relevance,an image-based attention module to capture the image-text relevance,and a target-image matching module based on the former two modules to properly align the target with the image so that fine-grained semantic information can be extracted.Our experimental results demonstrate that our model achieves comparable performance with several state-of-the-art approaches on two multimodal sentiment datasets.Our findings indicate that incorporating semantic descriptions of images can enhance our understanding of multimodal content and lead to improved sentiment analysis performance.

Micro-motion effect in inverse synthetic aperture radar imaging of ballistic mid-course targets

For ballistic mid-course targets,in addition to constant orbital motion,the target or any structure on the target undergoes micro-motion dynamics,such as spin,precession and tumbling.The micro-motion characteristics of the ballistic mid-course targets were discussed.The target motion model and inverse synthetic aperture radar(ISAR) imaging model for this kind of targets were built.Then,the influence of micro-motion on ISAR imaging based on the established imaging model was presented.The computer simulation to get mid-course target echoes from static darkroom electromagnetic scattering data based on the established target motion model was realized.The imaging results of computer simulation show the validity of ISAR imaging analysis for micro-motion targets.

Micro-motion dynamics analysis of ballistic targets based on infrared detection

The dynamic characteristics related to micro-motions, such as mechanical vibration or rotation, play an essential role in classifying and recognizing ballistic targets in the midcourse, and recent researches explore ways of extracting the micro-motion features from radar signals of ballistic targets. In this paper, we focus on how to investigate the micro-motion dynamic characteristics of the ballistic targets from the signals based on infrared (IR) detection, which is mainly achieved by analyzing the periodic fluctuation characteristics of the target IR irradiance intensity signatures. Simulation experiments demonstrate that the periodic characteristics of IR signatures can be used to distinguish different micro motion types and estimate related parameters. Consequently, this is possible to determine the micro-motion dynamics of ballistic targets based on IR detection.

A Classification Algorithm for Ground Moving Targets Based on Magnetic Sensors

A novel classification algorithm based on abnormal magnetic signals is proposed for ground moving targets which are made of ferromagnetic material. According to the effect of diverse targets on earth's magnetism,the moving targets are detected by a magnetic sensor and classified with a simple computation method. The detection sensor is used for collecting a disturbance signal of earth magnetic field from an undetermined target. An optimum category match pattern of target signature is tested by training some statistical samples and designing a classification machine. Three ordinary targets are researched in the paper. The experimental results show that the algorithm has a low computation cost and a better sorting accuracy. This classification method can be applied to ground reconnaissance and target intrusion detection.

Classification of birds and drones by exploiting periodical motions in Doppler spectrum series

With the rapidly growing abuse of drones, monitoring and classification of birds and drones have become a crucial safety issue. With similar low radar cross sections(RCSs), velocities, and heights, drones are usually difficult to be distinguished from birds in radar measurements. In this paper, we propose to exploit different periodical motions of birds and drones from highresolution Doppler spectrum sequences(DSSs) for classification.This paper presents an elaborate feature vector representing the periodic fluctuations of RCS and micro kinematics. Fed by the Doppler spectrum and feature sequence, the long to short-time memory(LSTM) is used to solve the time series classification.Different classification schemes to exploit the Doppler spectrum series are validated and compared by extensive real-data experiments, which confirms the effectiveness and superiorities of the proposed algorithm.

Modified joint probabilistic data association with classification-aided for multitarget tracking

Joint probabilistic data association is an effective method for tracking multiple targets in clutter, but only the target kinematic information is used in measure-to-track association. If the kinematic likelihoods are similar for different closely spaced targets, there is ambiguity in using the kinematic information alone; the correct association probability will decrease in conventional joint probabilistic data association algorithm and track coalescence will occur easily. A modified algorithm of joint probabilistic data association with classification-aided is presented, which avoids track coalescence when tracking multiple neighboring targets. Firstly, an identification matrix is defined, which is used to simplify validation matrix to decrease computational complexity. Then, target class information is integrated into the data association process. Performance comparisons with and without the use of class information in JPDA are presented on multiple closely spaced maneuvering targets tracking problem. Simulation results quantify the benefits of classification-aided JPDA for improved multiple targets tracking, especially in the presence of association uncertainty in the kinematic measurement and target maneuvering. Simulation results indicate that the algorithm is valid.

Target classification using SIFT sequence scale invariants

On the basis of scale invariant feature transform（SIFT） descriptors,a novel kind of local invariants based on SIFT sequence scale（SIFT-SS） is proposed and applied to target classification.First of all,the merits of using an SIFT algorithm for target classification are discussed.Secondly,the scales of SIFT descriptors are sorted by descending as SIFT-SS,which is sent to a support vector machine（SVM） with radial based function（RBF） kernel in order to train SVM classifier,which will be used for achieving target classification.Experimental results indicate that the SIFT-SS algorithm is efficient for target classification and can obtain a higher recognition rate than affine moment invariants（AMI） and multi-scale auto-convolution（MSA） in some complex situations,such as the situation with the existence of noises and occlusions.Moreover,the computational time of SIFT-SS is shorter than MSA and longer than AMI.

Effective distributed convolutional neural network architecture for remote sensing images target classification with a pre-training approach

How to recognize targets with similar appearances from remote sensing images(RSIs) effectively and efficiently has become a big challenge. Recently, convolutional neural network(CNN) is preferred in the target classification due to the powerful feature representation ability and better performance. However,the training and testing of CNN mainly rely on single machine.Single machine has its natural limitation and bottleneck in processing RSIs due to limited hardware resources and huge time consuming. Besides, overfitting is a challenge for the CNN model due to the unbalance between RSIs data and the model structure.When a model is complex or the training data is relatively small,overfitting occurs and leads to a poor predictive performance. To address these problems, a distributed CNN architecture for RSIs target classification is proposed, which dramatically increases the training speed of CNN and system scalability. It improves the storage ability and processing efficiency of RSIs. Furthermore,Bayesian regularization approach is utilized in order to initialize the weights of the CNN extractor, which increases the robustness and flexibility of the CNN model. It helps prevent the overfitting and avoid the local optima caused by limited RSI training images or the inappropriate CNN structure. In addition, considering the efficiency of the Na¨?ve Bayes classifier, a distributed Na¨?ve Bayes classifier is designed to reduce the training cost. Compared with other algorithms, the proposed system and method perform the best and increase the recognition accuracy. The results show that the distributed system framework and the proposed algorithms are suitable for RSIs target classification tasks.

Data association based on target signal classification information

In most of the passive tracking systems, only the target kinematical information is used in the measurement-to-track association, which results in error tracking in a multitarget environment, where the targets are too close to each other. To enhance the tracking accuracy, the target signal classification information （TSCI） should be used to improve the data association. The TSCI is integrated in the data association process using the JPDA （joint probabilistic data association）. The use of the TSCI in the data association can improve discrimination by yielding a purer track and preserving continuity. To verify the validity of the application of TSCI, two simulation experiments are done on an air target-tracing problem, that is, one using the TSCI and the other not using the TSCI. The final comparison shows that the use of the TSCI can effectively improve tracking accuracy.

LLE-BASED CLASSIFICATION ALGORITHM FOR MMW RADAR TARGET RECOGNITION

In this paper,a new multiclass classification algorithm is proposed based on the idea of Locally Linear Embedding(LLE),to avoid the defect of traditional manifold learning algorithms,which can not deal with new sample points.The algorithm defines an error as a criterion by computing a sample's reconstruction weight using LLE.Furthermore,the existence and characteristics of low dimensional manifold in range-profile time-frequency information are explored using manifold learning algorithm,aiming at the problem of target recognition about high range resolution MilliMeter-Wave(MMW) radar.The new algorithm is applied to radar target recognition.The experiment results show the algorithm is efficient.Compared with other classification algorithms,our method improves the recognition precision and the result is not sensitive to input parameters.

Deep Learning Based Target Tracking and Classification for Infrared Videos Using Compressive Measurements

Although compressive measurements save data storage and bandwidth usage, they are difficult to be used directly for target tracking and classification without pixel reconstruction. This is because the Gaussian random matrix destroys the target location information in the original video frames. This paper summarizes our research effort on target tracking and classification directly in the compressive measurement domain. We focus on one particular type of compressive measurement using pixel subsampling. That is, original pixels in video frames are randomly subsampled. Even in such a special compressive sensing setting, conventional trackers do not work in a satisfactory manner. We propose a deep learning approach that integrates YOLO (You Only Look Once) and ResNet (residual network) for multiple target tracking and classification. YOLO is used for multiple target tracking and ResNet is for target classification. Extensive experiments using short wave infrared (SWIR), mid-wave infrared (MWIR), and long-wave infrared (LWIR) videos demonstrated the efficacy of the proposed approach even though the training data are very scarce.

Target Tracking and Classification Using Compressive Measurements of MWIR and LWIR Coded Aperture Cameras

Pixel-wise Code Exposure (PCE) camera is one type of compressive sensing camera that has low power consumption and high compression ratio. Moreover, a PCE camera can control individual pixel exposure time that can enable high dynamic range. Conventional approaches of using PCE camera involve a time consuming and lossy process to reconstruct the original frames and then use those frames for target tracking and classification. In this paper, we present a deep learning approach that directly performs target tracking and classification in the compressive measurement domain without any frame reconstruction. Our approach has two parts: tracking and classification. The tracking has been done using YOLO (You Only Look Once) and the classification is achieved using Residual Network (ResNet). Extensive experiments using mid-wave infrared (MWIR) and long-wave infrared (LWIR) videos demonstrated the efficacy of our proposed approach.

New algorithm of target classification in polarimetric SAR

The different approaches used for target decomposition （TD） theory in radar polarimetry are reviewed and three main types of theorems are introduced： those based on Mueller matrix, those using an eigenvector analysis of the coherency matrix, and those employing coherent decomposition of the scattering matrix. Support vector machine （SVM）, as a novel approach in pattern recognition, has demonstrated success in many fields. A new algorithm of target classification, by combining target decomposition and the support vector machine, is proposed. To conduct the experiment, the polarimetric synthetic aperture radar （SAR） data are used. Experimental results show that it is feasible and efficient to target classification by applying target decomposition to extract scattering mechanisms, and the effects of kernel function and its parameters on the classification efficiency are significant.

Eigen-Range Profiles for Radar Target Classification

A new millimet er-wave radar target classification approach based on Eigen-Range Profiles is proposed. Comparing with the conventional matching score approach, it has better classification performance, lower storage and computational requirements owing to the reduction of the target class number in data base. The results have verified the validity of this approach.

Multisource Target Classification Based on Underwater Channel Cepstral Features

Passive target detection through shipping-radiated noise is a key technology in current underwater operations and is of great research value in civil and military fields.In this study,the stable spectral line component of shipping-radiated noise is used as the research object,and the classification of multisource targets is studied from the perspective of underwater channels.We utilize the channel impulse response function as the classification basis of different targets.First,the underwater channel is estimated by the cepstrum.Then,the channel cepstral features carried by different spectral line components are extracted in turn.Finally,the spectral line components belonging to the same target are clustered by the cepstral feature distance to realize the classification of different targets.The simulation and experimental results verify the effectiveness of the proposed method in this research.

A Survey on Joint Target Tracking and Classification

The JTC technology deals with the problem of target tracking and target classification simultaneously within a unified framework.The fundamental idea of the JTC technology is that by taking advantage of the mutual exchange of useful information between the tracker and classifier,significant improvements in performance of both target tracking and target classification can be expected.The principle of JTC technology is introduced.The existing JTC technologies are broadly categorized into two classes,i.e.,point-target-motion-model-based JTC and rigid-target-motion-based JTC,which are then compared in detail.The advance of the JTC technology is surveyed with comments on some related literatures.Finally,some opening topics of the JTC technology are discussed.

New therapeutic options opened by the molecular classification of gastric cancer

Gastric cancer(GC) is one of the most lethal and aggressive cancers, being the third cause of cancer related death worldwide. Even with radical gastrectomy and the latest generation of molecular chemotherapeutics, the numbers of recurrence and mortality remains high. This is due to its biological heterogeneity based on the interaction between multiple factors, from genomic to environmental factors, diet or infections with various pathogens. Therefore, understanding the molecular characteristics at a genomic level is critical to develop new treatment strategies. Recent advances in GC molecular classification provide the unique opportunity to improve GC therapy by exploiting the biomarkers and developing novel targeted therapy specific to each subtype. This article highlights the molecular characteristics of each subtype of gastric cancer that could be considered in shaping a therapeutic decision, and also presents the completed and ongoing clinical trials addressed to those targets. The implementation of the novel molecular classification system will allow a preliminary patient selection for clinical trials, a mandatory issue if it is desired to test the efficacy of a certain inhibitor to the given target. This will represent a substantial advance as well as a powerful tool for targeted therapy. Nevertheless, translating the scientific results into new personalized treatment opportunities is needed in order to improve clinical care, the survival and quality of life of patients with GC.

Molecular classifications of gastric cancers: Novel insights and possible future applications

Despite some notable advances in the systemic management of gastric cancer(GC), the prognosis of patients with advanced disease remains overall poor and their chance of cure is anecdotic. In a molecularly selected population, a median overall survival of 13.8 mo has been reached with the use of human epidermal growth factor 2(HER2) inhibitors in combination with chemotherapy, which has soon after become the standard of care for patients with HER2-overexpressing GC. Moreover, oncologists have recognized the clinical utility of conceiving cancers as a collection of different molecularlydriven entities rather than a single disease. Several molecular drivers have been identified as having crucial roles in other tumors and new molecular classifications have been recently proposed for gastric cancer as well. Not only these classifications allow the identification of different tumor subtypes with unique features, but also they serve as springboard for the development of different therapeutic strategies. Hopefully, the application of standard systemic chemotherapy, specifictargeted agents, immunotherapy or even surgery in specific cancer subgroups will help maximizing treatment outcomes and will avoid treating patients with minimal chance to respond, therefore diluting the average benefit. In this review, we aim at elucidating the aspects of GC molecular subtypes, and the possible future applications of such molecular analyses.

MOVING TARGETS PATTERN RECOGNITION BASED ON THE WAVELET NEURAL NETWORK

Based on pattern recognition theory and neural network technology, moving objects automatic detection and classification method integrating advanced wavelet analysis are discussed in detail. An algorithm of moving targets pattern recognition on the combination of inter-frame difference and wavelet neural network is presented. The experimental results indicate that the designed BP wavelet network using this algorithm can recognize and classify moving targets rapidly and effectively.

基于FPGA的小目标识别分类系统的设计与实现

为了提高小目标识别和分类的实时性,同时降低识别系统的资源消耗,本文提出了一种简易、高效的现场可编程门阵列(Field Programmable Gate Array,FPGA)小目标识别分类系统。该系统首先通过图像预处理消除图像噪点,并采用并行计算提升系统实时性。然后将处理后的图像与模板进行匹配计算得到识别结果,设计的模板匹配电路具有较小的硬件复杂度和较快的处理速度。实验结果表明,本文所提出的识别系统在680×480图像分辨下,可达137.5帧/s的处理速度,实时性强,同时仅消耗了9个块随机存储器(Block Random Access Memory,BRAM)和2个数字信号处理器(Digital Signal Processor,DSP),硬件资源消耗较少,在处理小目标识别和分类问题上有较好的实用价值。