Training of Multi-layered Neural Network for Data Enlargement Processing Using an Activity Function

In this paper, we present a study on activity functions for an MLNN (multi-layered neural network) and propose a suitable activity function for data enlargement processing. We have carefully studied the training performance of Sigmoid, ReLu, Leaky-ReLu and L & exp. activity functions for few inputs to multiple output training patterns. Our MLNNs model has L hidden layers with two or three inputs to four or six outputs data variations by BP (backpropagation) NN (neural network) training. We focused on the multi teacher training signals to investigate and evaluate the training performance in MLNNs to select the best and good activity function for data enlargement and hence could be applicable for image and signal processing (synaptic divergence) along with the proposed methods with convolution networks. We specifically used four activity functions from which we found out that L & exp. activity function can suite DENN (data enlargement neural network) training since it could give the highest percentage training abilities compared to the other activity functions of Sigmoid, ReLu and Leaky-ReLu during simulation and training of data in the network. And finally, we recommend L & exp. function to be good for MLNNs and may be applicable for signal processing of data and information enlargement because of its performance training characteristics with multiple teacher training patterns using original generated data and hence can be tried with CNN (convolution neural networks) of image processing.

A Support Data-Based Core-Set Selection Method for Signal Recognition

In recent years,deep learning-based signal recognition technology has gained attention and emerged as an important approach for safeguarding the electromagnetic environment.However,training deep learning-based classifiers on large signal datasets with redundant samples requires significant memory and high costs.This paper proposes a support databased core-set selection method(SD)for signal recognition,aiming to screen a representative subset that approximates the large signal dataset.Specifically,this subset can be identified by employing the labeled information during the early stages of model training,as some training samples are labeled as supporting data frequently.This support data is crucial for model training and can be found using a border sample selector.Simulation results demonstrate that the SD method minimizes the impact on model recognition performance while reducing the dataset size,and outperforms five other state-of-the-art core-set selection methods when the fraction of training sample kept is less than or equal to 0.3 on the RML2016.04C dataset or 0.5 on the RML22 dataset.The SD method is particularly helpful for signal recognition tasks with limited memory and computing resources.

ON THE PERFORMANCE OF DATA-DEPENDENT SUPERIMPOSED TRAINING WITHOUT CYCLIC PREFIX FOR SISO/MIMO SYSTEMS

Compared with channel estimation method based on explicit training sequences,bandwidth is saved for those methods using superimposed training sequences,while it is wasted when Cyclic Prefix(CP) is added.In previous work of McLernon,the Mean Square Error(MSE) performance of Data-Dependent Superimposed Training(DDST) without CP for Single-Input Single-Output(SISO) system was analyzed under the assumption that the data-dependent sequence matrix was a circulant matrix and not interfered by others.In fact,for the system without CP,the data-dependent sequence matrix is not circulant any more and will be interfered.This paper derives the exact expression of MSE for the system without CP and also gives its extension to Multiple-Input Multiple-Output(MIMO) system without CP.

一种基于Tri-training的数据流集成分类算法

数据流分类是数据挖掘领域的重要研究任务之一,已有的数据流分类算法大多是在有标记数据集上进行训练,而实际应用领域数据流中有标记的数据数量极少。为解决这一问题,可通过人工标注的方式获取标记数据,但人工标注昂贵且耗时。考虑到未标记数据的数量极大且隐含大量信息,因此在保证精度的前提下,为利用这些未标记数据的信息,本文提出了一种基于Tri-training的数据流集成分类算法。该算法采用滑动窗口机制将数据流分块,在前k块含有未标记数据和标记数据的数据集上使用Tri-training训练基分类器,通过迭代的加权投票方式不断更新分类器直到所有未标记数据都被打上标记,并利用k个Tri-training集成模型对第k+1块数据进行预测,丢弃分类错误率高的分类器并在当前数据块上重建新分类器从而更新当前模型。在10个UCI数据集上的实验结果表明:与经典算法相比,本文提出的算法在含80%未标记数据的数据流上的分类精度有显著提高。

基于Tri-Training半监督分类算法的研究

在实际应用中,容易获取大量的未标记样本数据,而样本数据是有限的,因此,半监督分类算法成为研究者关注的热点。文中在协同训练Tri-Training算法的基础上,提出了采用两个不同的训练分类器的Simple-Tri-Training方法和对标记数据进行编辑的Edit-Tri-Training方法,给出了这三种分类方法与监督分类SVM的分类实验结果的比较和分析。实验表明,无标记数据的引入,在一定程度上提高了分类的性能;初始训练集和分类器的选取以及标记过程中数据编辑技术,都是影响半监督分类稳定性和性能的关键点。

基于自适应数据剪辑策略的Tri-training算法

Tri-training能有效利用无标记样例提高泛化能力.针对Tri-training迭代中无标记样例常被错误标记而形成训练集噪声,导致性能不稳定的缺点,文中提出ADE-Tri-training(Tri-training with Adaptive Data Editing)新算法.它不仅利用Remove Only剪辑操作对每次迭代可能产生的误标记样例识别并移除,更重要的是采用自适应策略来确定Remove Only触发与抑制的恰当时机.文中证明,PAC理论下自适应策略中一系列判别充分条件可同时确保新训练集规模迭代增大和新假设分类错误率迭代降低更多.UCI数据集上实验结果表明:ADE-Tri-training具有更好的分类泛化性能和健壮性.

基于Tri-Training和数据剪辑的半监督聚类算法

提出一种半监督聚类算法,该算法在用seeds集初始化聚类中心前,利用半监督分类方法Tri-training的迭代训练过程对无标记数据进行标记,并加入seeds集以扩大规模;同时,在Tri-training训练过程中结合基于最近邻规则的Depuration数据剪辑技术对seeds集扩大过程中产生的误标记噪声数据进行修正、净化,以提高seeds集质量.实验结果表明,所提出的基于Tri-training和数据剪辑的DE-Tri-training半监督聚类新算法能够有效改善seeds集对聚类中心的初始化效果,提高聚类性能.

基于Tri-training与噪声过滤的弱监督关系抽取

弱监督关系抽取利用已有关系实体对从文本集中自动获取训练数据,有效解决了训练数据不足的问题。针对弱监督训练数据存在噪声、特征不足和不平衡,导致关系抽取性能不高的问题,文中提出NF-Tri-training(Tritraining with Noise Filtering)弱监督关系抽取算法。它利用欠采样解决样本不平衡问题,基于Tri-training从未标注数据中迭代学习新的样本,提高分类器的泛化能力,采用数据编辑技术识别并移除初始训练数据和每次迭代产生的错标样本。在互动百科采集数据集上实验结果表明NF-Tri-training算法能够有效提升关系分类器的性能。

基于Tri-Training算法的数据编辑技术

Tri-Training是一种半监督学习算法,在少量标记数据下,通过三个不同的分类器,从未标记样本中采样并标记新的训练数据,作为各分类器训练数据的有效补充。但由于错误标记样本的存在,引入了噪音数据,降低了分类的性能。论文在Tri-Training算法中分别采用DE-KNN,DE-BKNN和DE-NED三种数据编辑技术,识别移除误标记的数据。通过对六组UCI数据集的实验,分析结果表明,编辑技术的引入是有效的,三种方法的使用在一定程度上提升了Tri-Training算法的分类性能,尤其是DE-NED方法更为显著。

用于在线产品评论质量分析的Co-training算法

在线评论广泛存在于电子商务网站平台,其中包含着客户对产品的评价及偏好.高效分析在线评论数据并满足客户需求,对许多谋求立足于竞争激烈的国际化市场的企业来说至关重要.但因在线评论的质量不一,使得如何分析在线评论的质量成为一项重要工作.从两个方面提取特征对在线评论进行描述,并构建了一种Co-training算法来判断评论的质量.通过对比实验验证了该算法相对于单一分类算法的优势.

Closing the loop between data mining and fast decision support for intelligent train scheduling and traffic control

The existing Big Data of transport flows and railway operations can be mined through advanced statistical analysis and machine learning methods in order to describe and predict well the train speed, punctuality, track capacity and energy consumption. The accurate modelling of the real spatial and temporal distribution of line and network transport, traffic and performance stimulates a faster construction and implementation of robust and resilient timetables, as well as the development of efficient decision support tools for real-time rescheduling of train schedules. In combination with advanced train control and safety systems even (semi-.) automatic piloting of trains on main and regional railway lines will become feasible in near future.

基于多视图Tri-Training的微博用户性别判断

互联网技术不断发展,新浪微博作为公开的网络社交平台拥有庞大的活跃用户.然而由于用户数量庞大,且个人信息并不一定真实,造成训练样本打标困难.本文采用了一种多视图tri-training的方法,构建三个不同的视图,利用这些视图中少量已打标样本和未打标样本不断重复互相训练三个不同的分类器,最后集成这三个分类器实现用户性别判断.本文用真实用户数据进行实验,发现和单一视图分类器相比,使用多视图tri-training学习训练后的分类器准确性更好,且需要打标的样本更少.

A training image optimization method in multiple-point geostatistics and its application in geological modeling

Based on the analysis of the high-order compatibility optimization method proposed by predecessors, a new training image optimization method based on data event repetition probability is proposed. The basic idea is to extract the data event contained in the condition data and calculate the number of repetitions of the extracted data events and their repetition probability in the training image to obtain two statistical indicators, unmatched ratio and repeated probability variance of data events. The two statistical indicators are used to characterize the diversity and stability of the sedimentary model in the training image and evaluate the matching of the geological volume spatial structure contained in data of the well block to be modeled. The unmatched ratio reflects the completeness of geological model in training image, which is the first choice index. The repeated probability variance reflects the stationarity index of geological model of each training image, and is an auxiliary index. Then, we can integrate the above two indexes to achieve the optimization of training image. Multiple sets of theoretical model tests show that the training image with small variance and low no-matching ratio is the optimal training image. The method is used to optimize the training image of turbidite channel in Plutonio oilfield in Angola. The geological model established by this method is in good agreement with the seismic attributes and can better reproduce the morphological characteristics of the channels and distribution pattern of sands.

Classifying Unstructured Text Using Structured Training Instances and an Ensemble of Classifiers

Typical supervised classification techniques require training instances similar to the values that need to be classified. This research proposes a methodology that can utilize training instances found in a different format. The benefit of this approach is that it allows the use of traditional classification techniques, without the need to hand-tag training instances if the information exists in other data sources. The proposed approach is presented through a practical classification application. The evaluation results show that the approach is viable, and that the segmentation of classifiers can greatly improve accuracy.

基于改进Tri-Training算法的大数据保险业客户分类研究

保险行业正处于比较快速的发展阶段,为了能够盈利,构建良好的客户关系是非常关键的,可利用改进TriTraining算法对大数据保险业客户进行分类.首先确定保险业客户细分的指标;其次分析改进Tri-Training分类算法的基本理论;再次设计基于改进Tri-Training算法的大数据保险业客户分类流程;最后进行大数据保险业客户的分类实例研究,研究结果表明改进Tri-Training算法能够有效地提升保险业客户分类的精度.

A Modified Generative Adversarial Network for Fault Diagnosis in High-Speed Train Components with Imbalanced and Heterogeneous Monitoring Data

Data-driven methods are widely considered for fault diagnosis in complex systems.However,in practice,the between-class imbalance due to limited faulty samples may deteriorate their classification performance.To address this issue,synthetic minority methods for enhancing data have been proved to be effective in many applications.Generative adversarial networks(GANs),capable of automatic features extraction,can also be adopted for augmenting the faulty samples.However,the monitoring data of a complex system may include not only continuous signals but also discrete/categorical signals.Since the current GAN methods still have some challenges in handling such heterogeneous monitoring data,a Mixed Dual Discriminator GAN(noted as M-D2GAN)is proposed in this work.In order to render the expanded fault samples more aligned with the real situation and improve the accuracy and robustness of the fault diagnosis model,different types of variables are generated in different ways,including floating-point,integer,categorical,and hierarchical.For effectively considering the class imbalance problem,proper modifications are made to the GAN model,where a normal class discriminator is added.A practical case study concerning the braking system of a high-speed train is carried out to verify the effectiveness of the proposed framework.Compared to the classic GAN,the proposed framework achieves better results with respect to F-measure and G-mean metrics.

Study on key technologies of GNSS-based train state perception for traincentric railway signaling

The application of Global Navigation Satellite Systems(GNSSs)in the intelligent railway systems is rapidly developing all over the world.With the GNSs-based train positioning and moving state perception,the autonomy and flexibility of a novel train control system can be greatly enhanced over the existing solutions relying on the track-side facilities.Considering the safety critical features of the railway signaling applications,the GNSS stand-alone mode may not be sufficient to satisfy the practical requirements.In this paper,the key technologies for applying GNSS in novel train-centric railway signaling systems are investigated,including the multi-sensor data fusion,Virtual Balise(VB)capturing and messaging,train integrity monitoring and system performance evaluation.According to the practical characteristics of the novel train control system under the moving block mode,the details of the key technologies are introduced.Field demonstration results of a novel train control system using the presented technologies under the practical railway operation conditions are presented to illustrate the achievable performance feature of autonomous train state perception using BeiDou Navigation Satellite System(BDS)and related solutions.It reveals the great potentials of these key technologies in the next generation train control system and other GNSS-based railway implementations.

大数据时代空间信息与数字技术专业建设探讨

面对大数据时代“空间信息与数字技术”专业建设的挑战,如何适应经济社会发展的人才需求,培养兼具“信息技术”+“领域知识”的“空间信息与数字技术”专业的复合型人才,是该专业持续建设需要着重探讨的问题。从创新“3332”人才培养模式、重构“信息技术+领域知识”的课程体系、构建“基础-综合-创新”相结合的实践教学体系三方面对该专业的建设问题进行了探讨,给出了与之对应的专业建设的具体措施、路径与办法,以期为大数据时代“空间信息与数字技术”专业建设和人才培养提供参考,以满足国家战略对该专业高层次复合型人才培养的需求。