Empirical Likelihood Statistical Inference for Compound Poisson Vector Processes under Infinite Covariance Matrix

The paper discusses the statistical inference problem of the compound Poisson vector process(CPVP)in the domain of attraction of normal law but with infinite covariance matrix.The empirical likelihood(EL)method to construct confidence regions for the mean vector has been proposed.It is a generalization from the finite second-order moments to the infinite second-order moments in the domain of attraction of normal law.The log-empirical likelihood ratio statistic for the average number of the CPVP converges to F distribution in distribution when the population is in the domain of attraction of normal law but has infinite covariance matrix.Some simulation results are proposed to illustrate the method of the paper.

Constrained Run-to-Run Optimization for Batch Process Based on Support Vector Regression Model

An iterative (run-to-run) optimization method was presented for batch processes under input constraints. Generally it is very difficult to acquire an accurate mechanistic model for a batch process.Because support vector machine is powerful for the problems characterized by small samples,nonlinearity, high dimension and local minima, support vector regression models were developed for the end-point optimization of batch processes. Since there is no analytical way to find the optimal trajectory, an iterative method was used to exploit the repetitive nature of batch processes to determine the optimal operating policy. The optimization algorithm is proved convergent. The numerical simulation shows that the method can improve the process performance through iterations.

Fault-Diagnosis Method Based on Support Vector Machine and Artificial Immune for Batch Process

A new fault-diagnosis method to be used in batch processes based on multi-phase regression is presented to overcome the difficulty arising in the processes due to non-uniform sample data in each phase.Support vector machine is first used for phase identification,and for each phase,improved artificial immune network is developed to analyze and recognize fault patterns.A new cell elimination role is proposed to enhance the incremental clustering capability of the immune network.The proposed method has been applied to glutamic acid fermentation,comparison results have indicated that the proposed approach can better classify fault samples and yield higher diagnosis precision.

State of the art in applications of machine learning in steelmaking process modeling

With the development of automation and informatization in the steelmaking industry,the human brain gradually fails to cope with an increasing amount of data generated during the steelmaking process.Machine learning technology provides a new method other than production experience and metallurgical principles in dealing with large amounts of data.The application of machine learning in the steelmaking process has become a research hotspot in recent years.This paper provides an overview of the applications of machine learning in the steelmaking process modeling involving hot metal pretreatment,primary steelmaking,secondary refining,and some other aspects.The three most frequently used machine learning algorithms in steelmaking process modeling are the artificial neural network,support vector machine,and case-based reasoning,demonstrating proportions of 56%,14%,and 10%,respectively.Collected data in the steelmaking plants are frequently faulty.Thus,data processing,especially data cleaning,is crucially important to the performance of machine learning models.The detection of variable importance can be used to optimize the process parameters and guide production.Machine learning is used in hot metal pretreatment modeling mainly for endpoint S content prediction.The predictions of the endpoints of element compositions and the process parameters are widely investigated in primary steelmaking.Machine learning is used in secondary refining modeling mainly for ladle furnaces,Ruhrstahl–Heraeus,vacuum degassing,argon oxygen decarburization,and vacuum oxygen decarburization processes.Further development of machine learning in the steelmaking process modeling can be realized through additional efforts in the construction of the data platform,the industrial transformation of the research achievements to the practical steelmaking process,and the improvement of the universality of the machine learning models.

Soft sensor design for hydrodesulfurization process using support vector regression based on WT and PCA

A novel method for developing a reliable data driven soft sensor to improve the prediction accuracy of sulfur content in hydrodesulfurization(HDS) process was proposed. Therefore, an integrated approach using support vector regression(SVR) based on wavelet transform(WT) and principal component analysis(PCA) was used. Experimental data from the HDS setup were employed to validate the proposed model. The results reveal that the integrated WT-PCA with SVR model was able to increase the prediction accuracy of SVR model. Implementation of the proposed model delivers the best satisfactory predicting performance(EAARE=0.058 and R2=0.97) in comparison with SVR. The obtained results indicate that the proposed model is more reliable and more precise than the multiple linear regression(MLR), SVR and PCA-SVR.

Data-driven optimal operation of the industrial methanol to olefin process based on relevance vector machine

Methanol to olefin(MTO)technology provides the opportunity to produce olefins from nonpetroleum sources such as coal,biomass and natural gas.More than 20 commercial MTO plants have been put into operation.Till now,contributions on optimal operation of industrial MTO plants from a process systems engineering perspective are rare.Based on relevance vector machine(RVM),a data-driven framework for optimal operation of the industrial MTO process is established to fully utilize the plentiful industrial data sets.RVM correlates the yield distribution prediction of main products and the operation conditions.These correlations then serve as the constraints for the multi-objective optimization model to pursue the optimal operation of the plant.Nondominated sorting genetic algorithmⅡis used to solve the optimization problem.Comprehensive tests demonstrate that the ethylene yield is effectively improved based on the proposed framework.Since RVM does provide the distribution prediction instead of point estimation,the established model is expected to provide guidance for actual production operations under uncertainty.

Cuckoo Optimized Convolution Support Vector Machine for Big Health Data Processing

Big health data collection and storing for further analysis is a challenging task because this knowledge is big and has many features.Several cloud-based IoT health providers have been described in the literature previously.Furthermore,there are a number of issues related to time consumed and overall network performance when it comes to big data information.In the existing method,less performed optimization algorithms were used for optimizing the data.In the proposed method,the Chaotic Cuckoo Optimization algorithm was used for feature selection,and Convolutional Support Vector Machine(CSVM)was used.The research presents a method for analyzing healthcare information that uses in future prediction.The major goal is to take a variety of data while improving efficiency and minimizing process time.The suggested method employs a hybrid method that is divided into two stages.In the first stage,it reduces the features by using the Chaotic Cuckoo Optimization algorithm with Levy flight,opposition-based learning,and distributor operator.In the second stage,CSVM is used which combines the benefits of convolutional neural network(CNN)and SVM.The CSVM modifies CNN’s convolution product to learn hidden deep inside data sources.For improved economic flexibility,greater protection,greater analytics with confidentiality,and lower operating cost,the suggested approach is built on fog computing.Overall results of the experiments show that the suggested method can minimize the number of features in the datasets,enhances the accuracy by 82%,and decrease the time of the process.

Combination Method of Principal Component Analysis and Support Vector Machine for On-line Process Monitoring and Fault Diagnosis

On-line monitoring and fault diagnosis of chemical process is extremely important for operation safety and product quality. Principal component analysis (PCA) has been widely used in multivariate statistical process monitoring for its ability to reduce processes dimensions. PCA and other statistical techniques, however, have difficulties in differentiating faults correctly in complex chemical process. Support vector machine (SVM) is a novel approach based on statistical learning theory, which has emerged for feature identification and classification. In this paper, an integrated method is applied for process monitoring and fault diagnosis, which combines PCA for fault feature extraction and multiple SVMs for identification of different fault sources. This approach is verified and illustrated on the Tennessee Eastman benchmark process as a case study. Results show that the proposed PCA-SVMs method has good diagnosis capability and overall diagnosis correctness rate.

Multimode Process Monitoring Based on the Density-Based Support Vector Data Description

Complex industry processes often need multiple operation modes to meet the change of production conditions. In the same mode,there are discrete samples belonging to this mode. Therefore,it is important to consider the samples which are sparse in the mode.To solve this issue,a new approach called density-based support vector data description( DBSVDD) is proposed. In this article,an algorithm using Gaussian mixture model( GMM) with the DBSVDD technique is proposed for process monitoring. The GMM method is used to obtain the center of each mode and determine the number of the modes. Considering the complexity of the data distribution and discrete samples in monitoring process,the DBSVDD is utilized for process monitoring. Finally,the validity and effectiveness of the DBSVDD method are illustrated through the Tennessee Eastman( TE) process.

Animal Classification System Based on Image Processing &Support Vector Machine

This project is mainly focused to develop system for animal researchers & wild life photographers to overcome so many challenges in their day life today. When they engage in such situation, they need to be patiently waiting for long hours, maybe several days in whatever location and under severe weather conditions until capturing what they are interested in. Also there is a big demand for rare wild life photo graphs. The proposed method makes the task automatically use microcontroller controlled camera, image processing and machine learning techniques. First with the aid of microcontroller and four passive IR sensors system will automatically detect the presence of animal and rotate the camera toward that direction. Then the motion detection algorithm will get the animal into middle of the frame and capture by high end auto focus web cam. Then the captured images send to the PC and are compared with photograph database to check whether the animal is exactly the same as the photographer choice. If that captured animal is the exactly one who need to capture then it will automatically capture more. Though there are several technologies available none of these are capable of recognizing what it captures. There is no detection of animal presence in different angles. Most of available equipment uses a set of PIR sensors and whatever it disturbs the IR field will automatically be captured and stored. Night time images are black and white and have less details and clarity due to infrared flash quality. If the infrared flash is designed for best image quality, range will be sacrificed. The photographer might be interested in a specific animal but there is no facility to recognize automatically whether captured animal is the photographer’s choice or not.

Some Group Runs Based Multivariate Control Charts for Monitoring the Process Mean Vector

In this article, we propose two control charts namely, the “Multivariate Group Runs’ (MV-GR-M)” and the “Multivariate Modified Group Runs’ (MV-MGR-M)” control charts, based on the multivariate normal processes, for monitoring the process mean vector. Methods to obtain the design parameters and operations of these control charts are discussed. Performances of the proposed charts are compared with some existing control charts. It is verified that, the proposed charts give a significant reduction in the out-of-control “Average Time to Signal” (ATS) in the zero state, as well in the steady state compared to the Hotelling’s T2 and the synthetic T2 control charts.

Vector FIGARCH process, its persistence and co-persistence in variance

In this paper, the definition of the vector FIGARCH process is established, and the stationarity and some properties of the process are discussed. According to the stationarity and the results of Du and Zhang [1], we verify the persistence in variance of the vector FIGARCH process, and finally establish the sufficient and necessary condition for the co-persistence in the variance of the process and also discuss the constant related vector FIGARCH ( p , d , q ) process as a special case.

Word Embeddings and Semantic Spaces in Natural Language Processing

One of the critical hurdles, and breakthroughs, in the field of Natural Language Processing (NLP) in the last two decades has been the development of techniques for text representation that solves the so-called curse of dimensionality, a problem which plagues NLP in general given that the feature set for learning starts as a function of the size of the language in question, upwards of hundreds of thousands of terms typically. As such, much of the research and development in NLP in the last two decades has been in finding and optimizing solutions to this problem, to feature selection in NLP effectively. This paper looks at the development of these various techniques, leveraging a variety of statistical methods which rest on linguistic theories that were advanced in the middle of the last century, namely the distributional hypothesis which suggests that words that are found in similar contexts generally have similar meanings. In this survey paper we look at the development of some of the most popular of these techniques from a mathematical as well as data structure perspective, from Latent Semantic Analysis to Vector Space Models to their more modern variants which are typically referred to as word embeddings. In this review of algoriths such as Word2Vec, GloVe, ELMo and BERT, we explore the idea of semantic spaces more generally beyond applicability to NLP.

Image Processing on Geological Data in Vector Format and Multi-Source Spatial Data Fusion

The geological data are constructed in vector format in geographical information system (GIS) while other data such as remote sensing images, geographical data and geochemical data are saved in raster ones. This paper converts the vector data into 8 bit images according to their importance to mineralization each by programming. We can communicate the geological meaning with the raster images by this method. The paper also fuses geographical data and geochemical data with the programmed strata data. The result shows that image fusion can express different intensities effectively and visualize the structure characters in 2 dimensions. Furthermore, it also can produce optimized information from multi-source data and express them more directly.

A New Vector Markov Process for M/G/1 Queue

In this paper, by considering the stochastic proces s of the busy period and the idle period, and introducing the unfinished work as a supplementary variable, a new vector Markov process was presented to study th e M/G/1 queue again. Through establishing and solving the density evolution equa tions, the busy-period distribution, and the stationary distributions of waitin g time and queue length were obtained. In addition, the stability condition of th is queue system was given by means of an imbedded renewal process.

自然语言处理领域中的词嵌入方法综述

词嵌入作为自然语言处理任务的第一步,其目的是将输入的自然语言文本转换为模型可以处理的数值向量,即词向量,也称词的分布式表示。词向量作为自然语言处理任务的根基,是完成一切自然语言处理任务的前提。然而,国内外针对词嵌入方法的综述文献大多只关注于不同词嵌入方法本身的技术路线,而未能将词嵌入的前置分词方法以及词嵌入方法完整的演变趋势进行分析与概述。以word2vec模型和Transformer模型作为划分点,从生成的词向量是否能够动态地改变其内隐的语义信息来适配输入句子的整体语义这一角度,将词嵌入方法划分为静态词嵌入方法和动态词嵌入方法,并对此展开讨论。同时,针对词嵌入中的分词方法,包括整词切分和子词切分,进行了对比和分析;针对训练词向量所使用的语言模型,从概率语言模型到神经概率语言模型再到如今的深度上下文语言模型的演化,进行了详细列举和阐述;针对预训练语言模型时使用的训练策略进行了总结和探讨。最后,总结词向量质量的评估方法,分析词嵌入方法的当前现状并对其未来发展方向进行展望。

基于图像处理的水培生菜冠层图像叶面积估测研究

为实现精准、高效、无损地获取植物工厂环境下水培生菜相关长势参数叶面积(Leaf area,LA),基于数字图像处理和机器学习回归方法建立单株水培生菜冠层图像LA估测模型。首先,通过智能手机获取2个生菜品种不同生长期的冠层可见光图像,利用Photoshop图像处理软件将原始图像统一剪裁为900像素×900像素大小,采用中值滤波(MedianBlur)法对剪裁后的图像进行去噪运算,将RGB图像转化为HSV颜色空间,再采用mask掩膜法分割彩色图像;然后,利用图像法获取单株生菜LA实测值,构建以LA实测值为因变量,以生菜冠层投影面积(Projected leaf area,PLA)为自变量的线性回归(Linear regression,LR)模型和以全局图像特征(颜色、形状、纹理等)为自变量的支持向量回归(Support vector regression,SVR)、多元线性回归(Multiple linear regression,MLR)和随机森林(Random forest,RF)等LA估测模型进行对比分析;最后,采用决定系数(Coefficient of determination,R^(2))和均方根误差(Root mean square error,RMSE)评估模型的准确性。结果表明:RF模型估测效果最好,对于生菜品种‘绿萝’单株LA估测结果的R^(2)为0.9714、RMSE为8.89 cm2,对于品种‘碧霄’估测结果的R^(2)为0.9201、RMSE为23.34 cm2。本研究验证了RF回归模型能够较准确地估测生菜单株叶面积,可为植物工厂水培生菜LA无损估测提供新的解决方案和研究基础。

TEB:GPU上矩阵分解重构的高效SpMV存储格式

稀疏矩阵向量乘法(SpMV)是科学与工程领域中一个至关重要的计算过程,CSR(compressed sparse row)格式是最常用的稀疏矩阵存储格式之一,在图形处理器(GPU)平台上实现并行SpMV的过程中,其只存储稀疏矩阵的非零元,避免零元素填充所带来的计算冗余,节约存储空间,但存在着负载不均衡的问题,浪费了计算资源。针对上述问题,对近年来效果良好的存储格式进行了研究,提出了一种逐行分解重组存储格式——TEB(threshold-exchangeorder block)格式。该格式采用启发式阈值选择算法确定合适分割阈值,并结合基于重排序的行归并算法,对稀疏矩阵进行重构分解,使得块与块之间非零元个数尽可能得相近,其次结合CUDA(computer unified device architecture)线程技术,提出了基于TEB存储格式的子块间并行SpMV算法,能够合理分配计算资源,解决负载不均衡问题,从而提高SpMV并行计算效率。为了验证TEB存储格式的有效性,在NVIDIA Tesla V100平台上进行实验,结果表明TEB相较于PBC(partition-block-CSR)、AMF-CSR(adaptive multi-row folding of CSR)、CSR-Scalar(compressed sparse row-scalar)和CSR5(compressed sparse row 5)存储格式,在SpMV的时间性能方面平均可提升3.23、5.83、2.33和2.21倍;在浮点计算性能方面,平均可提高3.36、5.95、2.29和2.13倍。

基于NEON的VSIPL加速技术研究

针对航空及通信领域嵌入式信息处理软件的可移植性和实时性需求,提出了ARM平台下基于NEON的矢量信号图像处理函数库(VSIPL)中间件算法加速优化的方法。VSIPL中间件能够解决信号处理软件在不同平台的复用性问题,通过对VSIPL的数据特性进行分析,然后将NEON技术应用于VSIPL加速设计中,实现数据的并行处理以提高运算速率。最后,对VSIPL中的典型向量算法优化前后进行性能对比测试,并分析了不同因素对加速效果的影响,测试结果验证了加速方法的可行性。提出的基于NEON的VSIPL加速设计方法能有效提高信号处理软件的性能,具有一定的指导意义和工程应用价值。

基于i-vector局部加权线性判别分析的说话人识别

基于i-vector的说话人识别系统通常采用LDA来消除训练和测试语音之间信道失配,不能保证样本在待识别语音近邻区域内具有最佳的分离度,这就使得目标说话人和其近邻间的得分差异较小,进而导致识别准确性下降。针对该问题,提出基于i-vector局部加权线性判别分析的说话人识别方法(LWLDA)。在计算类内和类间散度时,增加待识别语音近邻样本权重。在此基础上,通过提高待识别语音近邻域局部类间的分辨能力,尽可能减少因信道差异而产生的识别错误。在不同语音库上的实验结果表明:LWLDA在复杂信道环境下能够保持良好的鲁棒性;在交叉信道条件下的识别准确率比LDA平均提高3.6%。