Vertex centrality of complex networks based on joint nonnegative matrix factorization and graph embedding

Finding crucial vertices is a key problem for improving the reliability and ensuring the effective operation of networks,solved by approaches based on multiple attribute decision that suffer from ignoring the correlation among each attribute or the heterogeneity between attribute and structure. To overcome these problems, a novel vertex centrality approach, called VCJG, is proposed based on joint nonnegative matrix factorization and graph embedding. The potential attributes with linearly independent and the structure information are captured automatically in light of nonnegative matrix factorization for factorizing the weighted adjacent matrix and the structure matrix, which is generated by graph embedding. And the smoothness strategy is applied to eliminate the heterogeneity between attributes and structure by joint nonnegative matrix factorization. Then VCJG integrates the above steps to formulate an overall objective function, and obtain the ultimately potential attributes fused the structure information of network through optimizing the objective function. Finally, the attributes are combined with neighborhood rules to evaluate vertex's importance. Through comparative analyses with experiments on nine real-world networks, we demonstrate that the proposed approach outperforms nine state-of-the-art algorithms for identification of vital vertices with respect to correlation, monotonicity and accuracy of top-10 vertices ranking.

Extracting Sub-Networks from Brain Functional Network Using Graph Regularized Nonnegative Matrix Factorization

Currently,functional connectomes constructed from neuroimaging data have emerged as a powerful tool in identifying brain disorders.If one brain disease just manifests as some cognitive dysfunction,it means that the disease may affect some local connectivity in the brain functional network.That is,there are functional abnormalities in the sub-network.Therefore,it is crucial to accurately identify them in pathological diagnosis.To solve these problems,we proposed a sub-network extraction method based on graph regularization nonnegative matrix factorization(GNMF).The dynamic functional networks of normal subjects and early mild cognitive impairment(eMCI)subjects were vectorized and the functional connection vectors(FCV)were assembled to aggregation matrices.Then GNMF was applied to factorize the aggregation matrix to get the base matrix,in which the column vectors were restored to a common sub-network and a distinctive sub-network,and visualization and statistical analysis were conducted on the two sub-networks,respectively.Experimental results demonstrated that,compared with other matrix factorization methods,the proposed method can more obviously reflect the similarity between the common subnetwork of eMCI subjects and normal subjects,as well as the difference between the distinctive sub-network of eMCI subjects and normal subjects,Therefore,the high-dimensional features in brain functional networks can be best represented locally in the lowdimensional space,which provides a new idea for studying brain functional connectomes.

Cold-Start Link Prediction via Weighted Symmetric Nonnegative Matrix Factorization with Graph Regularization

Link prediction has attracted wide attention among interdisciplinaryresearchers as an important issue in complex network. It aims to predict the missing links in current networks and new links that will appear in future networks.Despite the presence of missing links in the target network of link prediction studies, the network it processes remains macroscopically as a large connectedgraph. However, the complexity of the real world makes the complex networksabstracted from real systems often contain many isolated nodes. This phenomenon leads to existing link prediction methods not to efficiently implement the prediction of missing edges on isolated nodes. Therefore, the cold-start linkprediction is favored as one of the most valuable subproblems of traditional linkprediction. However, due to the loss of many links in the observation network, thetopological information available for completing the link prediction task is extremely scarce. This presents a severe challenge for the study of cold-start link prediction. Therefore, how to mine and fuse more available non-topologicalinformation from observed network becomes the key point to solve the problemof cold-start link prediction. In this paper, we propose a framework for solving thecold-start link prediction problem, a joint-weighted symmetric nonnegative matrixfactorization model fusing graph regularization information, based on low-rankapproximation algorithms in the field of machine learning. First, the nonlinear features in high-dimensional space of node attributes are captured by the designedgraph regularization term. Second, using a weighted matrix, we associate the attribute similarity and first order structure information of nodes and constrain eachother. Finally, a unified framework for implementing cold-start link prediction isconstructed by using a symmetric nonnegative matrix factorization model to integrate the multiple information extracted together. Extensive experimental validationon five real networks with attributes shows that the proposed model has very goodpredictive performance when predicting missing edges of isolated nodes.

Randomized Algorithms for Orthogonal Nonnegative Matrix Factorization

Orthogonal nonnegative matrix factorization(ONMF)is widely used in blind image separation problem,document classification,and human face recognition.The model of ONMF can be efficiently solved by the alternating direction method of multipliers and hierarchical alternating least squares method.When the given matrix is huge,the cost of computation and communication is too high.Therefore,ONMF becomes challenging in the large-scale setting.The random projection is an efficient method of dimensionality reduction.In this paper,we apply the random projection to ONMF and propose two randomized algorithms.Numerical experiments show that our proposed algorithms perform well on both simulated and real data.

Clustering-based hyperspectral band selection using sparse nonnegative matrix factorization

Hyperspectral imagery generally contains a very large amount of data due to hundreds of spectral bands.Band selection is often applied firstly to reduce computational cost and facilitate subsequent tasks such as land-cover classification and higher level image analysis.In this paper,we propose a new band selection algorithm using sparse nonnegative matrix factorization (sparse NMF).Though acting as a clustering method for band selection,sparse NMF need not consider the distance metric between different spectral bands,which is often the key step for most common clustering-based band selection methods.By imposing sparsity on the coefficient matrix,the bands' clustering assignments can be easily indicated through the largest entry in each column of the matrix.Experimental results showed that sparse NMF provides considerable insight into the clustering-based band selection problem and the selected bands are good for land-cover classification.

Identifying spatiotemporal traffic patterns in large-scale urban road networks using a modified nonnegative matrix factorization algorithm

The identification and analysis of spatiotemporal traffic patterns in road networks constitute a crucial process for sophisticated traffic management and control.Traditional methods based on mathematical equations and statistical models can hardly be applicable to large-scale urban road networks,where traffic states exhibit high degrees of dynamics and complexity.Recently,advances in data collection and processing have provided new opportunities to effectively understand spatiotemporal traffic patterns in large-scale road networks using data-driven methods.However,limited efforts have been exerted to explore the essential structure of the networks when conducting a spatiotemporal analysis of traffic characteristics.To this end,this study proposes a modified nonnegative matrix factorization algorithm that processes high-dimensional traffic data and provides an improved representation of the global traffic state.After matrix factorization,cluster analysis is conducted based on the obtained low-dimensional representative matrices,which contain different traffic patterns and serve as the basis for exploring the temporal dynamics and spatial structure of network congestion.The applicability and effectiveness of the proposed approach are examined in a road network of Beijing,China.Results show that the methods exhibit considerable potential for identifying and interpreting the spatiotemporal traffic patterns over the entire network and provide a systematic and efficient approach for analyzing the network-level traffic state.

CUR Based Initialization Strategy for Non-Negative Matrix Factorization in Application to Hyperspectral Unmixing

Hyperspectral unmixing is a powerful tool for the remote sensing image mining. Nonnegative matrix factorization (NMF) has been adopted to deal with this issue, while the precision of unmixing is closely related with the local minimizers of NMF. We present two novel initialization strategies that is based on CUR decomposition, which is physically meaningful. In the experimental test, NMF with the new initialization method is used to unmix the urban scene which was captured by airborne visible/infrared imaging spectrometer (AVIRIS) in 1997, numerical results show that the initialization methods work well.

Semi-supervised multi-view clustering with dual hypergraph regularized partially shared non-negative matrix factorization

Real-world data can often be represented in multiple forms and views,and analyzing data from different perspectives allows for more comprehensive learning of the data,resulting in better data clustering results.Non-negative matrix factorization(NMF)is used to solve the clustering problem to extract uniform discriminative low-dimensional features from multi-view data.Many clustering methods based on graph regularization have been proposed and proven to be effective,but ordinary graphs only consider pairwise relationships between samples.In order to learn the higher-order relationships that exist in the sample manifold and feature manifold of multi-view data,we propose a new semi-supervised multi-view clustering method called dual hypergraph regularized partially shared non-negative matrix factorization(DHPS-NMF).The complex manifold structure of samples and features is learned by constructing samples and feature hypergraphs.To improve the discrimination power of the obtained lowdimensional features,semi-supervised regression terms are incorporated into the model to effectively use the label information when capturing the complex manifold structure of the data.Ultimately,we conduct experiments on six real data sets and the results show that our algorithm achieves encouraging results in comparison with some methods.

Adaptive total variation constraint hypergraph regularized NMF for single-cell RNA-seq data analysis

Background:Single-cell RNA sequencing(scRNA-seq)data provides a whole new view to study disease and cell differentiation development.With the explosive increment of scRNA-seq data,effective models are demanded for mining the intrinsic biological information.Methods:This paper proposes a novel non-negative matrix factorization(NMF)method for clustering and gene coexpression network analysis,termed Adaptive Total Variation Constraint Hypergraph Regularized NMF(ATV-HNMF).ATV-HNMF can adaptively select the different schemes to denoise the cluster or preserve the cluster boundary information between clusters based on the gradient information.Besides,ATV-HNMF incorporates hypergraph regularization,which can consider high-order relationships between cells to reserve the intrinsic structure of the space.Results:Experiments show that the performances on clustering outperform other compared methods,and the network construction results are consistent with previous studies,which illustrate that our model is effective and useful.Conclusion:From the clustering results,we can see that ATV-HNMF outperforms other methods,which can help us to understand the heterogeneity.We can discover many disease-related genes from the constructed network,and some are worthy of further clinical exploration.

Topic features for machine learning-based sentiment analysis in Indonesian tweets

Purpose–The purpose of this paper is to analyze topics as alternative features for sentiment analysis in Indonesian tweets.Design/methodology/approach–Given Indonesian tweets,the processes of sentiment analysis start by extracting features from the tweets.The features are words or topics.The authors use non-negative matrix factorization to extract the topics and apply a support vector machine to classify the tweets into its sentiment class.Findings–The authors analyze the accuracy using the two-class and three-class sentiment analysis data sets.Both data sets are about sentiments of candidates for Indonesian presidential election.The experiments show that the standard word features give better accuracies than the topics features for the two-class sentiment analysis.Moreover,the topic features can slightly improve the accuracy of the standard word features.The topic features can also improve the accuracy of the standard word features for the three-class sentiment analysis.Originality/value–The standard textual data representation for sentiment analysis using machine learning is bag of word and its extensions mainly created by natural language processing.This paper applies topics as novel features for the machine learning-based sentiment analysis in Indonesian tweets.