Fully Distributed Learning for Deep Random Vector Functional-Link Networks

In the contemporary era, the proliferation of information technology has led to an unprecedented surge in data generation, with this data being dispersed across a multitude of mobile devices. Facing these situations and the training of deep learning model that needs great computing power support, the distributed algorithm that can carry out multi-party joint modeling has attracted everyone’s attention. The distributed training mode relieves the huge pressure of centralized model on computer computing power and communication. However, most distributed algorithms currently work in a master-slave mode, often including a central server for coordination, which to some extent will cause communication pressure, data leakage, privacy violations and other issues. To solve these problems, a decentralized fully distributed algorithm based on deep random weight neural network is proposed. The algorithm decomposes the original objective function into several sub-problems under consistency constraints, combines the decentralized average consensus (DAC) and alternating direction method of multipliers (ADMM), and achieves the goal of joint modeling and training through local calculation and communication of each node. Finally, we compare the proposed decentralized algorithm with several centralized deep neural networks with random weights, and experimental results demonstrate the effectiveness of the proposed algorithm.

ADAPTIVE PREDICTIVE CONTROL OF NEAR-SPACE VEHICLE USING FUNCTIONAL LINK NETWORK

A novel nonlinear adaptive control method is presented for a near-space hypersonic vehicle （NHV） in the presence of strong uncertainties and disturbances. The control law consists of the optimal generalized predictive controller （OGPC） and the functional link network （FLN） direct adaptive law. OGPC is a continuous-time nonlinear predictive control law. The FLN adaptive law is used to offset the unknown uncertainties and disturbances in a flight through the online learning. The learning process does not need any offline training phase. The stability analyses of the NHV close-loop system are provided and it is proved that the system error and the weight learning error are uniformly ultimately hounded. Simulation results show the satisfactory performance of the con- troller for the attitude tracking.

Biodiversity metrics on ecological networks: Demonstrated with animal gastrointestinal microbiomes

Biodiversity has become a terminology familiar to virtually every citizen in modern societies.It is said that ecology studies the economy of nature,and economy studies the ecology of humans;then measuring biodiversity should be similar with measuring national wealth.Indeed,there have been many parallels between ecology and economics,actually beyond analogies.For example,arguably the second most widely used biodiversity metric,Simpson(1949)’s diversity index,is a function of familiar Gini-index in economics.One of the biggest challenges has been the high“diversity”of diversity indexes due to their excessive“speciation”-there are so many indexes,similar to each country’s sovereign currency-leaving confused diversity practitioners in dilemma.In 1973,Hill introduced the concept of“numbers equivalent”,which is based on Renyi entropy and originated in economics,but possibly due to his abstruse interpretation of the concept,his message was not widely received by ecologists until nearly four decades later.What Hill suggested was similar to link the US dollar to gold at the rate of$35 per ounce under the Bretton Woods system.The Hill numbers now are considered most appropriate biodiversity metrics system,unifying Shannon,Simpson and other diversity indexes.Here,we approach to another paradigmatic shift-measuring biodiversity on ecological networks-demonstrated with animal gastrointestinal microbiomes representing four major invertebrate classes and all six vertebrate classes.The network diversity can reveal the diversity of species interactions,which is a necessary step for understanding the spatial and temporal structures and dynamics of biodiversity across environmental gradients.

Adaptive functional link network control of near-space vehicles with dynamical uncertainties

The control law design for a near-space hypersonic vehicle（NHV） is highly challenging due to its inherent nonlinearity,plant uncertainties and sensitivity to disturbances.This paper presents a novel functional link network（FLN） control method for an NHV with dynamical thrust and parameter uncertainties.The approach devises a new partially-feedback-functional-link-network（PFFLN） adaptive law and combines it with the nonlinear generalized predictive control（NGPC） algorithm.The PFFLN is employed for approximating uncertainties in flight.Its weights are online tuned based on Lyapunov stability theorem for the first time.The learning process does not need any offline training phase.Additionally,a robust controller with an adaptive gain is designed to offset the approximation error.Finally,simulation results show a satisfactory performance for the NHV attitude tracking,and also illustrate the controller＇s robustness.

Percolation on networks with dependence links

As a classical model of statistical physics, the percolation theory provides a powerful approach to analyze the network structure and dynamics. Recently, to model the relations among interacting agents beyond the connection of the networked system, the concept of dependence link is proposed to represent the dependence relationship of agents. These studies suggest that the percolation properties of these networks differ greatly from those of the ordinary networks. In particular, unlike the well known continuous transition on the ordinary networks, the percolation transitions on these networks are discontinuous. Moreover, these networks are more fragile for a broader degree distribution, which is opposite to the famous results for the ordinary networks. In this article, we give a summary of the theoretical approaches to study the percolation process on networks with inter- and inner-dependence links, and review the recent advances in this field, focusing on the topology and robustness of such networks.

Optimized functional linked neural network for predicting diaphragm wall deflection induced by braced excavations in clays

Deep excavation during the construction of underground systems can cause movement on the ground,especially in soft clay layers.At high levels,excessive ground movements can lead to severe damage to adjacent structures.In this study,finite element analyses(FEM)and the hardening small strain(HSS)model were performed to investigate the deflection of the diaphragm wall in the soft clay layer induced by braced excavations.Different geometric and mechanical properties of the wall were investigated to study the deflection behavior of the wall in soft clays.Accordingly,1090 hypothetical cases were surveyed and simulated based on the HSS model and FEM to evaluate the wall deflection behavior.The results were then used to develop an intelligent model for predicting wall deflection using the functional linked neural network(FLNN)with different functional expansions and activation functions.Although the FLNN is a novel approach to predict wall deflection;however,in order to improve the accuracy of the FLNN model in predicting wall deflection,three swarm-based optimization algorithms,such as artificial bee colony(ABC),Harris’s hawk’s optimization(HHO),and hunger games search(HGS),were hybridized to the FLNN model to generate three novel intelligent models,namely ABC-FLNN,HHO-FLNN,HGS-FLNN.The results of the hybrid models were then compared with the basic FLNN and MLP models.They revealed that FLNN is a good solution for predicting wall deflection,and the application of different functional expansions and activation functions has a significant effect on the outcome predictions of the wall deflection.It is remarkably interesting that the performance of the FLNN model was better than the MLP model with a mean absolute error(MAE)of 19.971,root-mean-squared error(RMSE)of 24.574,and determination coefficient(R^(2))of 0.878.Meanwhile,the performance of the MLP model only obtained an MAE of 20.321,RMSE of 27.091,and R^(2)of 0.851.Furthermore,the results also indicated that the proposed hybrid models,i.e.,ABC-FLNN,HHO-FLNN,HGS-FLNN,yielded more superior performances than those of the FLNN and MLP models in terms of the prediction of deflection behavior of diaphragm walls with an MAE in the range of 11.877 to 12.239,RMSE in the range of 15.821 to 16.045,and R^(2)in the range of 0.949 to 0.951.They can be used as an alternative tool to simulate diaphragm wall deflections under different conditions with a high degree of accuracy.

Modeling online social networks based on preferential linking

We study the phenomena of preferential linking in a large-scale evolving online social network and find that the linear preference holds for preferential creation, preferential acceptance, and preferential attachment. Based on the linear preference, we propose an analyzable model, which illustrates the mechanism of network growth and reproduces the process of network evolution. Our simulations demonstrate that the degree distribution of the network produced by the model is in good agreement with that of the real network. This work provides a possible bridge between the micro=mechanisms of network growth and the macrostructures of online social networks.

Functional Link Neural Network for Predicting Crystallization Temperature of Ammonium Chloride in Air Cooler System

The air cooler is an important equipment in the petroleum refining industry.Ammonium chloride(NH4 Cl)deposition-induced corrosion is one of its main failure forms.In this study,the ammonium salt crystallization temperature is chosen as the key decision variable of NH4 Cl deposition-induced corrosion through in-depth mechanism research and experimental analysis.The functional link neural network(FLNN)is adopted as the basic algorithm for modeling because of its advantages in dealing with non-linear problems and its fast-computational ability.A hybrid FLNN attached to a small norm is built to improve the generalization performance of the model.Then,the trained model is used to predict the NH4 Cl salt crystallization temperature in the air cooler of a sour water stripper plant.Experimental results show the proposed improved FLNN algorithm can achieve better generalization performance than the PLS,the back propagation neural network,and the conventional FLNN models.

Defending Against Link Failure in Virtual Network Embedding Using a Hybrid Scheme

Nowadays network virtualization is utterly popular.As a result,how to protect the virtual networks from attacking on the link is increasingly important.Existing schemes are mainly backup-based,which suffer from data loss and are helpless to such attacks like data tampering.To offer high security level,in this paper,we first propose a multipath and decision-making(MD) scheme which applies multipath simultaneously delivery and decision-making for protecting the virtual network.Considering different security requirement for virtual link,we devise a hybrid scheme to protect the virtual links.For the critical links,MD scheme is adopted.For the other links,we adopt the Shared Backup Scheme.Our simulation results indicate the proposed scheme can significantly increase the security level of the critical link high in the loss of less acceptance ratio.

A dynamic logistic regression for network link prediction

In social network analysis, link prediction is a problem of fundamental importance. How to conduct a comprehensive and principled link prediction, by taking various network structure information into consideration,is of great interest. To this end, we propose here a dynamic logistic regression method. Specifically, we assume that one has observed a time series of network structure. Then the proposed model dynamically predicts future links by studying the network structure in the past. To estimate the model, we find that the standard maximum likelihood estimation(MLE) is computationally forbidden. To solve the problem, we introduce a novel conditional maximum likelihood estimation(CMLE) method, which is computationally feasible for large-scale networks. We demonstrate the performance of the proposed method by extensive numerical studies.

A Routing Strategy with Link Disruption Tolerance for Multilayered Satellite Networks

Link disruption has a considerable impact on routing in multilayered satellite networks, which includes predictable disruption from the periodic satellite motion and unpredictable disruption from communication faults. Based on the analysis on the predictability of satellite links, a link disruption routing strategy is proposed for multilayered satellite networks, where, a topology period is divided into non-uniform slots, and a routing table in each slot is calculated by the topology predictability of satellite networks, and a congestion control mechanism is proposed to ensure the reliable transmission of packets, and a flooding mechanism is given to deal with the routes selection in the case of unpredictable link disruption. This routing strategy is implemented on the satellite network simulation platform, the simulation results show that the strategy has less delay and higher link utilization, and can meet the routing requirements of multilayered satellite networks.

Mathematical Model and Algorithm for Link Community Detection in Bipartite Networks

In the past ten years, community detection in complex networks has attracted more and more attention of researchers. Communities often correspond to functional subunits in the complex systems. In complex network, a node community can be defined as a subgraph induced by a set of nodes, while a link community is a subgraph induced by a set of links. Although most researches pay more attention to identifying node communities in both unipartite and bipartite networks, some researchers have investigated the link community detection problem in unipartite networks. But current research pays little attention to the link community detection problem in bipartite networks. In this paper, we investigate the link community detection problem in bipartite networks, and formulate it into an integer programming model. We proposed a genetic algorithm for partition the bipartite network into overlapping link communities. Simulations are done on both artificial networks and real-world networks. The results show that the bipartite network can be efficiently partitioned into overlapping link communities by the genetic algorithm.

The determination of the link with the smallest end-to-end network latency in ethernet architecture

Ethernet fundamental and its data transmission model are introduced in brief and end-to-end network latency was analyzed in this paper. On the premise of not considering transmission quality and transmission cost, latency was the function of the rest of network resource parameter (NRP). The relation between the number of nodes and that of end-to-end links was presented. In ethernet architecture, the algorithm to determine the link with the smallest latency is a polynomial issue when the number of network nodes is limited, so it can be solved by way of polynomial equations. Latency measuring is the key issue to determine the link with the smallest network latency. 3-node brigade (regiment) level network centric warfare (NCW) demonstration platform was studied and the latency between the detectors and weapon control stations was taken as an example. The algorithm of end-to-end network latency and link information in NCW was presented. The algorithm program based on Server/Client architecture was developed. The data transmission optimal link is one whose end-to-end latency is the smallest. This paper solves the key issue to determine the link whose end-to-end latency is the smallest in ethernet architecture. The study can be widely applied to determine the optimal link which is in the complex network environment of multiple service provision points.

Link reliability based hybrid routing for tactical mobile ad hoc network

Tactical mobile ad hoc network （MANET） is a collection of mobile nodes forming a temporary network, without the aid of pre-established network infrastructure. The routing protocol has a crucial impact on the network performance in battlefields. Link reliability based hybrid routing （LRHR） is proposed, which is a novel hybrid routing protocol, for tactical MANET. Contrary to the traditional single path routing strategy, multiple paths are established between a pair of source-destination nodes. In the hybrid routing strategy, the rate of topological change provides a natural mechanism for switching dynamically between table-driven and on-demand routing. The simulation results indicate that the performances of the protocol in packet delivery ratio, routing overhead, and average end-to-end delay are better than the conventional routing protocol.

Entropy-based link prediction in weighted networks

Information entropy has been proved to be an effective tool to quantify the structural importance of complex networks.In a previous work [Xu et al. Physica A, 456 294（2016）], we measure the contribution of a path in link prediction with information entropy. In this paper, we further quantify the contribution of a path with both path entropy and path weight,and propose a weighted prediction index based on the contributions of paths, namely weighted path entropy（WPE）, to improve the prediction accuracy in weighted networks. Empirical experiments on six weighted real-world networks show that WPE achieves higher prediction accuracy than three other typical weighted indices.

Link prediction in complex networks via modularity-based belief propagation

Link prediction aims at detecting missing, spurious or evolving links in a network, based on the topological information and/or nodes＇ attributes of the network. Under the assumption that the likelihood of the existence of a link between two nodes can be captured by nodes＇ similarity, several methods have been proposed to compute similarity directly or indirectly, with information on node degree. However, correctly predicting links is also crucial in revealing the link formation mechanisms and thus in providing more accurate modeling for networks. We here propose a novel method to predict links by incorporating stochastic-block-model link generating mechanisms with node degree. The proposed method first recov- ers the underlying block structure of a network by modularity-based belief propagation, and based on the recovered block structural information it models the link likelihood between two nodes to match the degree sequence of the network. Experiments on a set of real-world networks and synthetic networks generated by stochastic block model show that our proposed method is effective in detecting missing, spurious or evolving links of networks that can be well modeled by a stochastic block model. This approach efficiently complements the toolbox for complex network analysis, offering a novel tool to model links in stochastic block model networks that are fundamental in the modeling of real world complex networks.

Analysis on Connectivity of Inter-Orbit-Links in a MEO/LEO Double-Layer Satellite Network

As an important scheme of future global mobile satellite communication systems to provide multimedia service, a Double-Layer Satellite Network （DLSN） with MEO satellites and LEO satellites is proposed. The Inter-Orbit-Links （IOLs） between layers is an essential factor, which affects the performances of the DLSN systems. Considering certain constellation parameters, the geometric characteristics of IOLs are described and the connectivity of MEO satellites and LEO satellites in the DLSN is analyzed. By computer simulation, the results show that IOLs should be selectively established according to certain parameters rather than the simple in-sight principle.

Research on Link Duration for Mobile Multihop Communication Networks

Mobile multihop communication network is an important branch of modern mobile communication system, and is an important technical support for ubiquitous communication. The random movement of the nodes makes the networking be more flexible, but the frequently changing topology will decrease the link duration between nodes significantly, which will increase the packets loss probability and affect the network communication performance. Aiming at the problem of declining link duration caused by nomadic characteristics in mobile multihop communication network, four link duration models for possible moving states are established based on different features in real networking process in this paper, which will provide reliable criterion for the optimal routing selection. Model analysis and simulation results show that the reliable route established by the proposed model will effectively extend the link duration, and can enhance the global stability of the mobile multihop information transmission, so as to provide new option to transmission reliability improvement for the mobile communication network.

Percolation transitions in edge-coupled interdependent networks with directed dependency links

We propose a model of edge-coupled interdependent networks with directed dependency links(EINDDLs)and develop the theoretical analysis framework of this model based on the self-consistent probabilities method.The phase transition behaviors and parameter thresholds of this model under random attacks are analyzed theoretically on both random regular(RR)networks and Erd¨os-Renyi(ER)networks,and computer simulations are performed to verify the results.In this EINDDL model,a fractionβof connectivity links within network B depends on network A and a fraction(1-β)of connectivity links within network A depends on network B.It is found that randomly removing a fraction(1-p)of connectivity links in network A at the initial state,network A exhibits different types of phase transitions(first order,second order and hybrid).Network B is rarely affected by cascading failure whenβis small,and network B will gradually converge from the first-order to the second-order phase transition asβincreases.We present the critical values ofβfor the phase change process of networks A and B,and give the critical values of p andβfor network B at the critical point of collapse.Furthermore,a cascading prevention strategy is proposed.The findings are of great significance for understanding the robustness of EINDDLs.

Semantic Link Network Based Knowledge Graph Representation and Construction

A knowledge graph consists of a set of interconnected typed entities and their attributes,which shows a better performance to organize,manage and understand knowledge.However,because knowledge graphs contain a lot of knowledge triples,it is difficult to directly display to researchers.Semantic Link Network is an attempt,and it can deal with the construction,representation and reasoning of semantics naturally.Based on the Semantic Link Network,this paper explores the representation and construction of knowledge graph,and develops an academic knowledge graph prototype system to realize the representation,construction and visualization of knowledge graph.