Multivariate Time Series Anomaly Detection Based on Spatial-Temporal Network and Transformer in Industrial Internet of Things

In the Industrial Internet of Things(IIoT),sensors generate time series data to reflect the working state.When the systems are attacked,timely identification of outliers in time series is critical to ensure security.Although many anomaly detection methods have been proposed,the temporal correlation of the time series over the same sensor and the state(spatial)correlation between different sensors are rarely considered simultaneously in these methods.Owing to the superior capability of Transformer in learning time series features.This paper proposes a time series anomaly detection method based on a spatial-temporal network and an improved Transformer.Additionally,the methods based on graph neural networks typically include a graph structure learning module and an anomaly detection module,which are interdependent.However,in the initial phase of training,since neither of the modules has reached an optimal state,their performance may influence each other.This scenario makes the end-to-end training approach hard to effectively direct the learning trajectory of each module.This interdependence between the modules,coupled with the initial instability,may cause the model to find it hard to find the optimal solution during the training process,resulting in unsatisfactory results.We introduce an adaptive graph structure learning method to obtain the optimal model parameters and graph structure.Experiments on two publicly available datasets demonstrate that the proposed method attains higher anomaly detection results than other methods.

Comprehensive evaluation and spatial-temporal evolution characteristics of urban resilience in Chengdu-Chongqing Economic Circle

To clarify the connotations and extensions of urban resilience,this study focuses on the Chengdu-Chongqing Economic Circle with 16 cities as research subjects.A comprehensive evaluation index system was constructed to measure the resilience of each city from 2003 to 2020.The spatial-temporal evolution characteristics were analyzed using Kernel density estimation,standard deviation ellipse,and spatial Markov chain analysis,and the spatial Tobit model was introduced to discover the influencing factors.The results indicate the following:①Urban resilience in the Chengdu-Chongqing Economic Circle displays an upward trend,with the center of gravity moving to the southwest,and the polarization phenomenon intensifying.②The urban resilience level in a region has certain spatial and geographical dependence,while the probability of urban resilience transfer differs in adjacent cities with different resilience levels.③Urban centrality,economic scale,openness level,and financial development promote urban resilience,whereas government scale significantly inhibits it.Finally,this paper proposes countermeasures and suggestions to improve the urban resilience of the Chengdu-Chongqing Economic Circle.

AFSTGCN:Prediction for multivariate time series using an adaptive fused spatial-temporal graph convolutional network

The prediction for Multivariate Time Series(MTS)explores the interrelationships among variables at historical moments,extracts their relevant characteristics,and is widely used in finance,weather,complex industries and other fields.Furthermore,it is important to construct a digital twin system.However,existing methods do not take full advantage of the potential properties of variables,which results in poor predicted accuracy.In this paper,we propose the Adaptive Fused Spatial-Temporal Graph Convolutional Network(AFSTGCN).First,to address the problem of the unknown spatial-temporal structure,we construct the Adaptive Fused Spatial-Temporal Graph(AFSTG)layer.Specifically,we fuse the spatial-temporal graph based on the interrelationship of spatial graphs.Simultaneously,we construct the adaptive adjacency matrix of the spatial-temporal graph using node embedding methods.Subsequently,to overcome the insufficient extraction of disordered correlation features,we construct the Adaptive Fused Spatial-Temporal Graph Convolutional(AFSTGC)module.The module forces the reordering of disordered temporal,spatial and spatial-temporal dependencies into rule-like data.AFSTGCN dynamically and synchronously acquires potential temporal,spatial and spatial-temporal correlations,thereby fully extracting rich hierarchical feature information to enhance the predicted accuracy.Experiments on different types of MTS datasets demonstrate that the model achieves state-of-the-art single-step and multi-step performance compared with eight other deep learning models.

Spatial-temporal distribution and geochemistry of highly evolved Mesozoic granites in Great Xing’an Range,NE China:Discriminant criteria and geological significance

Highly evolved granite is an important sign of the mature continent crust and closely associated with deposits of rare metals.In this work,the authors undertake systematically zircon U-Pb ages and whole rock elemental data for highly evolved granitic intrusions from the Great Xing’an Range(GXR),NE China,to elucidate their discriminant criteria,spatial-temporal distribution,differentiation and geodynamic mecha-nism.Geochemical data of these highly evolved granites suggest that high w(SiO_(2))(>70%)and differentiation index(DI>88)could be quantified indicators,while strong Eu depletion,high TE_(1,3),lowΣREE and low Zr/Hf,Nb/Ta,K/Rb could only be qualitative indicators.Zircon U-Pb ages suggest that the highly evolved gran-ites in the GXR were mainly formed in Late Mesozoic,which can be divided into two major stages:Late Ju-rassic-early Early Cretaceous(162-136 Ma,peak at 138 Ma),and late Early Cretaceous(136-106 Ma,peak at 126 Ma).The highly evolved granites are mainly distributed in the central-southern GXR,and display a weakly trend of getting younger from northwest to southeast,meanwhile indicating the metallogenic potential of rare metals within the central GXR.The spatial-temporal distribution,combined with regional geological data,indicates the highly evolved Mesozoic granites in the GXR were emplaced in an extensional environ-ment,of which the Late Jurassic-early Early Cretaceous extension was related to the closure of the Mongol-Okhotsk Ocean and roll-back of the Paleo-Pacific Plate,while the late Early Cretaceous extension was mainly related to the roll-back of the Paleo-Pacific Plate.

Adaptive spatial-temporal graph attention network for traffic speed prediction

Considering the nonlinear structure and spatial-temporal correlation of traffic network,and the influence of potential correlation between nodes of traffic network on the spatial features,this paper proposes a traffic speed prediction model based on the combination of graph attention network with self-adaptive adjacency matrix(SAdpGAT)and bidirectional gated recurrent unit(BiGRU).First-ly,the model introduces graph attention network(GAT)to extract the spatial features of real road network and potential road network respectively in spatial dimension.Secondly,the spatial features are input into BiGRU to extract the time series features.Finally,the prediction results of the real road network and the potential road network are connected to generate the final prediction results of the model.The experimental results show that the prediction accuracy of the proposed model is im-proved obviously on METR-LA and PEMS-BAY datasets,which proves the advantages of the pro-posed spatial-temporal model in traffic speed prediction.

Spatial-temporal Variation Characteristics of Water Quality in the Lower Reaches of the Nenjiang River

As an important river in the western part of Jilin Province,the lower reach of the Nenjiang River is an important wetland water source conservation area in Jilin Province.Within the watershed,it governs the Momoge Wetland,the Xianghai Wetland,and the Danjiang Wetland in Jilin Province.The main problem in the lower reaches of the Nenjiang River is the uneven distribution of water resources in time and space,and the intensification of land salinization.Zhenlai County and Da an City in the Nenjiang River Basin have sufficient surface water resources,with surface water as the drinking water source.Baicheng City and Tongyu County have scarce surface water resources,and both use groundwater as their domestic water source.The main polluted section in the basin is the Xianghai Reservoir,and the annual water quality evaluation is Class V.However,the water quality of the Tao er River,the main stream of the Nenjiang River,is significantly better than that of the Xianghai Reservoir.In order to better study the water environmental pollution situation in the Nenjiang River basin,monitoring data from five sections of non seasonal rivers in the basin from 2012 to 2021 were selected for studying water quality.This in-depth exploration of the water pollution status and river water quality change trends in the Nenjiang River basin is of great significance for future rural development,agricultural pattern transformation,and the promotion of water ecological civilization construction.

Optimal Routing with Spatial-Temporal Dependencies for Traffic Flow Control in Intelligent Transportation Systems

In Intelligent Transportation Systems(ITS),controlling the trafficflow of a region in a city is the major challenge.Particularly,allocation of the traffic-free route to the taxi drivers during peak hours is one of the challenges to control the trafficflow.So,in this paper,the route between the taxi driver and pickup location or hotspot with the spatial-temporal dependencies is optimized.Initially,the hotspots in a region are clustered using the density-based spatial clustering of applications with noise(DBSCAN)algorithm tofind the hot spots at the peak hours in an urban area.Then,the optimal route is allocated to the taxi driver to pick up the customer in the hotspot.Before allocating the optimal route,each route between the taxi driver and the hot spot is mapped to the number of taxi drivers.Among the map function,the optimal map is selected using the rain opti-mization algorithm(ROA).If more than one map function is obtained as the opti-mal solution,the map between the route and the taxi driver who has done the least number of trips in the day is chosen as thefinal solution This optimal route selec-tion leads to control of the trafficflow at peak hours.Evaluation of the approach depicts that the proposed trafficflow control scheme reduces traveling time,wait-ing time,fuel consumption,and emission.

Multi-granularity spatial-temporal access control model for web GIS

The multi-granularity spatial-temporal-related access control（MSTAC） model was proposed to meet the spatial access control requirements for the service-oriented spatial data infrastructure（SDI）. MSTAC extends the attribute constraints of role-based access control（RBAC）, which includes the user＇s location attribute, the role＇s time constraint, the layer vector constraint of a map class, the scale and time constraints of a geographic layer, the topological constraints of geographic features, the semantic attribute expression constraints of geographic features, and the field constraint of feature views. Through this model, authorized users would be limited to access different granularity spatial datasets, such as the map granularity, the graphic layer granularity, the feature object granularity and the feature view granularity. Finally, the MSTAC model is achieved in a web GIS, which shows the positive and negative authorizations to different services in different data granularities and time periods.

Spatial-temporal difference between nitrate in groundwater and nitrogen in soil based on geostatistical analysis

The study of temporal and spatial variations of nitrate in groundwater under different soil nitrogen environments is helpful to the security of groundwater resources in agricultural areas.In this paper,based on 320 groups of soil and groundwater samples collected at the same time,geostatistical analysis and multiple regression analysis were comprehensively used to conduct the evaluation of nitrogen contents in both groundwater and soil.From May to August,as the nitrification of groundwater is dominant,the average concentration of nitrate nitrogen is 34.80 mg/L;The variation of soil ammonia nitrogen and nitrate nitrogen is moderate from May to July,and the variation coefficient decreased sharply and then increased in August.There is a high correlation between the nitrate nitrogen in groundwater and soil in July,and there is a high correlation between the nitrate nitrogen in groundwater and ammonium nitrogen in soil in August and nitrate nitrogen in soil in July.From May to August,the area of low groundwater nitrate nitrogen in 0-5 mg/L and 5-10 mg/L decreased from 10.97%to 0,and the proportion of high-value area(greater than 70 mg/L)increased from 21.19%to 27.29%.Nitrate nitrogen is the main factor affecting the quality of groundwater.The correlation analysis of nitrate nitrogen in groundwater,nitrate nitrogen in soil and ammonium nitrogen shows that they have a certain period of delay.The areas with high concentration of nitrate in groundwater are mainly concentrated in the western part of the study area,which has a high consistency with the high value areas of soil nitrate distribution from July to August,and a high difference with the spatial position of soil ammonia nitrogen distribution in August.

STGSA:A Novel Spatial-Temporal Graph Synchronous Aggregation Model for Traffic Prediction

The success of intelligent transportation systems relies heavily on accurate traffic prediction,in which how to model the underlying spatial-temporal information from traffic data has come under the spotlight.Most existing frameworks typically utilize separate modules for spatial and temporal correlations modeling.However,this stepwise pattern may limit the effectiveness and efficiency in spatial-temporal feature extraction and cause the overlook of important information in some steps.Furthermore,it is lacking sufficient guidance from prior information while modeling based on a given spatial adjacency graph(e.g.,deriving from the geodesic distance or approximate connectivity),and may not reflect the actual interaction between nodes.To overcome those limitations,our paper proposes a spatial-temporal graph synchronous aggregation(STGSA)model to extract the localized and long-term spatial-temporal dependencies simultaneously.Specifically,a tailored graph aggregation method in the vertex domain is designed to extract spatial and temporal features in one graph convolution process.In each STGSA block,we devise a directed temporal correlation graph to represent the localized and long-term dependencies between nodes,and the potential temporal dependence is further fine-tuned by an adaptive weighting operation.Meanwhile,we construct an elaborated spatial adjacency matrix to represent the road sensor graph by considering both physical distance and node similarity in a datadriven manner.Then,inspired by the multi-head attention mechanism which can jointly emphasize information from different r epresentation subspaces,we construct a multi-stream module based on the STGSA blocks to capture global information.It projects the embedding input repeatedly with multiple different channels.Finally,the predicted values are generated by stacking several multi-stream modules.Extensive experiments are constructed on six real-world datasets,and numerical results show that the proposed STGSA model significantly outperforms the benchmarks.

Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, respectively.Then, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation significantly.Finally, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

Dense Spatial-Temporal Graph Convolutional Network Based on Lightweight OpenPose for Detecting Falls

Fall behavior is closely related to high mortality in the elderly,so fall detection becomes an important and urgent research area.However,the existing fall detection methods are difficult to be applied in daily life due to a large amount of calculation and poor detection accuracy.To solve the above problems,this paper proposes a dense spatial-temporal graph convolutional network based on lightweight OpenPose.Lightweight OpenPose uses MobileNet as a feature extraction network,and the prediction layer uses bottleneck-asymmetric structure,thus reducing the amount of the network.The bottleneck-asymmetrical structure compresses the number of input channels of feature maps by 1×1 convolution and replaces the 7×7 convolution structure with the asymmetric structure of 1×7 convolution,7×1 convolution,and 7×7 convolution in parallel.The spatial-temporal graph convolutional network divides the multi-layer convolution into dense blocks,and the convolutional layers in each dense block are connected,thus improving the feature transitivity,enhancing the network’s ability to extract features,thus improving the detection accuracy.Two representative datasets,Multiple Cameras Fall dataset(MCF),and Nanyang Technological University Red Green Blue+Depth Action Recognition dataset(NTU RGB+D),are selected for our experiments,among which NTU RGB+D has two evaluation benchmarks.The results show that the proposed model is superior to the current fall detection models.The accuracy of this network on the MCF dataset is 96.3%,and the accuracies on the two evaluation benchmarks of the NTU RGB+D dataset are 85.6%and 93.5%,respectively.

Vibration Control of A Flexible Marine Riser System Subject to Input Dead Zone and Extraneous Disturbances

An observer-based adaptive backstepping boundary control is proposed for vibration control of flexible offshore riser systems with unknown nonlinear input dead zone and uncertain environmental disturbances.The control algorithm can update the control law online through real-time data to make the controller adapt to the environment and improve the control precision.Specifically,based on the adaptive backstepping framework,virtual control laws and Lyapunov functions are designed for each subsystem.Three direction interference observers are designed to track the timevarying boundary disturbance.On this basis,the inverse of the dead zone and linear state transformation are used to compensate for the original system and eliminate the adverse effects of the dead zone.In addition,the stability of the closed-loop system is proven by Lyapunov stability theory.All the system states are bounded,and the vibration offset of the riser converges to a small area of the initial position.Finally,four examples of flexible marine risers are simulated in MATLAB to verify the effectiveness of the proposed controller.

Spatial-temporal variations and driving factors of soil organic carbon in forest ecosystems of Northeast China

Forest soil carbon is a major carbon pool of terrestrial ecosystems,and accurate estimation of soil organic carbon(SOC)stocks in forest ecosystems is rather challenging.This study compared the prediction performance of three empirical model approaches namely,regression kriging(RK),multiple stepwise regression(MSR),random forest(RF),and boosted regression trees(BRT)to predict SOC stocks in Northeast China for 1990 and 2015.Furthermore,the spatial variation of SOC stocks and the main controlling environmental factors during the past 25 years were identified.A total of 82(in 1990)and 157(in 2015)topsoil(0–20 cm)samples with 12 environmental factors(soil property,climate,topography and biology)were selected for model construction.Randomly selected80%of the soil sample data were used to train the models and the other 20%data for model verification using mean absolute error,root mean square error,coefficient of determination and Lin's consistency correlation coefficient indices.We found BRT model as the best prediction model and it could explain 67%and 60%spatial variation of SOC stocks,in 1990,and 2015,respectively.Predicted maps of all models in both periods showed similar spatial distribution characteristics,with the lower SOC in northeast and higher SOC in southwest.Mean annual temperature and elevation were the key environmental factors influencing the spatial variation of SOC stock in both periods.SOC stocks were mainly stored under Cambosols,Gleyosols and Isohumosols,accounting for 95.6%(1990)and 95.9%(2015).Overall,SOC stocks increased by 471 Tg C during the past 25 years.Our study found that the BRT model employing common environmental factors was the most robust method for forest topsoil SOC stocks inventories.The spatial resolution of BRT model enabled us to pinpoint in which areas of Northeast China that new forest tree planting would be most effective for enhancing forest C stocks.Overall,our approach is likely to be useful in forestry management and ecological restoration at and beyond the regional scale.

Control of highly pathogenic avian influenza through vaccination

The stamping-out strategy has been used to control highly pathogenic avian influenza viruses in many countries,driven by the belief that vaccination would not be successful against such viruses and fears that avian influenza virus in vaccinated birds would evolve more rapidly and pose a greater risk to humans.In this review,we summarize the successes in controlling highly pathogenic avian influenza in China and make suggestions regarding the requirements for vaccine selection and effectiveness.In addition,we present evidence that vaccination of poultry not only eliminates human infection with avian influenza virus,but also significantly reduces and abolishes some harmful characteristics of avian influenza virus.

An Integrated Control Framework for Torque Vectoring and Active Suspension System

Four-wheel independently driven electric vehicles(FWID-EV)endow a flexible and scalable control framework to improve vehicle performance.This paper integrates the torque vectoring and active suspension system(ASS)to enhance the vehicle’s longitudinal and vertical motion control performance.While the nonlinear characteristic of the tire model leads to a relatively heavier computational burden.To facilitate the controller design and ease the load,a half-vehicle dynamics system is built and simplified to the linear-time-varying(LTV)model.Then a model predictive controller is developed by formulating the objective function by comprehensively considering the safety,energy-saving and comfort requirements.The in-wheel motor efficiency and the power loss of tire slip are treated as optimization indices in this work to reduce energy consumption.Finally,the effectiveness of the proposed controller is verified through the rapid-control-prototype(RCP)test.The results demonstrate the enhancement of the energy-saving as well as comfort on the basis of vehicle stability.

Mitochondrial dysfunction and quality control lie at the heart of subarachnoid hemorrhage

The dramatic increase in intracranial pressure after subarachnoid hemorrhage leads to a decrease in cerebral perfusion pressure and a reduction in cerebral blood flow.Mitochondria are directly affected by direct factors such as ischemia,hypoxia,excitotoxicity,and toxicity of free hemoglobin and its degradation products,which trigger mitochondrial dysfunction.Dysfunctional mitochondria release large amounts of reactive oxygen species,inflammatory mediators,and apoptotic proteins that activate apoptotic pathways,further damaging cells.In response to this array of damage,cells have adopted multiple mitochondrial quality control mechanisms through evolution,including mitochondrial protein quality control,mitochondrial dynamics,mitophagy,mitochondrial biogenesis,and intercellular mitochondrial transfer,to maintain mitochondrial homeostasis under pathological conditions.Specific interventions targeting mitochondrial quality control mechanisms have emerged as promising therapeutic strategies for subarachnoid hemorrhage.This review provides an overview of recent research advances in mitochondrial pathophysiological processes after subarachnoid hemorrhage,particularly mitochondrial quality control mechanisms.It also presents potential therapeutic strategies to target mitochondrial quality control in subarachnoid hemorrhage.

A Blockchain-Based Access Control Scheme for Reputation Value Attributes of the Internet of Things

The Internet of Things(IoT)access controlmechanism may encounter security issues such as single point of failure and data tampering.To address these issues,a blockchain-based IoT reputation value attribute access control scheme is proposed.Firstly,writing the reputation value as an attribute into the access control policy,and then deploying the access control policy in the smart contract of the blockchain system can enable the system to provide more fine-grained access control;Secondly,storing a large amount of resources fromthe Internet of Things in Inter Planetary File System(IPFS)to improve system throughput;Finally,map resource access operations to qualification tokens to improve the performance of the access control system.Complete simulation experiments based on the Hyperledger Fabric platform.Fromthe simulation experimental results,it can be seen that the access control system can achieve more fine-grained and dynamic access control while maintaining high throughput and low time delay,providing sufficient reliability and security for access control of IoT devices.

A Review on Vibration Control of Multiple Cylinders Subjected to FlowInduced Vibrations

The fatigue damage caused by flow-induced vibration(FIV)is one of the major concerns for multiple cylindrical structures in many engineering applications.The FIV suppression is of great importance for the security of many cylindrical structures.Many active and passive control methods have been employed for the vibration suppression of an isolated cylinder undergoing vortex-induced vibrations(VIV).The FIV suppression methods are mainly extended to the multiple cylinders from the vibration control of the isolated cylinder.Due to the mutual interference between the multiple cylinders,the FIV mechanism is more complex than the VIV mechanism,which makes a great challenge for the FIV suppression.Some efforts have been devoted to vibration suppression of multiple cylinder systems undergoing FIV over the past two decades.The control methods,such as helical strakes,splitter plates,control rods and flexible sheets,are not always effective,depending on many influence factors,such as the spacing ratio,the arrangement geometrical shape,the flow velocity and the parameters of the vibration control devices.The FIV response,hydrodynamic features and wake patterns of the multiple cylinders equipped with vibration control devices are reviewed and summarized.The FIV suppression efficiency of the vibration control methods are analyzed and compared considering different influence factors.Further research on the FIV suppression of multiple cylinders is suggested to provide insight for the development of FIV control methods and promote engineering applications of FIV control methods.

Spatial-Temporal Distribution, Geological Characteristics and Ore-Formation Controlling Factors of Major Types of Rare Metal Mineral Deposits in China

Rare metals including Lithium(Li),Beryllium(Be),Rubidium(Rb),Cesium(Cs),Zirconium(Zr),Hafnium(Hf),Niobium(Nb),Tantalum(Ta),Tungsten(W)and Tin(Sn)are important critical mineral resources.In China,rare metal mineral deposits are spatially distributed mainly in the Altay and Southern Great Xingán Range regions in the Central Asian orogenic belt;in the Middle Qilian,South Qinling and East Qinling mountains regions in the Qilian-Qinling-Dabie orogenic belt;in the Western Sichuan and Bailongshan-Dahongliutan regions in the Kunlun-Songpan-Garze orogenic belt,and in the Northeastern Jiangxi,Northwestern Jiangxi,and Southern Hunan regions in South China.Major ore-forming epochs include Indosinian(mostly 200-240 Ma,in particular in western China)and the Yanshanian(mostly 120-160 Ma,in particular in South China).In addition,Bayan Obo,Inner Mongolia,northeastern China,with a complex formation history,hosts the largest REE and Nb deposits in China.There are six major rare metal mineral deposit types in China:Highly fractionated granite;Pegmatite;Alkaline granite;Carbonatite and alkaline rock;Volcanic;and Hydrothermal types.Two further types,namely the Leptynite type and Breccia pipe type,have recently been discovered in China,and are represented by the Yushishan Nb-Ta-(Zr-Hf-REE)and the Weilasituo Li-Rb-Sn-W-Zn-Pb deposits.Several most important controlling factors for rare metal mineral deposits are discussed,including geochemical behaviors and sources of the rare metals,highly evolved magmatic fractionation,and structural controls such as the metamorphic core complex setting,with a revised conceptual model for the latter.