Multivariate Time Series Anomaly Detection Based on Spatial-Temporal Network and Transformer in Industrial Internet of Things

In the Industrial Internet of Things(IIoT),sensors generate time series data to reflect the working state.When the systems are attacked,timely identification of outliers in time series is critical to ensure security.Although many anomaly detection methods have been proposed,the temporal correlation of the time series over the same sensor and the state(spatial)correlation between different sensors are rarely considered simultaneously in these methods.Owing to the superior capability of Transformer in learning time series features.This paper proposes a time series anomaly detection method based on a spatial-temporal network and an improved Transformer.Additionally,the methods based on graph neural networks typically include a graph structure learning module and an anomaly detection module,which are interdependent.However,in the initial phase of training,since neither of the modules has reached an optimal state,their performance may influence each other.This scenario makes the end-to-end training approach hard to effectively direct the learning trajectory of each module.This interdependence between the modules,coupled with the initial instability,may cause the model to find it hard to find the optimal solution during the training process,resulting in unsatisfactory results.We introduce an adaptive graph structure learning method to obtain the optimal model parameters and graph structure.Experiments on two publicly available datasets demonstrate that the proposed method attains higher anomaly detection results than other methods.

Comprehensive evaluation and spatial-temporal evolution characteristics of urban resilience in Chengdu-Chongqing Economic Circle

To clarify the connotations and extensions of urban resilience,this study focuses on the Chengdu-Chongqing Economic Circle with 16 cities as research subjects.A comprehensive evaluation index system was constructed to measure the resilience of each city from 2003 to 2020.The spatial-temporal evolution characteristics were analyzed using Kernel density estimation,standard deviation ellipse,and spatial Markov chain analysis,and the spatial Tobit model was introduced to discover the influencing factors.The results indicate the following:①Urban resilience in the Chengdu-Chongqing Economic Circle displays an upward trend,with the center of gravity moving to the southwest,and the polarization phenomenon intensifying.②The urban resilience level in a region has certain spatial and geographical dependence,while the probability of urban resilience transfer differs in adjacent cities with different resilience levels.③Urban centrality,economic scale,openness level,and financial development promote urban resilience,whereas government scale significantly inhibits it.Finally,this paper proposes countermeasures and suggestions to improve the urban resilience of the Chengdu-Chongqing Economic Circle.

AFSTGCN:Prediction for multivariate time series using an adaptive fused spatial-temporal graph convolutional network

The prediction for Multivariate Time Series(MTS)explores the interrelationships among variables at historical moments,extracts their relevant characteristics,and is widely used in finance,weather,complex industries and other fields.Furthermore,it is important to construct a digital twin system.However,existing methods do not take full advantage of the potential properties of variables,which results in poor predicted accuracy.In this paper,we propose the Adaptive Fused Spatial-Temporal Graph Convolutional Network(AFSTGCN).First,to address the problem of the unknown spatial-temporal structure,we construct the Adaptive Fused Spatial-Temporal Graph(AFSTG)layer.Specifically,we fuse the spatial-temporal graph based on the interrelationship of spatial graphs.Simultaneously,we construct the adaptive adjacency matrix of the spatial-temporal graph using node embedding methods.Subsequently,to overcome the insufficient extraction of disordered correlation features,we construct the Adaptive Fused Spatial-Temporal Graph Convolutional(AFSTGC)module.The module forces the reordering of disordered temporal,spatial and spatial-temporal dependencies into rule-like data.AFSTGCN dynamically and synchronously acquires potential temporal,spatial and spatial-temporal correlations,thereby fully extracting rich hierarchical feature information to enhance the predicted accuracy.Experiments on different types of MTS datasets demonstrate that the model achieves state-of-the-art single-step and multi-step performance compared with eight other deep learning models.

The Impact of Network Topologies and Radio Duty Cycle Mechanisms on the RPL Routing Protocol Power Consumption

The Internet of Things(IoT)has witnessed a significant surge in adoption,particularly through the utilization of Wireless Sensor Networks(WSNs),which comprise small internet-connected devices.These deployments span various environments and offer a multitude of benefits.However,the widespread use of battery-powered devices introduces challenges due to their limited hardware resources and communication capabilities.In response to this,the Internet Engineering Task Force(IETF)has developed the IPv6 Routing Protocol for Low-power and Lossy Networks(RPL)to address the unique requirements of such networks.Recognizing the critical role of RPL in maintaining high performance,this paper proposes a novel approach to optimizing power consumption.Specifically,it introduces a developed sensor motes topology integrated with a Radio Duty Cycling(RDC)mechanism aimed at minimizing power usage.Through rigorous analysis,the paper evaluates the power efficiency of this approach through several simulations conducted across different network topologies,including random,linear,tree,and elliptical topologies.Additionally,three distinct RDC mechanisms—CXMAC,ContikiMAC,and NullRDC—are investigated to assess their impact on power consumption.The findings of the study,based on a comprehensive and deep analysis of the simulated results,highlight the efficiency of ContikiMAC in power conservation.This research contributes valuable insights into enhancing the energy efficiency of RPL-based IoT networks,ultimately facilitating their widespread deployment and usability in diverse environments.

Inconsistent phylogenetic topologies reveal genomic admixture in Kallima butterflies(Lepidoptera:Nymphalidae)

Kallima butterflies are famous for their leaf-mimicking wing patterns.Yet the characterization of Kallima species is still under debate owing to their high phenotypic similarity.With the release of the K.inachus reference genome,phylogenetic studies based on genome-wide data have been carried out,thus improving the understanding of the evolutionary relationships of the genus Kallima.However,we noticed that there is some conflict between genome-based phylogenies and morphological classifications in butterflies.We further examined the cause of this conflict by conducting an in-depth study of the relationships among Kallima butterflies to test possible reticulate phylogenetic topologies.We constructed phylogenies based on various datasets(including SNPs in single-copy genes,coding sequences,neutral regions and all remaining sites across the genome)to compare the topologies,revealing the complex evolutionary history of Kallima butterflies.Our results suggest that the reticulate species topology may constitute a pervasive pattern present not only in species with adaptive radiations but also in gradually evolving species,with Kallima butterflies as an example.

Electromagnetic Performance Analysis of Variable Flux Memory Machines with Series-magnetic-circuit and Different Rotor Topologies

In this paper,the electromagnetic performance of variable flux memory(VFM)machines with series-magnetic-circuit is investigated and compared for different rotor topologies.Based on a V-type VFM machine,five topologies with different interior permanent magnet(IPM)arrangements are evolved and optimized under same constrains.Based on two-dimensional(2-D)finite element(FE)method,their electromagnetic performance at magnetization and demagnetization states is evaluated.It reveals that the iron bridge and rotor lamination region between constant PM(CPM)and variable PM(VPM)play an important role in torque density and flux regulation(FR)capabilities.Besides,the global efficiency can be improved in VFM machines by adjusting magnetization state(MS)under different operating conditions.

Space Topologies and Their Dual Space Topologies for Conventional Functional Space Topologies

In this paper, we have studied the topology of some classical functional spaces. Among these spaces, there are standard spaces, spaces that can be metrizable and others that cannot be metrizable. But they are all topological vector spaces and it is in this context that we have chosen to present this work. We are interested in the topology of its spaces and in the topologies of their dual spaces. The first part, we presented the fundamental topological properties of topological vector spaces. The second part, we studied Frechet spaces and particularly the space S(Rn) of functions of class C∞ on Rn which are as well as all their rapidly decreasing partial derivatives. We have also studied its dual S'(Rn) the space of tempered distributions. The last part aims to define a topological structure on an increasing union of Frechet spaces called inductive limit of Frechet spaces. We study in particular the space D(Ω) of functions of class C∞ with compact supports on Ω as well as its dual D' (Ω) the space distributions over the open set Ω.

Spatial-temporal distribution and geochemistry of highly evolved Mesozoic granites in Great Xing’an Range,NE China:Discriminant criteria and geological significance

Highly evolved granite is an important sign of the mature continent crust and closely associated with deposits of rare metals.In this work,the authors undertake systematically zircon U-Pb ages and whole rock elemental data for highly evolved granitic intrusions from the Great Xing’an Range(GXR),NE China,to elucidate their discriminant criteria,spatial-temporal distribution,differentiation and geodynamic mecha-nism.Geochemical data of these highly evolved granites suggest that high w(SiO_(2))(>70%)and differentiation index(DI>88)could be quantified indicators,while strong Eu depletion,high TE_(1,3),lowΣREE and low Zr/Hf,Nb/Ta,K/Rb could only be qualitative indicators.Zircon U-Pb ages suggest that the highly evolved gran-ites in the GXR were mainly formed in Late Mesozoic,which can be divided into two major stages:Late Ju-rassic-early Early Cretaceous(162-136 Ma,peak at 138 Ma),and late Early Cretaceous(136-106 Ma,peak at 126 Ma).The highly evolved granites are mainly distributed in the central-southern GXR,and display a weakly trend of getting younger from northwest to southeast,meanwhile indicating the metallogenic potential of rare metals within the central GXR.The spatial-temporal distribution,combined with regional geological data,indicates the highly evolved Mesozoic granites in the GXR were emplaced in an extensional environ-ment,of which the Late Jurassic-early Early Cretaceous extension was related to the closure of the Mongol-Okhotsk Ocean and roll-back of the Paleo-Pacific Plate,while the late Early Cretaceous extension was mainly related to the roll-back of the Paleo-Pacific Plate.

Spatial-temporal Divergence Characteristics and Driving Factors of Green Economic Efficiency in the Yangtze River Economic Belt of China

The spatial and temporal variation of green economic efficiency and its driving factors are of great significance for the construction of high-efficiency and low-consumption green development model and sustainable socio-economic development.The research focused on the Yangtze River Economic Belt(YREB)and employed the miniumum distance to strong efficient frontier DEA(MinDs)model to measure the green economic efficiency of the municipalities in the region between 2008 and 2020.Then,the spatial autocorrelation model was used to analyze the evolution characteristics of its spatial pattern.Finally,Geodetector was applied to reveal the drivers and their interactions on green economic efficiency.It is found that:1)the overall green economic efficiency of the YREB from 2008 to 2020 shows a W-shaped fluctuating upward trend,green economic efficiency is greater in the downstream and smallest in the upstream;2)the spatial distribution of green economic efficiency shows clustering characteristics,with multi-core clustering based on‘city clusters-central cities'becoming more obvious over time;the High-High agglomeration type is mainly clustered in Jiangsu and Zheji-ang,while the Low-Low agglomeration type is clustered in the western Sichuan Plateau area and southwestern Yunnan;3)from input-output factors,whether it is the YREB as a whole or the upper,middle and lower reaches regions,the economic development level,labor input,and capital investment are the leading factors in the spatial-temporal evolution of green economic efficiency,with the com-prehensive influence of economic development level and pollution index being the most important interactive driving factor;4)from so-cio-economic factors,information technology drivers such as government intervention,transportation accessibility,information infra-structure,and Internet penetration are always high impact influencers and dominant interaction factors for green economic efficiency in the YREB and the three major regions in the upper,middle and lower reaches.Accordingly,the article puts forward relevant policy re-commendations in terms of formulating differentiated green transformation strategies,strengthening network leadership and informa-tion technology construction and coordinating multi-factor integrated development,which could provide useful reference for promoting synergistic green economic efficiency in the YREB.

Containment control of heterogeneous multi-agent systems subject to Markovian randomly switching topologies and unbounded delays

This paper addresses the problem of containment control for heterogeneous multi-agent systems subject to Markovian randomly switching topologies and unbounded communication delays.The objective is to design a distributed control strategy that ensures the output of each follower converges to the convex hull formed by the outputs of a group of leaders in mean square sense.A novel distributed observer is proposed by tackling both Markovian randomly switching topologies and unbounded delays.Then,a distributed state feedback controller and a distributed output feedback controller are developed based on the distributed observer,respectively.Finally,simulation results are provided to demonstrate the effectiveness of the proposed controllers.

Adaptive spatial-temporal graph attention network for traffic speed prediction

Considering the nonlinear structure and spatial-temporal correlation of traffic network,and the influence of potential correlation between nodes of traffic network on the spatial features,this paper proposes a traffic speed prediction model based on the combination of graph attention network with self-adaptive adjacency matrix(SAdpGAT)and bidirectional gated recurrent unit(BiGRU).First-ly,the model introduces graph attention network(GAT)to extract the spatial features of real road network and potential road network respectively in spatial dimension.Secondly,the spatial features are input into BiGRU to extract the time series features.Finally,the prediction results of the real road network and the potential road network are connected to generate the final prediction results of the model.The experimental results show that the prediction accuracy of the proposed model is im-proved obviously on METR-LA and PEMS-BAY datasets,which proves the advantages of the pro-posed spatial-temporal model in traffic speed prediction.

Spatial-temporal Variation Characteristics of Water Quality in the Lower Reaches of the Nenjiang River

As an important river in the western part of Jilin Province,the lower reach of the Nenjiang River is an important wetland water source conservation area in Jilin Province.Within the watershed,it governs the Momoge Wetland,the Xianghai Wetland,and the Danjiang Wetland in Jilin Province.The main problem in the lower reaches of the Nenjiang River is the uneven distribution of water resources in time and space,and the intensification of land salinization.Zhenlai County and Da an City in the Nenjiang River Basin have sufficient surface water resources,with surface water as the drinking water source.Baicheng City and Tongyu County have scarce surface water resources,and both use groundwater as their domestic water source.The main polluted section in the basin is the Xianghai Reservoir,and the annual water quality evaluation is Class V.However,the water quality of the Tao er River,the main stream of the Nenjiang River,is significantly better than that of the Xianghai Reservoir.In order to better study the water environmental pollution situation in the Nenjiang River basin,monitoring data from five sections of non seasonal rivers in the basin from 2012 to 2021 were selected for studying water quality.This in-depth exploration of the water pollution status and river water quality change trends in the Nenjiang River basin is of great significance for future rural development,agricultural pattern transformation,and the promotion of water ecological civilization construction.

The Impairment Attention Capture by Topological Change in Children With Autism Spectrum Disorder

Objective Autism spectrum disorder(ASD)is a neurodevelopmental condition characterized by difficulties with communication and social interaction,restricted and repetitive behaviors.Previous studies have indicated that individuals with ASD exhibit early and lifelong attention deficits,which are closely related to the core symptoms of ASD.Basic visual attention processes may provide a critical foundation for their social communication and interaction abilities.Therefore,this study explores the behavior of children with ASD in capturing attention to changes in topological properties.Methods Our study recruited twenty-seven ASD children diagnosed by professional clinicians according to DSM-5 and twenty-eight typically developing(TD)age-matched controls.In an attention capture task,we recorded the saccadic behaviors of children with ASD and TD in response to topological change(TC)and non-topological change(nTC)stimuli.Saccadic reaction time(SRT),visual search time(VS),and first fixation dwell time(FFDT)were used as indicators of attentional bias.Pearson correlation tests between the clinical assessment scales and attentional bias were conducted.Results This study found that TD children had significantly faster SRT(P<0.05)and VS(P<0.05)for the TC stimuli compared to the nTC stimuli,while the children with ASD did not exhibit significant differences in either measure(P>0.05).Additionally,ASD children demonstrated significantly less attention towards the TC targets(measured by FFDT),in comparison to TD children(P<0.05).Furthermore,ASD children exhibited a significant negative linear correlation between their attentional bias(measured by VS)and their scores on the compulsive subscale(P<0.05).Conclusion The results suggest that children with ASD have difficulty shifting their attention to objects with topological changes during change detection.This atypical attention may affect the child’s cognitive and behavioral development,thereby impacting their social communication and interaction.In sum,our findings indicate that difficulties in attentional capture by TC may be a key feature of ASD.

Topological states constructed by two different trivial quantum wires

The topological states of the two-leg and three-leg ladders formed by two trivial quantum wires with different lattice constants are theoretically investigated. Firstly, we take two trivial quantum wires with a lattice constant ratio of 1:2 as an example. For the symmetric nearest-neighbor intra-chain hopping two-leg ladder, the inversion symmetry protected topological insulator phase with two degenerate topological edge states appears. When the inversion symmetry is broken, the topological insulators with one or two topological edge states of different energies and topological metals with edge states embedded in the bulk states could emerge depending on the filling factor. The topological origin of these topological states in the two-leg ladders is the topological properties of the Chern insulators and Chern metals. According to the arrangement of two trivial quantum wires, we construct two types of three-leg ladders. Each type of the three-leg ladder could be divided into one trivial subspace and one topological nontrivial subspace by unitary transformation. The topological nontrivial subspace corresponds to the effective two-leg ladder model. As the filling factor changes, the system could be in topological insulators or topological metals phases. When the two-leg ladder is constructed by two trivial quantum wires with a lattice constant ratio of 1:3 and 2:3, the system could also realize rich topological states such as the topological insulators and topological metals with the topological edge states. These rich topological states in the two-leg and three-leg ladders could be confirmed by current experimental techniques.

Topology, Size, and Shape Optimization in Civil Engineering Structures: A Review

The optimization of civil engineering structures is critical for enhancing structural performance and material efficiency in engineering applications.Structural optimization approaches seek to determine the optimal design,by considering material performance,cost,and structural safety.The design approaches aim to reduce the built environment’s energy use and carbon emissions.This comprehensive review examines optimization techniques,including size,shape,topology,and multi-objective approaches,by integrating these methodologies.The trends and advancements that contribute to developing more efficient,cost-effective,and reliable structural designs were identified.The review also discusses emerging technologies,such as machine learning applications with different optimization techniques.Optimization of truss,frame,tensegrity,reinforced concrete,origami,pantographic,and adaptive structures are covered and discussed.Optimization techniques are explained,including metaheuristics,genetic algorithm,particle swarm,ant-colony,harmony search algorithm,and their applications with mentioned structure types.Linear and non-linear structures,including geometric and material nonlinearity,are distinguished.The role of optimization in active structures,structural design,seismic design,form-finding,and structural control is taken into account,and the most recent techniques and advancements are mentioned.

Pore-scale investigation of forced imbibition in porous rocks through interface curvature and pore topology analysis

Forced imbibition,the invasion of a wetting fluid into porous rocks,plays an important role in the effective exploitation of hydrocarbon resources and the geological sequestration of carbon dioxide.However,the interface dynamics influenced by complex topology commonly leads to non-wetting fluid trapping.Particularly,the underlying mechanisms under viscously unfavorable conditions remain unclear.This study employs a direct numerical simulation method to simulate forced imbibition through the reconstructed digital rocks of sandstone.The interface dynamics and fluid–fluid interactions are investigated through transient simulations,while the pore topology metrics are introduced to analyze the impact on steady-state residual fluid distribution obtained by a pseudo-transient scheme.The results show that the cooperative pore-filling process promoted by corner flow is dominant at low capillary numbers.This leads to unstable inlet pressure,mass flow,and interface curvature,which correspond to complicated interface dynamics and higher residual fluid saturation.During forced imbibition,the interface curvature gradually increases,with the pore-filling mechanisms involving the cooperation of main terminal meniscus movement and arc menisci filling.Complex topology with small diameter pores may result in the destabilization of interface curvature.The residual fluid saturation is negatively correlated with porosity and pore throat size,and positively correlated with tortuosity and aspect ratio.A large mean coordination number characterizing global connectivity promotes imbibition.However,high connectivity characterized by the standardized Euler number corresponding to small pores is associated with a high probability of non-wetting fluid trapping.

GPU-Enabled Isogometric Topology Optimization with Bezier Element Stiffness Mapping

Due to the high-order B-spline basis functions utilized in isogeometric analysis(IGA)and the repeatedly updating global stiffness matrix of topology optimization,Isogeometric topology optimization(ITO)intrinsically suffers from the computationally demanding process.In this work,we address the efficiency problem existing in the assembling stiffness matrix and sensitivity analysis using B˙ezier element stiffness mapping.The Element-wise and Interaction-wise parallel computing frameworks for updating the global stiffness matrix are proposed for ITO with B˙ezier element stiffness mapping,which differs from these ones with the traditional Gaussian integrals utilized.Since the explicit stiffness computation formula derived from B˙ezier element stiffness mapping possesses a typical parallel structure,the presented GPU-enabled ITO method can greatly accelerate the computation speed while maintaining its high memory efficiency unaltered.Numerical examples demonstrate threefold speedup:1)the assembling stiffness matrix is accelerated by 10×maximumly with the proposed GPU strategy;2)the solution efficiency of a sparse linear system is enhanced by up to 30×with Eigen replaced by AMGCL;3)the efficiency of sensitivity analysis is promoted by 100×with GPU applied.Therefore,the proposed method is a promising way to enhance the numerical efficiency of ITO for both single-patch and multiple-patch design problems.

Topology Data Analysis-Based Error Detection for Semantic Image Transmission with Incremental Knowledge-Based HARQ

Semantic communication(SemCom)aims to achieve high-fidelity information delivery under low communication consumption by only guaranteeing semantic accuracy.Nevertheless,semantic communication still suffers from unexpected channel volatility and thus developing a re-transmission mechanism(e.g.,hybrid automatic repeat request[HARQ])becomes indispensable.In that regard,instead of discarding previously transmitted information,the incremental knowledge-based HARQ(IK-HARQ)is deemed as a more effective mechanism that could sufficiently utilize the information semantics.However,considering the possible existence of semantic ambiguity in image transmission,a simple bit-level cyclic redundancy check(CRC)might compromise the performance of IK-HARQ.Therefore,there emerges a strong incentive to revolutionize the CRC mechanism,thus more effectively reaping the benefits of both SemCom and HARQ.In this paper,built on top of swin transformer-based joint source-channel coding(JSCC)and IK-HARQ,we propose a semantic image transmission framework SC-TDA-HARQ.In particular,different from the conventional CRC,we introduce a topological data analysis(TDA)-based error detection method,which capably digs out the inner topological and geometric information of images,to capture semantic information and determine the necessity for re-transmission.Extensive numerical results validate the effectiveness and efficiency of the proposed SC-TDA-HARQ framework,especially under the limited bandwidth condition,and manifest the superiority of TDA-based error detection method in image transmission.

Spatial-temporal Evolvement Characteristics of Climate Productivity for the Plants on Inner Mongolia Desert Steppe

Thornthwaite Memorial model and other statistic methods were used to calculate the climate-productivity of plants with the meteorological data from 1961 to 2007 at 9 stations distributed on Inner Mongolia desert steppe.The spatial and temporal variation characteristics of climate-productivity were analyzed by using the methods of the tendency rate of the climate trend,accumulative anomaly,and spatial difference and so on.The results showed that the climate-productivity kept linear increased trend over Inner Mongolia desert steppe in recent 47 years,but not significant.In spatial distribution,the climate-productivity reduced with the increased latitude.The climate-productivity in southwest part of Inner Mongolia desert steppe was growing while that in the southeast was reducing.The variation rate of the climate-productivity increased from the northwest part to the southeast part of Inner Mongolia desert steppe.In recent 47 years,the climate-productivity in southeast Jurh underwent the greatest decreasing extent,and the region was the sensitive area of the climate-productivity variation.

Study on the Relationship among Forest Fire,Temperature and Precipitation and Its Spatial-temporal Variability in China

[Objective] The aim was to discuss the relationship between forest fire and meterological elements （precipitation and temprature） in each region of China.[Method] Firstly,the average precipitation and temperature in forest area of each province in fire season were obtained based on meterological data,forest distribution data,seasonal and monthly data of forest fire in China.Secondly,the relationship among forest fire area,precipitation and temperature was discussed through temporal and correlation analysis.[Result] The changes of precipitation and temperature with time could reflect the annual variation of fire area well.Forest fire area went up with the decrease of precipitation and increase of temprature,and visa versa.Meanwhile,there existed diffirences in the relationship in various regions over time.Correlation analyses revealed that there was positive correlation between forest fire area and temperature,especailly Northwest China （R=0.367,P〈0.01）,Southwest China （R=0.327,P〈0.05）,South China （R=0.33,P〈0.05）,East China （R=0.516,P〈0.01） and Xinjiang （R=0.447,P〈0.05） with obviously positive correlation.At the same time,the correlation between forest fire area and precipitation was significantly positive in Northwest China （R=0.482,P〈0.01）,while it was significantly negaive in South China （R=-0.323,P=0.03）,but there was no significant correlation in other regions.[Conclusion] Relationships between forest fire and meteorological elements （precipitation and temprature） revealed in the study would be useful for fire provention and early warning in China.