Multivariate Time Series Anomaly Detection Based on Spatial-Temporal Network and Transformer in Industrial Internet of Things

In the Industrial Internet of Things(IIoT),sensors generate time series data to reflect the working state.When the systems are attacked,timely identification of outliers in time series is critical to ensure security.Although many anomaly detection methods have been proposed,the temporal correlation of the time series over the same sensor and the state(spatial)correlation between different sensors are rarely considered simultaneously in these methods.Owing to the superior capability of Transformer in learning time series features.This paper proposes a time series anomaly detection method based on a spatial-temporal network and an improved Transformer.Additionally,the methods based on graph neural networks typically include a graph structure learning module and an anomaly detection module,which are interdependent.However,in the initial phase of training,since neither of the modules has reached an optimal state,their performance may influence each other.This scenario makes the end-to-end training approach hard to effectively direct the learning trajectory of each module.This interdependence between the modules,coupled with the initial instability,may cause the model to find it hard to find the optimal solution during the training process,resulting in unsatisfactory results.We introduce an adaptive graph structure learning method to obtain the optimal model parameters and graph structure.Experiments on two publicly available datasets demonstrate that the proposed method attains higher anomaly detection results than other methods.

Uncertainties of landslide susceptibility prediction:influences of different study area scales and mapping unit scales

This study aims to investigate the effects of different mapping unit scales and study area scales on the uncertainty rules of landslide susceptibility prediction(LSP).To illustrate various study area scales,Ganzhou City in China,its eastern region(Ganzhou East),and Ruijin County in Ganzhou East were chosen.Different mapping unit scales are represented by grid units with spatial resolution of 30 and 60 m,as well as slope units that were extracted by multi-scale segmentation method.The 3855 landslide locations and 21 typical environmental factors in Ganzhou City are first determined to create spatial datasets with input-outputs.Then,landslide susceptibility maps(LSMs)of Ganzhou City,Ganzhou East and Ruijin County are pro-duced using a support vector machine(SVM)and random forest(RF),respectively.The LSMs of the above three regions are then extracted by mask from the LSM of Ganzhou City,along with the LSMs of Ruijin County from Ganzhou East.Additionally,LSMs of Ruijin at various mapping unit scales are generated in accordance.Accuracy and landslide suscepti-bility indexes(LSIs)distribution are used to express LSP uncertainties.The LSP uncertainties under grid units significantly decrease as study area scales decrease from Ganzhou City,Ganzhou East to Ruijin County,whereas those under slope units are less affected by study area scales.Of course,attentions should also be paid to the broader representativeness of large study areas.The LSP accuracy of slope units increases by about 6%–10%compared with those under grid units with 30 m and 60 m resolution in the same study area's scale.The significance of environmental factors exhibits an averaging trend as study area scale increases from small to large.The importance of environmental factors varies greatly with the 60 m grid unit,but it tends to be consistent to some extent in the 30 m grid unit and the slope unit.

Comprehensive evaluation and spatial-temporal evolution characteristics of urban resilience in Chengdu-Chongqing Economic Circle

To clarify the connotations and extensions of urban resilience,this study focuses on the Chengdu-Chongqing Economic Circle with 16 cities as research subjects.A comprehensive evaluation index system was constructed to measure the resilience of each city from 2003 to 2020.The spatial-temporal evolution characteristics were analyzed using Kernel density estimation,standard deviation ellipse,and spatial Markov chain analysis,and the spatial Tobit model was introduced to discover the influencing factors.The results indicate the following:①Urban resilience in the Chengdu-Chongqing Economic Circle displays an upward trend,with the center of gravity moving to the southwest,and the polarization phenomenon intensifying.②The urban resilience level in a region has certain spatial and geographical dependence,while the probability of urban resilience transfer differs in adjacent cities with different resilience levels.③Urban centrality,economic scale,openness level,and financial development promote urban resilience,whereas government scale significantly inhibits it.Finally,this paper proposes countermeasures and suggestions to improve the urban resilience of the Chengdu-Chongqing Economic Circle.

AFSTGCN:Prediction for multivariate time series using an adaptive fused spatial-temporal graph convolutional network

The prediction for Multivariate Time Series(MTS)explores the interrelationships among variables at historical moments,extracts their relevant characteristics,and is widely used in finance,weather,complex industries and other fields.Furthermore,it is important to construct a digital twin system.However,existing methods do not take full advantage of the potential properties of variables,which results in poor predicted accuracy.In this paper,we propose the Adaptive Fused Spatial-Temporal Graph Convolutional Network(AFSTGCN).First,to address the problem of the unknown spatial-temporal structure,we construct the Adaptive Fused Spatial-Temporal Graph(AFSTG)layer.Specifically,we fuse the spatial-temporal graph based on the interrelationship of spatial graphs.Simultaneously,we construct the adaptive adjacency matrix of the spatial-temporal graph using node embedding methods.Subsequently,to overcome the insufficient extraction of disordered correlation features,we construct the Adaptive Fused Spatial-Temporal Graph Convolutional(AFSTGC)module.The module forces the reordering of disordered temporal,spatial and spatial-temporal dependencies into rule-like data.AFSTGCN dynamically and synchronously acquires potential temporal,spatial and spatial-temporal correlations,thereby fully extracting rich hierarchical feature information to enhance the predicted accuracy.Experiments on different types of MTS datasets demonstrate that the model achieves state-of-the-art single-step and multi-step performance compared with eight other deep learning models.

Rate-limiting factors in hydrate decomposition through depressurization across various scales:A mini-review

Natural gas hydrate is an energy resource for methane that has a carbon quantity twice more than all traditional fossil fuels combined.However,their practical application in the field has been limited due to the challenges of long-term preparation,high costs and associated risks.Experimental studies,on the other hand,offer a safe and cost-effective means of exploring the mechanisms of hydrate dissociation and optimizing exploitation conditions.Gas hydrate decomposition is a complicated process along with intrinsic kinetics,mass transfer and heat transfer,which are the influencing factors for hydrate decomposition rate.The identification of the rate-limiting factor for hydrate dissociation during depressurization varies with the scale of the reservoir,making it challenging to extrapolate findings from laboratory experiments to the actual exploitation.This review aims to summarize current knowledge of investigations on hydrate decomposition on the subject of the research scale(core scale,middle scale,large scale and field tests)and to analyze determining factors for decomposition rate,considering the various research scales and their associated influencing factors.

Spatial-temporal distribution and geochemistry of highly evolved Mesozoic granites in Great Xing’an Range,NE China:Discriminant criteria and geological significance

Highly evolved granite is an important sign of the mature continent crust and closely associated with deposits of rare metals.In this work,the authors undertake systematically zircon U-Pb ages and whole rock elemental data for highly evolved granitic intrusions from the Great Xing’an Range(GXR),NE China,to elucidate their discriminant criteria,spatial-temporal distribution,differentiation and geodynamic mecha-nism.Geochemical data of these highly evolved granites suggest that high w(SiO_(2))(>70%)and differentiation index(DI>88)could be quantified indicators,while strong Eu depletion,high TE_(1,3),lowΣREE and low Zr/Hf,Nb/Ta,K/Rb could only be qualitative indicators.Zircon U-Pb ages suggest that the highly evolved gran-ites in the GXR were mainly formed in Late Mesozoic,which can be divided into two major stages:Late Ju-rassic-early Early Cretaceous(162-136 Ma,peak at 138 Ma),and late Early Cretaceous(136-106 Ma,peak at 126 Ma).The highly evolved granites are mainly distributed in the central-southern GXR,and display a weakly trend of getting younger from northwest to southeast,meanwhile indicating the metallogenic potential of rare metals within the central GXR.The spatial-temporal distribution,combined with regional geological data,indicates the highly evolved Mesozoic granites in the GXR were emplaced in an extensional environ-ment,of which the Late Jurassic-early Early Cretaceous extension was related to the closure of the Mongol-Okhotsk Ocean and roll-back of the Paleo-Pacific Plate,while the late Early Cretaceous extension was mainly related to the roll-back of the Paleo-Pacific Plate.

Spatial-temporal Divergence Characteristics and Driving Factors of Green Economic Efficiency in the Yangtze River Economic Belt of China

The spatial and temporal variation of green economic efficiency and its driving factors are of great significance for the construction of high-efficiency and low-consumption green development model and sustainable socio-economic development.The research focused on the Yangtze River Economic Belt(YREB)and employed the miniumum distance to strong efficient frontier DEA(MinDs)model to measure the green economic efficiency of the municipalities in the region between 2008 and 2020.Then,the spatial autocorrelation model was used to analyze the evolution characteristics of its spatial pattern.Finally,Geodetector was applied to reveal the drivers and their interactions on green economic efficiency.It is found that:1)the overall green economic efficiency of the YREB from 2008 to 2020 shows a W-shaped fluctuating upward trend,green economic efficiency is greater in the downstream and smallest in the upstream;2)the spatial distribution of green economic efficiency shows clustering characteristics,with multi-core clustering based on‘city clusters-central cities'becoming more obvious over time;the High-High agglomeration type is mainly clustered in Jiangsu and Zheji-ang,while the Low-Low agglomeration type is clustered in the western Sichuan Plateau area and southwestern Yunnan;3)from input-output factors,whether it is the YREB as a whole or the upper,middle and lower reaches regions,the economic development level,labor input,and capital investment are the leading factors in the spatial-temporal evolution of green economic efficiency,with the com-prehensive influence of economic development level and pollution index being the most important interactive driving factor;4)from so-cio-economic factors,information technology drivers such as government intervention,transportation accessibility,information infra-structure,and Internet penetration are always high impact influencers and dominant interaction factors for green economic efficiency in the YREB and the three major regions in the upper,middle and lower reaches.Accordingly,the article puts forward relevant policy re-commendations in terms of formulating differentiated green transformation strategies,strengthening network leadership and informa-tion technology construction and coordinating multi-factor integrated development,which could provide useful reference for promoting synergistic green economic efficiency in the YREB.

Adaptive spatial-temporal graph attention network for traffic speed prediction

Considering the nonlinear structure and spatial-temporal correlation of traffic network,and the influence of potential correlation between nodes of traffic network on the spatial features,this paper proposes a traffic speed prediction model based on the combination of graph attention network with self-adaptive adjacency matrix(SAdpGAT)and bidirectional gated recurrent unit(BiGRU).First-ly,the model introduces graph attention network(GAT)to extract the spatial features of real road network and potential road network respectively in spatial dimension.Secondly,the spatial features are input into BiGRU to extract the time series features.Finally,the prediction results of the real road network and the potential road network are connected to generate the final prediction results of the model.The experimental results show that the prediction accuracy of the proposed model is im-proved obviously on METR-LA and PEMS-BAY datasets,which proves the advantages of the pro-posed spatial-temporal model in traffic speed prediction.

Spatial-temporal Variation Characteristics of Water Quality in the Lower Reaches of the Nenjiang River

As an important river in the western part of Jilin Province,the lower reach of the Nenjiang River is an important wetland water source conservation area in Jilin Province.Within the watershed,it governs the Momoge Wetland,the Xianghai Wetland,and the Danjiang Wetland in Jilin Province.The main problem in the lower reaches of the Nenjiang River is the uneven distribution of water resources in time and space,and the intensification of land salinization.Zhenlai County and Da an City in the Nenjiang River Basin have sufficient surface water resources,with surface water as the drinking water source.Baicheng City and Tongyu County have scarce surface water resources,and both use groundwater as their domestic water source.The main polluted section in the basin is the Xianghai Reservoir,and the annual water quality evaluation is Class V.However,the water quality of the Tao er River,the main stream of the Nenjiang River,is significantly better than that of the Xianghai Reservoir.In order to better study the water environmental pollution situation in the Nenjiang River basin,monitoring data from five sections of non seasonal rivers in the basin from 2012 to 2021 were selected for studying water quality.This in-depth exploration of the water pollution status and river water quality change trends in the Nenjiang River basin is of great significance for future rural development,agricultural pattern transformation,and the promotion of water ecological civilization construction.

Spatial-temporal Evolvement Characteristics of Climate Productivity for the Plants on Inner Mongolia Desert Steppe

Thornthwaite Memorial model and other statistic methods were used to calculate the climate-productivity of plants with the meteorological data from 1961 to 2007 at 9 stations distributed on Inner Mongolia desert steppe.The spatial and temporal variation characteristics of climate-productivity were analyzed by using the methods of the tendency rate of the climate trend,accumulative anomaly,and spatial difference and so on.The results showed that the climate-productivity kept linear increased trend over Inner Mongolia desert steppe in recent 47 years,but not significant.In spatial distribution,the climate-productivity reduced with the increased latitude.The climate-productivity in southwest part of Inner Mongolia desert steppe was growing while that in the southeast was reducing.The variation rate of the climate-productivity increased from the northwest part to the southeast part of Inner Mongolia desert steppe.In recent 47 years,the climate-productivity in southeast Jurh underwent the greatest decreasing extent,and the region was the sensitive area of the climate-productivity variation.

Study on the Relationship among Forest Fire,Temperature and Precipitation and Its Spatial-temporal Variability in China

[Objective] The aim was to discuss the relationship between forest fire and meterological elements （precipitation and temprature） in each region of China.[Method] Firstly,the average precipitation and temperature in forest area of each province in fire season were obtained based on meterological data,forest distribution data,seasonal and monthly data of forest fire in China.Secondly,the relationship among forest fire area,precipitation and temperature was discussed through temporal and correlation analysis.[Result] The changes of precipitation and temperature with time could reflect the annual variation of fire area well.Forest fire area went up with the decrease of precipitation and increase of temprature,and visa versa.Meanwhile,there existed diffirences in the relationship in various regions over time.Correlation analyses revealed that there was positive correlation between forest fire area and temperature,especailly Northwest China （R=0.367,P〈0.01）,Southwest China （R=0.327,P〈0.05）,South China （R=0.33,P〈0.05）,East China （R=0.516,P〈0.01） and Xinjiang （R=0.447,P〈0.05） with obviously positive correlation.At the same time,the correlation between forest fire area and precipitation was significantly positive in Northwest China （R=0.482,P〈0.01）,while it was significantly negaive in South China （R=-0.323,P=0.03）,but there was no significant correlation in other regions.[Conclusion] Relationships between forest fire and meteorological elements （precipitation and temprature） revealed in the study would be useful for fire provention and early warning in China.

Scales,methods and technical analysis of China's residential environment evaluation

To improve China＇s residential environment evaluation system and enhance its guiding role, current research results are analyzed and summarized from three aspects including research scales, evaluation methods and applied technology by means of comparison, induction and empirical application. The guiding role of the current macro-scale evaluation system of urban planning and construction is generally not obvious, whereas the guiding role of medium and micro-scale systems to the improvement of residential environments is improving. There are diversified methods for determining the threshold values and the weights of indices in China＇s evaluation system. For instance, the analytic hierarchy process（AHP） method is adopted to determine the weights of indices. The advantages and disadvantages of the method are analyzed on the basis of empirical calculation. In the course of comprehensive analyses, a nonlinear model can reflect interactions among indices more than a linear model; the evaluation model under the ARCGIS platform prevails since it combines space and attribute, and it has intuitive results. So far, the methodological system of China＇s residential environment evaluation has not been established; its subject coverage and research category should be expanded, and its guiding role should be enhanced.

Study on the scales of heterogeneous geologic bodies in random media

In order to study the scale characteristics of heterogeneities in complex media, a random medium is constructed using a statistical method and by changing model parameters （autocorrelation lengths a and b）, the scales of heterogeneous geologic bodies in the horizontal and the vertical Cartesian directions may be varied in the medium. The autocorrelation lengths a and b represent the mean scale of heterogeneous geologic bodies in the horizontal and vertical Cartesian directions in the randQm medium, respectively. Based on this model, the relationship between model autocorrelation lengths and heterogeneous geologic body scales is studied by horizontal velocity variation and standard deviation. The horizontal velocity variation research shows that velocities are in random perturbation. The heterogeneous geologic body scale increases with increasing autocorrelation length. The recursion equation for the relationship between autocorrelation lengths and heterogeneous geologic body scales is determined from the velocity standard deviation research and the actual heterogeneous geologic body scale magnitude can be estimated by the equation.

Spatial-Temporal Distribution Characteristics and Limiting Factors of Medium-low Yield Farmland in Tianjin

[Objective] This paper aimed to understand the area change and distribu- tion of medium-low yield farmland, and offered basis to the improvement of mediumlow farmland and its increase of grain production in Tianjin. [Method] Based on the statistical date of Tianjin and its relevant counties and districts, the yield standard was set up to classify high-yield, medium-yield and low-yield farmland in Tianjin. The author analyzed area change of medium-low yield farmland in six agricultural counties and districts （including Jixian County, Wuqing District, Baodi District, Ninghe County, Jinghai County and Dagang district of Binghai New Area） from 1980 to 2010. [Result] The results showed that the average yield of grain rose from 2 445 kg/hm^2 in 1980 to 5 130 kg/hm^2 in 2010, increasing 109.82%. The area of mediumlow yield farmland was reduced from 291 250.13 hm^2 in 1985 to 76 489.87 hm^2 in 2010, coming down 74%. In Tianjin, the area of medium-low yield farmland of 2010 accounted for 19% of the total farmland, of which the ratios of medium-low yield farmland of Jinghai County, Jixian County, Dagang district of Binghai New Area, Wuqing District, Baodi District and Ninghe County were 43.12%, 18.59%, 17.23%, 14.01%, 7.05% and 0, respectively. Low soil nutrient content, drought and water shortage, as well as soil salinization were the main yield limiting factors to mediumlow yield farmland in Tianjin in 2010. [Conclusion] The countermeasures to improve the medium-low yield farmland were proposed, involving enhancing the investment of the government, strengthening the construction of water conservancy infrastructure, further improving the soil fertility, as well as saline and alkaline land, optimizing the farming system and planting drought and salt tolerance crops, etc.

Effect of Phytohormones on Adventitious Bud Differentiation from Bulb Scales of Oriental Lily Test-tube Plantlets

[Objective] The purpose of this study is to investigate the effects of differ- ent phytohormones on the adventitious bud differentiation of oriental lily. [Method] The bulb scales of the test-tube plantlets of Tiber, Rodina and Constanta were cul- tured in media supplemented with different cytokinin and auxin at different concen- tration, and then the adventitious buds in each treatment were calculated. [Result] Cytokinins had different influence on the adventitious bud differentiation of the three oriental lily cultivars. Among them, 6-BA had the best effect to induce the adventi- tious bud differentiation from bulb scales of Tiber and Rodina, but there was some difference in the optimal concentration. KT had the best effect to induce the adven- titious bud differentiation of Constanta. The auxins had little influence on the quality of the adventitious bud of the three oriental lily cultivars, but caused some difference in differentiation coefficients. [Conclusion] The most suitable media for the adventi- tious bud differentiation from bulb scales in vitro of Tiber, Rodina and Constanta were MS＋0.2 mg/L 6-BA＋0.2 mg/L 2,4-D, MS＋I.0 mg/L 6-BA＋0.2 mg/L IAA, MS＋ 1.0 mg/L KT＋0.5 mg/L 2,4-D, respectively.

Spatial-temporal Evolution and Driving Force of Cultivated Land Quality in Henan Province

The purpose of this study was to find out the spatial-temporal rules and driving force of cultivated land quality in Henan Province in the last ten years. Agricultural land grading factor evaluation was used to evaluate the cultivated land quality of 2002 and 2012 in Henan Province, and to research the change laws. Method of correlation coefficient was employed to select the driving forces affecting cultivated land quality evolution. The results indicated that the cultivated land quality in Henan Province increased slightly in the last ten years in general, and in spatial there were unchanged regions, increased regions and decreased regions. The cultivated land quality in spatial presented the trend of good becoming better, bad becoming worse, which should be highly valued in cultivated land quality protection and management. Land development and consolidation projects had significant contributions to increasing the cultivated land quality. Driving forces between the sudden change regions and gradual change regions were significantly different. The paper concluded that the research on the spatial-temporal evolution and driving force of cultivated land quality based on cultivated land quality evolution had important academic significance and practical value.

多重障碍学生的学业评价——英国“P Scales”述评

“P Scales”是英国教育部用于评价多重等严重障碍学生学业的评估工具,其把低于国家课程1级水平的学业表现分为八个等级,内容包含国家课程中的所有学科科目。“P Scales”的设计基于对学生早期交流、互动和认知发展水平的研究,采取学科导向的分层设计与表现性的内容描述,既概述了有学习困难的学生可能表现出来的一般情况,又将多重等严重障碍学生的学习纳入国家课程标准体系。

Bowel preparation quality scales for colonoscopy

Colorectal cancer(CRC) is the third most common cancer and second leading cause of cancer-related death in the United States. Colonoscopy is widely preferred for CRC screening and is the most commonly used method in the United States. Adequate bowel preparation is essential for successful colonoscopy CRC screening. However, up to one-quarter of colonoscopies are associated with inadequate bowel preparation, which may result in reduced polyp and adenoma detection rates, unsuccessful screens, and an increased likelihood of repeat procedure. In addition, standardized criteria and assessment scales for bowel preparation quality are lacking. While several bowel preparation quality scales are referred to in the literature, these differ greatly in grading methodology and categorization criteria. Published reliability and validity data are available for five bowel preparation quality assessment scales, which vary in several key attributes. However, clinicians and researchers continue to use a variety of bowel preparation quality measures, including nonvalidated scales, leading to potential confusion and difficulty when comparing quality results among clinicians and across clinical trials. Optimal clinical criteria for bowel preparation quality remain controversial. The use of validated bowel preparation quality scales with stringent but simple scoring criteria would help clarify clinical trial data as well as the performance of colonoscopy in clinical practice related to quality measurements.

Trends and Scales of Observed Soil Moisture Variations in China

A new soil moisture dataset from direct gravimetric measurements within the top 50-cm soil layers at 178 soil moisture stations in China covering the period 1981 1998 are used to study the long-term and seasonal trends of soil moisture variations, as well as estimate the temporal and spatial scales of soil moisture for different soil layers. Additional datasets of precipitation and temperature difference between land surface and air （TDSA） are analyzed to gain further insight into the changes of soil moisture. There are increasing trends for the top 10 cm, but decreasing trends for the top 50 cm of soil layers in most regions. Trends in precipitation appear to dominantly influence trends in soil moisture in both cases. Seasonal variation of soil moisture is mainly controlled by precipitation and evaporation, and in some regions can be affected by snow cover in winter. Timescales of soil moisture variation are roughly 1-3 months and increase with soil depth. Further influences of TDSA and precipitation on soil moisture in surface layers, rather than in deeper layers, cause this phenomenon. Seasonal variations of temporal scales for soil moisture are region-dependent and consistent in both layer depths. Spatial scales of soil moisture range from 200-600 km, with topography also having an affect on these. Spatial scales of soil moisture in plains are larger than in mountainous areas. In the former, the spatial scale of soil moisture follows the spatial patterns of precipitation and evaporation, whereas in the latter, the spatial scale is controlled by topography.

The Microstructures of Butterfly Wing Scales in Northeast of China

There are billions of tiny scales on the butterfly wings, which array regularly as the tiles on the roof. Such tilts can form various colors of the wing and afford the species many abilities to survive and propagate. Morphological experiments on the wing scales of six butterfly species living in northeast of China were conducted. By the optics microscope; the form, geometry dimension and array of the scales were observed generally. By using scanning electron microscope （SEM）, the 2D scanning and measurement were carried out and the surface micro configurations of scales were observed. The dimension and microstructure characteristics of the cross section of single scale were achieved through transmission electron microscope （TEM）. Finally, by using 3D software, three 3D models were described and the 3D visual effect was achieved. This work can put forward a basic method for the future study on the morphology of biological microstructure.