Multivariate Time Series Anomaly Detection Based on Spatial-Temporal Network and Transformer in Industrial Internet of Things

In the Industrial Internet of Things(IIoT),sensors generate time series data to reflect the working state.When the systems are attacked,timely identification of outliers in time series is critical to ensure security.Although many anomaly detection methods have been proposed,the temporal correlation of the time series over the same sensor and the state(spatial)correlation between different sensors are rarely considered simultaneously in these methods.Owing to the superior capability of Transformer in learning time series features.This paper proposes a time series anomaly detection method based on a spatial-temporal network and an improved Transformer.Additionally,the methods based on graph neural networks typically include a graph structure learning module and an anomaly detection module,which are interdependent.However,in the initial phase of training,since neither of the modules has reached an optimal state,their performance may influence each other.This scenario makes the end-to-end training approach hard to effectively direct the learning trajectory of each module.This interdependence between the modules,coupled with the initial instability,may cause the model to find it hard to find the optimal solution during the training process,resulting in unsatisfactory results.We introduce an adaptive graph structure learning method to obtain the optimal model parameters and graph structure.Experiments on two publicly available datasets demonstrate that the proposed method attains higher anomaly detection results than other methods.

Characterization of Hydroxyapatite Extracted from Crab Shell Using the Hydrothermal Method with Varying Holding Times

Hydroxyapatite(HA)is a bio ceramic commonly utilized in bone tissue engineering due to its bioactive and osteoconductive properties.Crab shells are usually disregarded as waste material despite their significant CaCO_(3) content,and have not been widely utilized in the synthesis of HA.This study aims to synthesize and analyze HA derived from crab shells using the hydrothermal method with different durations of holding time.This study utilized precipitated calcium carbonate(PCC)derived from crab shells.With a hydrothermal reactor set at 160°C and varying holding times of 14(HA_14),16(HA_16),and 18(HA_18)h,a PCC and(NH4)2HPO4 mixture was used to synthesize HA.The synthesis results were analyzed using scanning electron microscopy(SEM),fourier transform infrared spectroscopy(FTIR),and X-ray diffraction(XRD)tests.This study has accomplished the synthesis of HA from crab shells.Nonetheless,the final product of synthesis still contained CaCO_(3) as an impurity.The prolonged hydrothermal holding time of 14 to 18 h resulted in a reduction of impurities while increasing the percentage of crystal weight and crystallite size of HA.Specimen CH_18 is the best-quality product generated in this study.This specimen produced HA with the highest percentage of crystal weight and crystallite size compared to the other specimens.Furthermore,specimen CH_18 exhibited the lowest concentration of impurities.The Ca/P ratio in this specimen was also the closest to 1.67.The Ca/P ratio,crystallite size,and crystal weight percentage of this specimen are 1.54,19.06 nm,and 99.1%,respectively.

Practical Prescribed Time Tracking Control With Bounded Time-Varying Gain Under Non-Vanishing Uncertainties

This paper investigates the prescribed-time control(PTC) problem for a class of strict-feedback systems subject to non-vanishing uncertainties. The coexistence of mismatched uncertainties and non-vanishing disturbances makes PTC synthesis nontrivial. In this work, a control method that does not involve infinite time-varying gain is proposed, leading to a practical and global prescribed time tracking control solution for the strict-feedback systems, in spite of both the mismatched and nonvanishing uncertainties. Different from methods based on control switching to avoid the issue of infinite control gain that involves control discontinuity at the switching point, in our method a softening unit is exclusively included to ensure the continuity of the control action. Furthermore, in contrast to most existing prescribed-time control works where the control scheme is only valid on a finite time interval, in this work, the proposed control scheme is valid on the entire time interval. In addition, the prior information on the upper or lower bound of gi is not in need,enlarging the applicability of the proposed method. Both the theoretical analysis and numerical simulation confirm the effectiveness of the proposed control algorithm.

A Note on an Order Level Inventory Model with Varying Two-Phased Demand and Time-Proportional Deterioration

The main purpose of this paper is to generalize the effect of two-phased demand and variable deterioration within the EOQ (Economic Order Quantity) framework. The rate of deterioration is a linear function of time. The two-phased demand function states the constant function for a certain period and the quadratic function of time for the rest part of the cycle time. No shortages as well as partial backlogging are allowed to occur. The mathematical expressions are derived for determining the optimal cycle time, order quantity and total cost function. An easy-to-use working procedure is provided to calculate the above quantities. A couple of numerical examples are cited to explain the theoretical results and sensitivity analysis of some selected examples is carried out.

Variational Iteration Method for Solving Time Fractional Burgers Equation Using Maple

The Time Fractional Burger equation was solved in this study using the Mabel software and the Variational Iteration approach. where a number of instances of the Time Fractional Burger Equation were handled using this technique. Tables and images were used to present the collected numerical results. The difference between the exact and numerical solutions demonstrates the effectiveness of the Mabel program’s solution, as well as the accuracy and closeness of the results this method produced. It also demonstrates the Mabel program’s ability to quickly and effectively produce the numerical solution.

Novel models for simulating maize growth based on thermal time and photothermal units: Applications under various mulching practices

Maize (Zea mays L.) is one of the three major food crops and an important source of carbohydrates for maintaining food security around the world.Plant height (H),stem diameter (SD),leaf area index (LAI) and dry matter (DM) are important growth parameters that influence maize production.However,the combined effect of temperature and light on maize growth is rarely considered in crop growth models.Ten maize growth models based on the modified logistic growth equation (Mlog) and the Mitscherlich growth equation (Mit) were proposed to simulate the H,SD,LAI and DM of maize under different mulching practices based on experimental data from 2015–2018.Either the accumulative growing degree-days (AGDD),helio thermal units (HTU),photothermal units (PTU) or photoperiod thermal units (PPTU,first proposed here) was used as a single driving factor in the models;or AGDD was combined with either accumulative actual solar hours (ASS),accumulative photoperiod response (APR,first proposed here) or accumulative maximum possible sunshine hours (ADL) as the dual driving factors in the models.The model performances were evaluated using seven statistical indicators and a global performance index.The results showed that the three mulching practices significantly increased the maize growth rates and the maximum values of the growth curves compared with non-mulching.Among the four single factor-driven models,the overall performance of the Mlog_(PTU)Model was the best,followed by the Mlog_(AGDD)Model.The Mlog_(PPTU)Model was better than the Mlog_(AGDD)Model in simulating SD and LAI.Among the 10 models,the overall performance of the Mlog_(AGDD–APR)Model was the best,followed by the Mlog_(AGDD–ASS)Model.Specifically,the Mlog_(AGDD–APR)Model performed the best in simulating H and LAI,while the Mlog_(AGDD–ADL)and Mlog_(AGDD–ASS)models performed the best in simulating SD and DM,respectively.In conclusion,the modified logistic growth equations with AGDD and either APR,ASS or ADL as the dual driving factors outperformed the commonly used modified logistic growth model with AGDD as a single driving factor in simulating maize growth.

Fine-Grained Multivariate Time Series Anomaly Detection in IoT

Sensors produce a large amount of multivariate time series data to record the states of Internet of Things(IoT)systems.Multivariate time series timestamp anomaly detection(TSAD)can identify timestamps of attacks and malfunctions.However,it is necessary to determine which sensor or indicator is abnormal to facilitate a more detailed diagnosis,a process referred to as fine-grained anomaly detection(FGAD).Although further FGAD can be extended based on TSAD methods,existing works do not provide a quantitative evaluation,and the performance is unknown.Therefore,to tackle the FGAD problem,this paper first verifies that the TSAD methods achieve low performance when applied to the FGAD task directly because of the excessive fusion of features and the ignoring of the relationship’s dynamic changes between indicators.Accordingly,this paper proposes a mul-tivariate time series fine-grained anomaly detection(MFGAD)framework.To avoid excessive fusion of features,MFGAD constructs two sub-models to independently identify the abnormal timestamp and abnormal indicator instead of a single model and then combines the two kinds of abnormal results to detect the fine-grained anomaly.Based on this framework,an algorithm based on Graph Attention Neural Network(GAT)and Attention Convolutional Long-Short Term Memory(A-ConvLSTM)is proposed,in which GAT learns temporal features of multiple indicators to detect abnormal timestamps and A-ConvLSTM captures the dynamic relationship between indicators to identify abnormal indicators.Extensive simulations on a real-world dataset demonstrate that the proposed algorithm can achieve a higher F1 score and hit rate than the extension of existing TSAD methods with the benefit of two independent sub-models for timestamp and indicator detection.

4种植物源性成分多重real-time PCR检测方法的建立及其在食用淀粉中的应用

建立一种可同时快速检测红薯、木薯、马铃薯、玉米源性成分的多重实时聚合酶链式反应(real-time polymerase chain reaction,real-time PCR)方法。分别以红薯g3pdh基因、木薯g3pdh基因、马铃薯UGPase基因、玉米zSSIIb基因为靶基因设计特异性引物和TaqMan探针,以18S rRNA基因为内参基因,建立多重real-time PCR方法,开展方法学验证,并对不同掺入比例模拟样品和实际淀粉样品进行检测。结果显示,该方法具有高通量、特异性强、灵敏度高等优点。与15种非目标源性均无交叉反应;对目标DNA的检测灵敏度可达到3×10^(-3) ng/μL,且具有良好的线性关系和扩增效率;对淀粉样品的检出限可达0.1%,对50份实际样品进行检测,结果与参比方法一致,说明建立的多重real-time PCR法可用于食用淀粉种类掺假鉴别检测。

TimeGAN-Informer长时机场能见度预测

能见度的预测对机场的业务决策、保障飞机的安全起降具有重要的意义。针对现有能见度预测模型预测时间较短的问题,提出一种基于TimeGAN Informer(Time Generative Adversarial Network-Informer)的机场能见度预测方法。利用2018—2022年气象和污染物数据,通过相关系数法和递归特征消除法提取出能见度的主要影响因素,使用TimeGAN时间序列生成对抗网络对数据进行扩充,并将Informer长时间序列预测模型应用于能见度预测。结果显示:当预测步长为1 d、2 d、3 d时,TimeGAN Informer的绝对误差(Mean Absolute Error,MAE)分别为2.42、3.13、3.57,比Informer分别降低了0.29、0.27、0.28,比长短时记忆网络(Long Short-Term Memory,LSTM)分别降低了0.28、0.49、0.63;均方根误差(Root Mean Square Error,RMSE)分别为3.03、3.7、4.09,比Informer分别降低了0.38、0.22、0.24,比长短时记忆网络(LSTM)分别降低了0.3、0.5、1.04;百分误差小于30%的分别占测试样本集的78.07%、70.68%、63.84%。尽管随着步长的增加预测效果变差,但在预测步长为3 d时,多数样本的预测误差仍小于30%,实现了对机场区域较为准确的长时能见度预测。

基于TimeGAN数据增强的复杂过程故障分类方法

针对传统基于重构的故障分类方法在故障样本稀疏或失衡情况下效果不佳、故障子空间区分能力弱的问题,提出基于TimeGAN数据增强的复杂过程故障分类方法.针对小子样故障,使用TimeGAN对历史故障数据进行数据增强,生成与历史数据分布相似的虚拟故障样本;采用马氏距离评估虚拟样本的质量,剔除不可信样本,构造平衡的故障样本集.将故障样本映射到高维核空间,并在核空间中提取故障子空间.设计故障分类策略并定义4种故障分类性能评估指标以定量衡量算法的分类性能.Tennessee Eastman应用结果表明,所提数据增强方法可以有效扩充故障样本,进而提高故障重构率.与WGAN-GP和SMOTE方法进行对比,发现基于TimeGAN数据增强的故障分类方法具有更好的分类性能.

Partial Time-Varying Coefficient Regression and Autoregressive Mixed Model

Regression and autoregressive mixed models are classical models used to analyze the relationship between time series response variable and other covariates. The coefficients in traditional regression and autoregressive mixed models are constants. However, for complicated data, the coefficients of covariates may change with time. In this article, we propose a kind of partial time-varying coefficient regression and autoregressive mixed model and obtain the local weighted least-square estimators of coefficient functions by the local polynomial technique. The asymptotic normality properties of estimators are derived under regularity conditions, and simulation studies are conducted to empirically examine the finite-sample performances of the proposed estimators. Finally, we use real data about Lake Shasta inflow to illustrate the application of the proposed model.

Partial Time-Varying Coefficient Regression and Autoregressive Mixed Model

Regression and autoregressive mixed models are classical models used to analyze the relationship between time series response variable and other covariates. The coefficients in traditional regression and autoregressive mixed models are constants. However, for complicated data, the coefficients of covariates may change with time. In this article, we propose a kind of partial time-varying coefficient regression and autoregressive mixed model and obtain the local weighted least-square estimators of coefficient functions by the local polynomial technique. The asymptotic normality properties of estimators are derived under regularity conditions, and simulation studies are conducted to empirically examine the finite-sample performances of the proposed estimators. Finally, we use real data about Lake Shasta inflow to illustrate the application of the proposed model.

Brain Time Stack图像融合技术在CT中的应用

目的:分析Brain Time Stack图像融合技术在CT中的应用。方法:选取2021年3月—2022年9月衡水市第四人民医院收治的50例CT检查患者作为研究对象。所有患者进行CT检查并进行Brain Time Stack后处理。比较四组不同部位CT值、标准差(SD)、信噪比(SNR)。比较四组图像主观质量评分。分析不同部位CT值、SD、SNR与图像主观质量评分的相关性。结果:B组的延髓、额叶灰质、额叶白质、小脑内侧、小脑外侧、颞肌肌肉CT值明显低于A组;C组的延髓、脑室、额叶白质、小脑内侧、小脑外侧、颞肌肌肉CT值高于A组;D组延髓、额叶灰质、颞肌肌肉CT值明显低于A组,脑室、额叶白质、小脑外侧CT值明显高于A组;C组延髓、额叶灰质、额叶白质、小脑内侧、小脑外侧、颞肌肌肉CT值明显高于B组;D组延髓、脑室、额叶白质、小脑内侧、小脑外侧、颞肌肌肉CT值明显高于B组;D组延髓、额叶灰质、额叶白质、小脑内侧、小脑外侧、颞肌肌肉CT值明显低于C组;D组脑室CT值明显高于C组,差异有统计学意义(P<0.05)。B组、C组、D组延髓、脑室、额叶灰质、额叶白质、小脑内侧、小脑外侧、颞肌肌肉SD值明显低于A组;C组延髓、脑室、额叶白质、小脑内侧、小脑外侧、颞肌肌肉SD值均明显高于B组;C组额叶灰质SD明显低于B组;D组延髓、脑室、额叶灰质、额叶白质、小脑内侧、小脑外侧、肌肉SD均明显低于B组、C组,差异有统计学意义(P<0.05)。B组、C组、D组延髓、脑室、额叶灰质、额叶白质、小脑内侧、小脑外侧、颞肌肌肉SNR均明显高于A组;C组、D组延髓、额叶灰质、额叶白质、小脑内侧、小脑外侧、颞肌肌肉SNR值明显高于B组;C组、D组脑室SNR明显低于B组;D组延髓、脑室、额叶灰质、额叶白质、小脑内侧、小脑外侧、颞肌肌肉SNR明显高于C组,差异有统计学意义(P<0.05)。D组图像主观质量评分最高,差异有统计学意义(P<0.05)。延髓、脑室、额叶灰质、额叶白质、小脑内侧、小脑外侧及颞肌肌肉SD与主观质量评分呈明显负相关,SNR与主观质量评分间呈明显正相关,差异有统计学意义(P<0.05)。结论:利用Brain Time Stack图像融合技术对头部CT扫描检查图像处理,动脉期结合前一期及后一期的图像数据在处理后具有更好的质量和更少的噪音。

Association of daily sitting time and leisure-time physical activity with body fat among U.S.adults

Background:Prolonged sitting and reduced physical activity lead to low energy expenditures.However,little is known about the joint impact of daily sitting time and physical activity on body fat distribution.We investigated the independent and joint associations of daily sitting time and physical activity with body fat among adults.Methods:This was a cross-sectional analysis of U.S.nationally representative data from the National Health and Nutrition Examination Survey2011-2018 among adults aged 20 years or older.Daily sitting time and leisure-time physical activity(LTPA)were self-reported using the Global Physical Activity Questionnaire.Body fat(total and trunk fat percentage)was determined via dual X-ray absorptiometry.Results:Among 10,808 adults,about 54.6%spent 6 h/day or more sitting;more than one-half reported no LTPA(inactive)or less than 150 min/week LTPA(insufficiently active)with only 43.3%reported 150 min/week or more LTPA(active)in the past week.After fully adjusting for sociodemographic data,lifestyle behaviors,and chronic conditions,prolonged sitting time and low levels of LTPA were associated with higher total and trunk fat percentages in both sexes.When stratifying by LTPA,the association between daily sitting time and body fat appeared to be stronger in those who were inactive/insuufficiently active.In the joint analyses,inactive/insuufficiently active adults who reported sitting more than 8 h/day had the highest total(female:3.99%(95%confidence interval(95%CI):3.09%-4.88%);male:3.79%(95%CI:2.75%-4.82%))and trunk body fat percentages(female:4.21%(95%CI:3.09%-5.32%);male:4.07%(95%CI:2.95%-5.19%))when compared with those who were active and sitting less than 4 h/day.Conclusion:Prolonged daily sitting time was associated with increased body fat among U.S.adults.The higher body fat associated with 6 h/day sitting may not be offset by achieving recommended levels of physical activity.

Time-variant fragility analysis of the bridge system considering time-varying dependence among typical component seismic demands

This paper presents a copula technique to develop time-variant seismic fragility curves for corroded bridges at the system level and considers the realistic time-varying dependence among component seismic demands. Based on material deterioration mechanisms and incremental dynamic analysis, the time-evolving seismic demands of components were obtained in the form of marginal probability distributions. The time-varying dependences among bridge components were then captured with the best fitting copula function, which was selected from the commonly used copula classes by the empirical distribution based analysis method. The system time-variant fragility curves at different damage states were developed and the effects of time-varying dependences among components on the bridge system fragility were investigated. The results indicate the time-varying dependence among components significantly affects the time-variant fragility of the bridge system. The copula technique captures the nonlinear dependence among component seismic demands accurately and easily by separating the marginal distributions and the dependence among them.

Stock profiling using time–frequency‑varying systematic risk measure

This study proposes a wavelets approach to estimating time–frequency-varying betas in the capital asset pricing model(CAPM)framework.The dynamic of systematic risk across time and frequency is analyzed to investigate stock risk-profile robustness.Furthermore,we emphasize the effect of an investor’s investment horizon on the robustness of portfolio characteristics.We use a daily panel of French stocks from 2012 to 2022.Results show that varying systematic risk varies in time and frequency,and that its short and long-run evolutions differ.We observe differences in short and long dynamics,indicating that a stock’s betas differently fluctuate to early announcements or signs of events.However,short-run and long-run betas exhibit similar dynamics during persistent shocks.Betas are more volatile during times of crisis,resulting in greater or lesser robustness of risk profiles.Significant differences exist in short-run and longrun risk profiles,implying a different asset allocation.We conclude that the standard CAPM assumes short-run investment.Then,investors should consider time–frequency CAPM to perform systematic risk analysis and portfolio allocation.

Prescribed Performance Tracking Control of Time-Delay Nonlinear Systems With Output Constraints

The problem of prescribed performance tracking control for unknown time-delay nonlinear systems subject to output constraints is dealt with in this paper. In contrast with related works, only the most fundamental requirements, i.e., boundedness and the local Lipschitz condition, are assumed for the allowable time delays. Moreover, we focus on the case where the reference is unknown beforehand, which renders the standard prescribed performance control designs under output constraints infeasible. To conquer these challenges, a novel robust prescribed performance control approach is put forward in this paper.Herein, a reverse tuning function is skillfully constructed and automatically generates a performance envelop for the tracking error. In addition, a unified performance analysis framework based on proof by contradiction and the barrier function is established to reveal the inherent robustness of the control system against the time delays. It turns out that the system output tracks the reference with a preassigned settling time and good accuracy,without constraint violations. A comparative simulation on a two-stage chemical reactor is carried out to illustrate the above theoretical findings.

GENERAL DECAY FOR A VISCOELASTIC EQUATION OF VARIABLE COEFFICIENTS WITH A TIME-VARYING DELAY IN THE BOUNDARY FEEDBACK AND ACOUSTIC BOUNDARY CONDITIONS

A variable coefficient viscoelastic equation with a time-varying delay in the boundary feedback and acoustic boundary conditions and nonlinear source term is considered.Under suitable assumptions, general decay results of the energy are established via suitable Lyapunov functionals and some properties of the convex functions. Our result is obtained without imposing any restrictive growth assumption on the damping term and the elements of the matrix A and the kernel function g.

Communication Resource-Efficient Vehicle Platooning Control With Various Spacing Policies

Platooning represents one of the key features that connected automated vehicles may possess as it allows multiple automated vehicles to be maneuvered cooperatively with small headways on roads. However, a critical challenge in accomplishing automated vehicle platoons is to deal with the effects of intermittent and sporadic vehicle-to-vehicle data transmissions caused by limited wireless communication resources. This paper addresses the co-design problem of dynamic event-triggered communication scheduling and cooperative adaptive cruise control for a convoy of automated vehicles with diverse spacing policies. The central aim is to achieve automated vehicle platooning under various gap references with desired platoon stability and spacing performance requirements, while simultaneously improving communication efficiency. Toward this aim, a dynamic event-triggered scheduling mechanism is developed such that the intervehicle data transmissions are scheduled dynamically and efficiently over time. Then, a tractable co-design criterion on the existence of both the admissible event-driven cooperative adaptive cruise control law and the desired scheduling mechanism is derived. Finally, comparative simulation results are presented to substantiate the effectiveness and merits of the obtained results.

Real-time Rescue Target Detection Based on UAV Imagery for Flood Emergency Response

Timely acquisition of rescue target information is critical for emergency response after a flood disaster.Unmanned Aerial Vehicles(UAVs)equipped with remote sensing capabilities offer distinct advantages,including high-resolution imagery and exceptional mobility,making them well suited for monitoring flood extent and identifying rescue targets during floods.However,there are some challenges in interpreting rescue information in real time from flood images captured by UAVs,such as the complexity of the scenarios of UAV images,the lack of flood rescue target detection datasets and the limited real-time processing capabilities of the airborne on-board platform.Thus,we propose a real-time rescue target detection method for UAVs that is capable of efficiently delineating flood extent and identifying rescue targets(i.e.,pedestrians and vehicles trapped by floods).The proposed method achieves real-time rescue information extraction for UAV platforms by lightweight processing and fusion of flood extent extraction model and target detection model.The flood inundation range is extracted by the proposed method in real time and detects targets such as people and vehicles to be rescued based on this layer.Our experimental results demonstrate that the Intersection over Union(IoU)for flood water extraction reaches an impressive 80%,and the IoU for real-time flood water extraction stands at a commendable 76.4%.The information on flood stricken targets extracted by this method in real time can be used for flood emergency rescue.