Hierarchical multihead self-attention for time-series-based fault diagnosis

Fault diagnosis is important for maintaining the safety and effectiveness of chemical process.Considering the multivariate,nonlinear,and dynamic characteristic of chemical process,many time-series-based data-driven fault diagnosis methods have been developed in recent years.However,the existing methods have the problem of long-term dependency and are difficult to train due to the sequential way of training.To overcome these problems,a novel fault diagnosis method based on time-series and the hierarchical multihead self-attention(HMSAN)is proposed for chemical process.First,a sliding window strategy is adopted to construct the normalized time-series dataset.Second,the HMSAN is developed to extract the time-relevant features from the time-series process data.It improves the basic self-attention model in both width and depth.With the multihead structure,the HMSAN can pay attention to different aspects of the complicated chemical process and obtain the global dynamic features.However,the multiple heads in parallel lead to redundant information,which cannot improve the diagnosis performance.With the hierarchical structure,the redundant information is reduced and the deep local time-related features are further extracted.Besides,a novel many-to-one training strategy is introduced for HMSAN to simplify the training procedure and capture the long-term dependency.Finally,the effectiveness of the proposed method is demonstrated by two chemical cases.The experimental results show that the proposed method achieves a great performance on time-series industrial data and outperforms the state-of-the-art approaches.

Missing Value Imputation for Radar-Derived Time-Series Tracks of Aerial Targets Based on Improved Self-Attention-Based Network

The frequent missing values in radar-derived time-series tracks of aerial targets(RTT-AT)lead to significant challenges in subsequent data-driven tasks.However,the majority of imputation research focuses on random missing(RM)that differs significantly from common missing patterns of RTT-AT.The method for solving the RM may experience performance degradation or failure when applied to RTT-AT imputation.Conventional autoregressive deep learning methods are prone to error accumulation and long-term dependency loss.In this paper,a non-autoregressive imputation model that addresses the issue of missing value imputation for two common missing patterns in RTT-AT is proposed.Our model consists of two probabilistic sparse diagonal masking self-attention(PSDMSA)units and a weight fusion unit.It learns missing values by combining the representations outputted by the two units,aiming to minimize the difference between the missing values and their actual values.The PSDMSA units effectively capture temporal dependencies and attribute correlations between time steps,improving imputation quality.The weight fusion unit automatically updates the weights of the output representations from the two units to obtain a more accurate final representation.The experimental results indicate that,despite varying missing rates in the two missing patterns,our model consistently outperforms other methods in imputation performance and exhibits a low frequency of deviations in estimates for specific missing entries.Compared to the state-of-the-art autoregressive deep learning imputation model Bidirectional Recurrent Imputation for Time Series(BRITS),our proposed model reduces mean absolute error(MAE)by 31%~50%.Additionally,the model attains a training speed that is 4 to 8 times faster when compared to both BRITS and a standard Transformer model when trained on the same dataset.Finally,the findings from the ablation experiments demonstrate that the PSDMSA,the weight fusion unit,cascade network design,and imputation loss enhance imputation performance and confirm the efficacy of our design.

Modeling urban redevelopment:A novel approach using time-series remote sensing data and machine learning

Accurate mapping and timely monitoring of urban redevelopment are pivotal for urban studies and decisionmakers to foster sustainable urban development.Traditional mapping methods heavily depend on field surveys and subjective questionnaires,yielding less objective,reliable,and timely data.Recent advancements in Geographic Information Systems(GIS)and remote-sensing technologies have improved the identification and mapping of urban redevelopment through quantitative analysis using satellite-based observations.Nonetheless,challenges persist,particularly concerning accuracy and significant temporal delays.This study introduces a novel approach to modeling urban redevelopment,leveraging machine learning algorithms and remote-sensing data.This methodology can facilitate the accurate and timely identification of urban redevelopment activities.The study’s machine learning model can analyze time-series remote-sensing data to identify spatio-temporal and spectral patterns related to urban redevelopment.The model is thoroughly evaluated,and the results indicate that it can accurately capture the time-series patterns of urban redevelopment.This research’s findings are useful for evaluating urban demographic and economic changes,informing policymaking and urban planning,and contributing to sustainable urban development.The model can also serve as a foundation for future research on early-stage urban redevelopment detection and evaluation of the causes and impacts of urban redevelopment.

Meteorological factors, ambient air pollution, and daily hospital admissions for depressive disorder in Harbin: A time-series study

BACKGROUND The literature has discussed the relationship between environmental factors and depressive disorders;however,the results are inconsistent in different studies and regions,as are the interaction effects between environmental factors.We hypo-thesized that meteorological factors and ambient air pollution individually affect and interact to affect depressive disorder morbidity.AIM To investigate the effects of meteorological factors and air pollution on depressive disorders,including their lagged effects and interactions.METHODS The samples were obtained from a class 3 hospital in Harbin,China.Daily hos-pital admission data for depressive disorders from January 1,2015 to December 31,2022 were obtained.Meteorological and air pollution data were also collected during the same period.Generalized additive models with quasi-Poisson regre-ssion were used for time-series modeling to measure the non-linear and delayed effects of environmental factors.We further incorporated each pair of environ-mental factors into a bivariate response surface model to examine the interaction effects on hospital admissions for depressive disorders.RESULTS Data for 2922 d were included in the study,with no missing values.The total number of depressive admissions was 83905.Medium to high correlations existed between environmental factors.Air temperature(AT)and wind speed(WS)significantly affected the number of admissions for depression.An extremely low temperature(-29.0℃)at lag 0 caused a 53%[relative risk(RR)=1.53,95%confidence interval(CI):1.23-1.89]increase in daily hospital admissions relative to the median temperature.Extremely low WSs(0.4 m/s)at lag 7 increased the number of admissions by 58%(RR=1.58,95%CI:1.07-2.31).In contrast,atmospheric pressure and relative humidity had smaller effects.Among the six air pollutants considered in the time-series model,nitrogen dioxide(NO_(2))was the only pollutant that showed significant effects over non-cumulative,cumulative,immediate,and lagged conditions.The cumulative effect of NO_(2) at lag 7 was 0.47%(RR=1.0047,95%CI:1.0024-1.0071).Interaction effects were found between AT and the five air pollutants,atmospheric temperature and the four air pollutants,WS and sulfur dioxide.CONCLUSION Meteorological factors and the air pollutant NO_(2) affect daily hospital admissions for depressive disorders,and interactions exist between meteorological factors and ambient air pollution.

Sentinel-1 In SAR observations and time-series analysis of co-and postseismic deformation mechanisms of the 2021 Mw 5.8 Bandar Ganaveh Earthquake,Southern Iran

In the past two decades,because of the significant increase in the availability of differential interferometry from synthetic aperture radar and GPS data,spaceborne geodesy has been widely employed to determine the co-seismic displacement field of earthquakes.On April 18,2021,a moderate earthquake(Mw 5.8)occurred east of Bandar Ganaveh,southern Iran,followed by intensive seismic activity and aftershocks of various magnitudes.We use two-pass D-InSAR and Small Baseline Inversion techniques via the LiCSBAS suite to study the coseismic displacement and monitor the four-month post-seismic deformation of the Bandar Ganaveh earthquake,as well as constrain the fault geometry of the co-seismic faulting mechanism during the seismic sequence.Analyses show that the co-and postseismic deformation are distributed in relatively shallow depths along with an NW-SE striking and NE dipping complex reverse/thrust fault branches of the Zagros Mountain Front Fault,complying with the main trend of the Zagros structures.The average cumulative displacements were obtained from-137.5 to+113.3 mm/yr in the SW and NE blocks of the Mountain Front Fault,respectively.The received maximum uplift amount is approximately consistent with the overall orogen-normal shortening component of the Arabian-Eurasian convergence in the Zagros region.No surface ruptures were associated with the seismic source;therefore,we propose a shallow blind thrust/reverse fault(depth~10 km)connected to the deeper basal decollement fault within a complex tectonic zone,emphasizing the thin-skinned tectonics.

Generating Time-Series Data Using Generative Adversarial Networks for Mobility Demand Prediction

The increasing penetration rate of electric kickboard vehicles has been popularized and promoted primarily because of its clean and efficient features.Electric kickboards are gradually growing in popularity in tourist and education-centric localities.In the upcoming arrival of electric kickboard vehicles,deploying a customer rental service is essential.Due to its freefloating nature,the shared electric kickboard is a common and practical means of transportation.Relocation plans for shared electric kickboards are required to increase the quality of service,and forecasting demand for their use in a specific region is crucial.Predicting demand accurately with small data is troublesome.Extensive data is necessary for training machine learning algorithms for effective prediction.Data generation is a method for expanding the amount of data that will be further accessible for training.In this work,we proposed a model that takes time-series customers’electric kickboard demand data as input,pre-processes it,and generates synthetic data according to the original data distribution using generative adversarial networks(GAN).The electric kickboard mobility demand prediction error was reduced when we combined synthetic data with the original data.We proposed Tabular-GAN-Modified-WGAN-GP for generating synthetic data for better prediction results.We modified The Wasserstein GAN-gradient penalty(GP)with the RMSprop optimizer and then employed Spectral Normalization(SN)to improve training stability and faster convergence.Finally,we applied a regression-based blending ensemble technique that can help us to improve performance of demand prediction.We used various evaluation criteria and visual representations to compare our proposed model’s performance.Synthetic data generated by our suggested GAN model is also evaluated.The TGAN-Modified-WGAN-GP model mitigates the overfitting and mode collapse problem,and it also converges faster than previous GAN models for synthetic data creation.The presented model’s performance is compared to existing ensemble and baseline models.The experimental findings imply that combining synthetic and actual data can significantly reduce prediction error rates in the mean absolute percentage error(MAPE)of 4.476 and increase prediction accuracy.

Graph Construction Method for GNN-Based Multivariate Time-Series Forecasting

Multivariate time-series forecasting(MTSF)plays an important role in diverse real-world applications.To achieve better accuracy in MTSF,time-series patterns in each variable and interrelationship patterns between variables should be considered together.Recently,graph neural networks(GNNs)has gained much attention as they can learn both patterns using a graph.For accurate forecasting through GNN,a well-defined graph is required.However,existing GNNs have limitations in reflecting the spectral similarity and time delay between nodes,and consider all nodes with the same weight when constructing graph.In this paper,we propose a novel graph construction method that solves aforementioned limitations.We first calculate the Fourier transform-based spectral similarity and then update this similarity to reflect the time delay.Then,we weight each node according to the number of edge connections to get the final graph and utilize it to train the GNN model.Through experiments on various datasets,we demonstrated that the proposed method enhanced the performance of GNN-based MTSF models,and the proposed forecasting model achieve of up to 18.1%predictive performance improvement over the state-of-the-art model.

基于累加式实时串并联变换算法的机械故障声学监测方法

针对基于物联网(IoT)的冲压机床故障监测问题,为了降低冲压机床故障监测的计算复杂度,并提高其低频识别的精度,提出了一种无需机器学习技术的实时性机械故障声学监测方法,即基于累加式实时串并联变换算法的机械故障声学监测方法。首先,研究了物联网场景中冲压机床声学低频分析的必要性,并给出了声学信号的表达式;然后,针对频率轴上多个周期信号重叠导致参数估计较为困难的问题,提出了一种累加式实时串并联变换算法,将输入的采样序列馈入多个具有不同输出端口的串并转换器,从累加的波形中检测出最大绝对值,并进行了比较;最后,通过样本时隙划分,将累加式实时串并联变换算法应用于机械故障监测;通过仿真和冲压机床实机测试,对累加式实时串并联变换算法和实时性机械故障声学监测方法的有效性进行了验证。研究结果表明:在无需大量信号样本的情况下,使用累加式实时串并联变换算法有利于提高低频带的识别精度;在直方图相关性方面,累加式实时串并联变换算法和Morlet小波变换具有相同的性能,且均明显优于短时傅立叶变换;同时,尽管累加式实时串并联变换算法需要的加法总数比Morlet小波变换多2.5倍,但是乘法总数减少了20447%,大幅减少了计算的复杂度。

Influence of vapor pressure deficit on vegetation growth in China

Vapor pressure deficit(VPD)plays a crucial role in determining plant physiological functions and exerts a substantial influence on vegetation,second only to carbon dioxide(CO_(2)).As a robust indicator of atmospheric water demand,VPD has implications for global water resources,and its significance extends to the structure and functioning of ecosystems.However,the influence of VPD on vegetation growth under climate change remains unclear in China.This study employed empirical equations to estimate the VPD in China from 2000 to 2020 based on meteorological reanalysis data of the Climatic Research Unit(CRU)Time-Series version 4.06(TS4.06)and European Centre for Medium-Range Weather Forecasts(ECMWF)Reanalysis 5(ERA-5).Vegetation growth status was characterized using three vegetation indices,namely gross primary productivity(GPP),leaf area index(LAI),and near-infrared reflectance of vegetation(NIRv).The spatiotemporal dynamics of VPD and vegetation indices were analyzed using the Theil-Sen median trend analysis and Mann-Kendall test.Furthermore,the influence of VPD on vegetation growth and its relative contribution were assessed using a multiple linear regression model.The results indicated an overall negative correlation between VPD and vegetation indices.Three VPD intervals for the correlations between VPD and vegetation indices were identified:a significant positive correlation at VPD below 4.820 hPa,a significant negative correlation at VPD within 4.820–9.000 hPa,and a notable weakening of negative correlation at VPD above 9.000 hPa.VPD exhibited a pronounced negative impact on vegetation growth,surpassing those of temperature,precipitation,and solar radiation in absolute magnitude.CO_(2) contributed most positively to vegetation growth,with VPD offsetting approximately 30.00%of the positive effect of CO_(2).As the rise of VPD decelerated,its relative contribution to vegetation growth diminished.Additionally,the intensification of spatial variations in temperature and precipitation accentuated the spatial heterogeneity in the impact of VPD on vegetation growth in China.This research provides a theoretical foundation for addressing climate change in China,especially regarding the challenges posed by increasing VPD.

Heat exposure and hospitalizations for chronic kidney disease in China: a nationwide time series study in 261 major Chinese cities

Background:Climate change profoundly shapes the population health at the global scale.However,there was still insufficient and inconsistent evidence for the association between heat exposure and chronic kidney disease(CKD).Methods:In the present study,we studied the association of heat exposure with hospitalizations for cause-specific CKD using a national inpatient database in China during the study period of hot season from 2015 to 2018.Standard time-series regression models and random-effects Meta-analysis were developed to estimate the city-specific and national averaged associations at a 7 lag-day span,respectively.Results:A total of 768,129 hospitalizations for CKD was recorded during the study period.The results showed that higher temperature was associated with elevated risk of hospitalizations for CKD,especially in sub-tropical cities.With a 1℃ increase in daily mean temperature,the cumulative relative risks(RR)over lag 0-7 d were 1.008[95% confidence interval(CI)1.003-1.012]for nationwide.The attributable fraction of CKD hospitalizations due to high temperatures was 5.50%.Stronger associations were observed among younger patients and those with obstructive nephropathy.Our study also found that exposure to heatwaves was associated with added risk of hospitalizations for CKD compared to non-heatwave days(RR=1.116,95%CI 1.069-1.166)above the effect of daily mean temperature.Conclusions:Short-term heat exposure may increase the risk of hospitalization for CKD.Our findings provide insights into the health effects of climate change and suggest the necessity of guided protection strategies against the adverse effects of high temperatures.

InSAR-derived surface deformation characteristics and mining subsidence parameters in mountain coal mines

Mining-induced surface deformation disrupts ecological balance and impedes economic progress.This study employs SBAS-InSAR with 107-view of ascending and descending SAR data from Sentinel-1,spanning February 2017 to September 2020,to monitor surface deformation in the Fa’er Coal Mine,Guizhou Province.Analysis on the surface deformation time series reveals the relationship between underground mining and surface shifts.Considering geological conditions,mining activities,duration,and ranges,the study determines surface movement parameters for the coal mine.It asserts that mining depth significantly influences surface movement parameters in mountainous mining areas.Increasing mining depth elevates the strike movement angle on the deeper side of the burial depth by 22.84°,while decreasing by 7.74°on the shallower side.Uphill movement angles decrease by 4.06°,while downhill movement angles increase by 15.71°.This emphasizes the technology's suitability for local mining design,which lays the groundwork for resource development,disaster prevention,and ecological protection in analogous contexts.

WT-FCTGN:A wavelet-enhanced fully connected time-gated neural network for complex noisy traffic flow modeling

Accurate forecasting of traffic flow provides a powerful traffic decision-making basis for an intelligent transportation system. However, the traffic data's complexity and fluctuation, as well as the noise produced during collecting information and summarizing original data of traffic flow, cause large errors in the traffic flow forecasting results. This article suggests a solution to the above mentioned issues and proposes a fully connected time-gated neural network based on wavelet reconstruction(WT-FCTGN). To eliminate the potential noise and strengthen the potential traffic trend in the data, we adopt the methods of wavelet reconstruction and periodic data introduction to preprocess the data. The model introduces fully connected time-series blocks to model all the information including time sequence information and fluctuation information in the flow of traffic, and establishes the time gate block to comprehend the periodic characteristics of the flow of traffic and predict its flow. The performance of the WT-FCTGN model is validated on the public Pe MS data set. The experimental results show that the WT-FCTGN model has higher accuracy, and its mean absolute error(MAE), mean absolute percentage error(MAPE) and root mean square error(RMSE) are obviously lower than those of the other algorithms. The robust experimental results prove that the WT-FCTGN model has good anti-noise ability.

《切韻》系韻書用於記録吴方言詞的中古新增字三例

《切韻》系韻書記録了大量中古新增字,有些新增字是方言詞進入標準語詞彙系統引起的。本文選取《切韻》系韻書中吴方言詞的三個例子,分别例説方言詞引起中古字形新增的三種類型。方言詞和中古新增字研究不單純涉及漢字字形問題,還涉及漢語方言和非漢語成分的識别問題。該類研究有助於拓展研究視野,以觀察漢語及漢字複雜的來源、形成和演變過程。

一种带秒准时沿的串口时间发送技术

介绍了一种带秒准时沿的串口时间发送的技术实现。该技术应用于时间同步装置中,装置在发送串口时间报文时,串口时间报文的帧头起始位的下降沿为携带的秒准时沿。经验证,时间同步装置的串口时间报文帧头的起始位下降沿与该装置输出的秒信号准时沿同沿输出,时差小于30 ns,其帧头起始位的下降沿可作为该帧时间报文的秒准时沿用。

IP架构电视系统测量分析

随着基于电影和电视工程师协会(The Society of Motion Picture and Television Engineers,SMPTE)ST 2110标准的网际互连协议(Internet Protocol,IP)化电视系统越来越多,传统串行数字接口(Serial Digital Interface,SDI)架构电视系统测量方法在IP化电视系统中已不再适用。对此,详细介绍IP测量与SDI测量的区别与联系,以及IP架构电视系统测量的内容、方法及相关指标,以期在IP化电视系统出现问题时,能够通过相关测量,快速定位、解决系统故障。

跨平台访问端传感网络串口通信多线程实现

串口是外部串行设备与计算机之间的关键数据传输通道,由于跨平台访问端的传感器数据来自不同平台,具有显著独立性,融合难度较大,直接影响多线程通信效率。提出一种针对跨平台访问端传感网络的串口通信多线程实现方法。构建跨平台访问端,采用统计概率置信度算法,修正或剔除传感网络数据中的异常值。从时间相关性和空间相关性,完成传感网络的数据融合。依据信标时序补偿网络时钟同步法、父子链路时序轮转调度法,分配多线程执行信息传输,实现跨平台访问端传感网络串口多线程通信。实验表明:当线程数量由1增加至16时,在低网络流量和高网络流量负载情况下,所提方法的传感网络延迟可控制在0.53 ms以内。且在相同传输错漏率下,所提方法的进程平均超限步数始终更低。

Temperature and Daily Mortality in Shanghai:A Time-series Study

To investigate the association between temperature and daily mortality in Shanghai from June 1, 2000 to December 31, 2001. Methods Time-series approach was used to estimate the effect of temperature on daily total and cause-specific mortality. We fitted generalized additive Poisson regression using non-parametric smooth functions to control for long-term time trend, season and other variables. We also controlled for day of the week. Results A gently sloping V-like relationship between total mortality and temperature was found, with an optimum temperature (e.g. temperature with lowest mortality risk) value of 26.7癈 in Shanghai. For temperatures above the optimum value, total mortality increased by 0.73% for each degree Celsius increase; while for temperature below the optimum value, total mortality decreased by 1.21% for each degree Celsius increase. Conclusions Our findings indicate that temperature has an effect on daily mortality in Shanghai, and the time-series approach is a useful tool for studying the temperature-mortality association.

Mapping winter wheat using phenological feature of peak before winter on the North China Plain based on time-series MODIS data

By employing the unique phenological feature of winter wheat extracted from peak before winter （PBW） and the advantages of moderate resolution imaging spectroradiometer （MODIS） data with high temporal resolution and intermediate spatial resolution, a remote sensing-based model for mapping winter wheat on the North China Plain was built through integration with Landsat images and land-use data. First, a phenological window, PBW was drawn from time-series MODIS data. Next, feature extraction was performed for the PBW to reduce feature dimension and enhance its information. Finally, a regression model was built to model the relationship of the phenological feature and the sample data. The amount of information of the PBW was evaluated and compared with that of the main peak （MP）. The relative precision of the mapping reached up to 92% in comparison to the Landsat sample data, and ranged between 87 and 96% in comparison to the statistical data. These results were sufficient to satisfy the accuracy requirements for winter wheat mapping at a large scale. Moreover, the proposed method has the ability to obtain the distribution information for winter wheat in an earlier period than previous studies. This study could throw light on the monitoring of winter wheat in China by using unique phenological feature of winter wheat.

Review of the SBAS InSAR Time-series algorithms, applications, and challenges

In the past 30 years,the small baseline subset(SBAS)InSAR time-series technique has emerged as an essential tool for measuring slow surface displacement and estimating geophysical parameters.Because of its ability to monitor large-scale deformation with millimeter accuracy,the SBAS method has been widely used in various geodetic fields,such as ground subsidence,landslides,and seismic activity.The obtained long-term time-series cumulative deformation is vital for studying the deformation mecha-nism.This article reviews the algorithms,applications,and challenges of the SBAS method.First,we recall the fundamental principle and analyze the shortcomings of the traditional SBAS algorithm,which provides a basic framework for the following improved time series methods.Second,we classify the current improved SBAS techniques from different perspectives:solving the ill-posed equation,increasing the density of high-coherence points,improving the accuracy of monitoring deformation and measuring the multi-dimensional deformation.Third,we summarize the application of the SBAS method in monitoring ground subsidence,permafrost degradation,glacier movement,volcanic activity,landslides,and seismic activity.Finally,we discuss the difficulties faced by the SBAS method and explore its future development direction.

Clustering Structure Analysis in Time-Series Data With Density-Based Clusterability Measure

Clustering is used to gain an intuition of the struc tures in the data.Most of the current clustering algorithms pro duce a clustering structure even on data that do not possess such structure.In these cases,the algorithms force a structure in the data instead of discovering one.To avoid false structures in the relations of data,a novel clusterability assessment method called density-based clusterability measure is proposed in this paper.I measures the prominence of clustering structure in the data to evaluate whether a cluster analysis could produce a meaningfu insight to the relationships in the data.This is especially useful in time-series data since visualizing the structure in time-series data is hard.The performance of the clusterability measure is evalu ated against several synthetic data sets and time-series data sets which illustrate that the density-based clusterability measure can successfully indicate clustering structure of time-series data.