Time series segmentation has attracted more interests in recent years,which aims to segment time series into different segments,each reflects a state of the monitored objects.Although there have been many surveys on t...Time series segmentation has attracted more interests in recent years,which aims to segment time series into different segments,each reflects a state of the monitored objects.Although there have been many surveys on time series segmentation,most of them focus more on change point detection(CPD)methods and overlook the advances in boundary detection(BD)and state detection(SD)methods.In this paper,we categorize time series segmentation methods into CPD,BD,and SD methods,with a specific focus on recent advances in BD and SD methods.Within the scope of BD and SD,we subdivide the methods based on their underlying models/techniques and focus on the milestones that have shaped the development trajectory of each category.As a conclusion,we found that:(1)Existing methods failed to provide sufficient support for online working,with only a few methods supporting online deployment;(2)Most existing methods require the specification of parameters,which hinders their ability to work adaptively;(3)Existing SD methods do not attach importance to accurate detection of boundary points in evaluation,which may lead to limitations in boundary point detection.We highlight the ability to working online and adaptively as important attributes of segmentation methods,the boundary detection accuracy as a neglected metrics for SD methods.展开更多
This paper aims to detect the short-term as well as long-term change point in the surface air temperature time series for Asansol weather observation station, West Bengal, India. Temperature data for the period from 1...This paper aims to detect the short-term as well as long-term change point in the surface air temperature time series for Asansol weather observation station, West Bengal, India. Temperature data for the period from 1941 to 2010 of the said weather observatory have been collected from Indian Meteorological Department, Kolkata. Variations and trends of annual mean temperature, annual mean maximum temperature and annual minimum temperature time series were examined. The cumulative sum charts (CUSUM) and bootstrapping were used for the detection of abrupt changes in the time series data set. Statistically significant abrupt changes and trends have been detected. The major change point in the annual mean temperatures occurred around 1986 (0.57°C) at the period of 25 years in the long-term regional scale. On the other side, the annual mean maximum and annual mean minimum temperatures have distinct change points at level 1. There are abrupt changes in the year 1961 (Confidence interval 1961, 1963) for the annual mean maximum and 1994 (Confidence interval 1993, 1996) for the annual mean minimum temperatures at a confidence level of 100% and 98%, respectively. Before the change, the annual mean maximum and annual mean minimum temperatures were 30.90°C and 23.99°C, respectively, while after the change, the temperatures became 33.93°C and 24.84°C, respectively. Over the entire period of consideration (1941-2010), 11 forward and backward changes were found in total. Out of 11, there are 3 changes (1961, 1986 and 2001) in annual mean temperatures, 4 changes (1957, 1961, 1980 and 1994) in annual mean maximum temperatures, and rest 4 changes (1968, 1981, 1994 and 2001) are associated with annual mean minimum temperature data set.展开更多
The detection of outliers and change points from time series has become research focus in the area of time series data mining since it can be used for fraud detection, rare event discovery, event/trend change detectio...The detection of outliers and change points from time series has become research focus in the area of time series data mining since it can be used for fraud detection, rare event discovery, event/trend change detection, etc. In most previous works, outlier detection and change point detection have not been related explicitly and the change point detections did not consider the influence of outliers, in this work, a unified detection framework was presented to deal with both of them. The framework is based on ALARCON-AQUINO and BARRIA's change points detection method and adopts two-stage detection to divide the outliers and change points. The advantages of it lie in that: firstly, unified structure for change detection and outlier detection further reduces the computational complexity and make the detective procedure simple; Secondly, the detection strategy of outlier detection before change point detection avoids the influence of outliers to the change point detection, and thus improves the accuracy of the change point detection. The simulation experiments of the proposed method for both model data and actual application data have been made and gotten 100% detection accuracy. The comparisons between traditional detection method and the proposed method further demonstrate that the unified detection structure is more accurate when the time series are contaminated by outliers.展开更多
Trend analysis and change point detection in a time series are frequent analysis tools.Change point detection is the identification of abrupt variation in the process behaviour due to natural or artificial changes,whe...Trend analysis and change point detection in a time series are frequent analysis tools.Change point detection is the identification of abrupt variation in the process behaviour due to natural or artificial changes,whereas trend can be defined as estimation of gradual departure from past norms.We analyze the time series data in the presence of trend,using Cox-Stuart methods together with the change point algorithms.We applied the methods to the nearsurface wind speed time series for Australia as an example.The trends in near-surface wind speeds for Australia have been investigated based upon our newly developed wind speed datasets,which were constructed by blending observational data collected at various heights using local surface roughness information.The trend in wind speed at 10 m is generally increasing while at 2 m it tends to be decreasing.Significance testing,change point analysis and manual inspection of records indicate several factors may be contributing to the discrepancy,such as systematic biases accompanying instrument changes,random data errors(e.g.accumulation day error)and data sampling issues.Homogenization technique and multiple-period trend analysis based upon change point detections have thus been employed to clarify the source of the inconsistencies in wind speed trends.展开更多
The aim of this study is to establish the prevailing conditions of changing climatic trends and change point dates in four selected meteorological stations of Uyo, Benin, Port Harcourt, and Warri in the Niger Delta re...The aim of this study is to establish the prevailing conditions of changing climatic trends and change point dates in four selected meteorological stations of Uyo, Benin, Port Harcourt, and Warri in the Niger Delta region of Nigeria. Using daily or 24-hourly annual maximum series (AMS) data with the Indian Meteorological Department (IMD) and the modified Chowdury Indian Meteorological Department (MCIMD) models were adopted to downscale the time series data. Mann-Kendall (MK) trend and Sen’s Slope Estimator (SSE) test showed a statistically significant trend for Uyo and Benin, while Port Harcourt and Warri showed mild trends. The Sen’s Slope magnitude and variation rate were 21.6, 10.8, 6.00 and 4.4 mm/decade, respectively. The trend change-point analysis showed the initial rainfall change-point dates as 2002, 2005, 1988, and 2000 for Uyo, Benin, Port Harcourt, and Warri, respectively. These prove positive changing climatic conditions for rainfall in the study area. Erosion and flood control facilities analysis and design in the Niger Delta will require the application of Non-stationary IDF modelling.展开更多
Traditional studies on potential yield mainly referred to attainable yield: the maximum yield which could be reached by a crop in a given environment. The new concept of crop yield under average climate conditions wa...Traditional studies on potential yield mainly referred to attainable yield: the maximum yield which could be reached by a crop in a given environment. The new concept of crop yield under average climate conditions was defined in this paper, which was affected by advancement of science and technology. Based on the new concept of crop yield, the time series techniques relying on past yield data was employed to set up a forecasting model. The model was tested by using average grain yields of Liaoning Province in China from 1949 to 2005. The testing combined dynamic n-choosing and micro tendency rectification, and an average forecasting error was 1.24%. In the trend line of yield change, and then a yield turning point might occur, in which case the inflexion model was used to solve the problem of yield turn point.展开更多
Patterned-based time series segmentation (PTSS) is an important task for many time series data mining applications. In this paper, according to the characteristics of PTSS, a generalized model is proposed for PTSS. Fi...Patterned-based time series segmentation (PTSS) is an important task for many time series data mining applications. In this paper, according to the characteristics of PTSS, a generalized model is proposed for PTSS. First, a new inter-pretation for PTSS is given by comparing this problem with the prototype-based clustering (PC). Then, a novel model, called clustering-inverse model (CI-model), is presented. Finally, two algorithms are presented to implement this model. Our experimental results on artificial and real-world time series demonstrate that the proposed algorithms are quite effective.展开更多
Electrostatic monitoring technology of particle charging information can facilitate online monitoring of aero-engine,which effectively enhances engine fault diagnosis and health managements.Unlike traditional engine s...Electrostatic monitoring technology of particle charging information can facilitate online monitoring of aero-engine,which effectively enhances engine fault diagnosis and health managements.Unlike traditional engine state monitoring technologies,aircraft engine monitoring by gas path electrostatic monitoring not only covers the predicted information source itself,but also detects the information that can provide an early warnings for initial fault states through gas path charging levels.This paper establishes a non-stationary time sequence change-point model for anomaly recognition of electrostatic signals based on change-point theory combined with difference method of non-stationary time series.Finally,electrostatic induction data were utilized by the engine life test for a particular aircraft to validate the proposed algorithm.The results indicate that the activity level and the event rate were0.5—0.8(nc)and 50%,respectively,which were far greater than 4—12(pc)and 0—4% under normal working conditions of the engine.展开更多
传统离线数据分析方法对于处理即时性高和流量大的数据存在缺陷,而在线检测模型可以满足数据流分析的实时性要求。文中提出了一种基于多阈值模板的在线检测方法。该方法结合多路搜索树突变点检测(Ternary Search Tree and Kolmogorov-Sm...传统离线数据分析方法对于处理即时性高和流量大的数据存在缺陷,而在线检测模型可以满足数据流分析的实时性要求。文中提出了一种基于多阈值模板的在线检测方法。该方法结合多路搜索树突变点检测(Ternary Search Tree and Kolmogorov-Smirnov,TSTKS)算法进行在线检测,基于突变点密度更新窗口长度从而提高了突变点检测精度。采用等量分级策略实现对时序数据的自学习、匹配和分类,进而对大规模病变数据进行状态检测和预测。仿真实验和病变数据的实验结果表明,所提方法具有效果高、分类准确等优点,为大规模时序数据进行快速分类研究提供了新方法。展开更多
针对现阶段用电设备状态监测技术存在的处理速度较慢、准确率较低等问题,文中基于多突变点检测和模板匹配策略提出了一种用电设备在线状态监测方法。该方法在缓冲区模型和滑动窗口模型的基础上,利用多路搜索树突变点检测(Ternary Search...针对现阶段用电设备状态监测技术存在的处理速度较慢、准确率较低等问题,文中基于多突变点检测和模板匹配策略提出了一种用电设备在线状态监测方法。该方法在缓冲区模型和滑动窗口模型的基础上,利用多路搜索树突变点检测(Ternary Search Tree and Kolmogorov-Smirnov,TSTKS)算法形成窗口维度和缓冲区维度的特征向量,通过两种维度的模板匹配实现用电设备的运行状态匹配和状态切换时刻定位。基于家用电冰箱的仿真实验结果表明,所提方法具有检测速度快、准确率高等优点,可为用电设备状态监测领域提供参考。展开更多
针对在大规模时序医疗数据的分析中现有检测方法检测精度低、检测速度慢等问题,文中提出了一种基于深度学习的时序病变数据段分类方法。该方法在TSTKS(Ternary Search Trees and modified Kolmogorov-Smirnov)算法和滑动窗口理论的基础...针对在大规模时序医疗数据的分析中现有检测方法检测精度低、检测速度慢等问题,文中提出了一种基于深度学习的时序病变数据段分类方法。该方法在TSTKS(Ternary Search Trees and modified Kolmogorov-Smirnov)算法和滑动窗口理论的基础上,利用深度学习技术实现了对病变数据段的快速准确分类。文中以利用该方法对病变数据段进行分类的结果作为依据,实现了滑动窗口大小的动态调整。通过对真实癫痫脑电信号(Electroencephalogram,EEG)进行分析,证明了所提病变数据段分类方法和基于该分类方法的滑动窗口动态调整机制具有检测速度快、精度较高等优点,可以为大规模时序数据的快速分析研究提供一种新选择。展开更多
基金This work is supported by the National Key Research and Development Program of China(2022YFF1203001)National Natural Science Foundation of China(Nos.62072465,62102425)the Science and Technology Innovation Program of Hunan Province(Nos.2022RC3061,2023RC3027).
文摘Time series segmentation has attracted more interests in recent years,which aims to segment time series into different segments,each reflects a state of the monitored objects.Although there have been many surveys on time series segmentation,most of them focus more on change point detection(CPD)methods and overlook the advances in boundary detection(BD)and state detection(SD)methods.In this paper,we categorize time series segmentation methods into CPD,BD,and SD methods,with a specific focus on recent advances in BD and SD methods.Within the scope of BD and SD,we subdivide the methods based on their underlying models/techniques and focus on the milestones that have shaped the development trajectory of each category.As a conclusion,we found that:(1)Existing methods failed to provide sufficient support for online working,with only a few methods supporting online deployment;(2)Most existing methods require the specification of parameters,which hinders their ability to work adaptively;(3)Existing SD methods do not attach importance to accurate detection of boundary points in evaluation,which may lead to limitations in boundary point detection.We highlight the ability to working online and adaptively as important attributes of segmentation methods,the boundary detection accuracy as a neglected metrics for SD methods.
文摘This paper aims to detect the short-term as well as long-term change point in the surface air temperature time series for Asansol weather observation station, West Bengal, India. Temperature data for the period from 1941 to 2010 of the said weather observatory have been collected from Indian Meteorological Department, Kolkata. Variations and trends of annual mean temperature, annual mean maximum temperature and annual minimum temperature time series were examined. The cumulative sum charts (CUSUM) and bootstrapping were used for the detection of abrupt changes in the time series data set. Statistically significant abrupt changes and trends have been detected. The major change point in the annual mean temperatures occurred around 1986 (0.57°C) at the period of 25 years in the long-term regional scale. On the other side, the annual mean maximum and annual mean minimum temperatures have distinct change points at level 1. There are abrupt changes in the year 1961 (Confidence interval 1961, 1963) for the annual mean maximum and 1994 (Confidence interval 1993, 1996) for the annual mean minimum temperatures at a confidence level of 100% and 98%, respectively. Before the change, the annual mean maximum and annual mean minimum temperatures were 30.90°C and 23.99°C, respectively, while after the change, the temperatures became 33.93°C and 24.84°C, respectively. Over the entire period of consideration (1941-2010), 11 forward and backward changes were found in total. Out of 11, there are 3 changes (1961, 1986 and 2001) in annual mean temperatures, 4 changes (1957, 1961, 1980 and 1994) in annual mean maximum temperatures, and rest 4 changes (1968, 1981, 1994 and 2001) are associated with annual mean minimum temperature data set.
基金Project(2011AA040603) supported by the National High Technology Ressarch & Development Program of ChinaProject(201202226) supported by the Natural Science Foundation of Liaoning Province, China
文摘The detection of outliers and change points from time series has become research focus in the area of time series data mining since it can be used for fraud detection, rare event discovery, event/trend change detection, etc. In most previous works, outlier detection and change point detection have not been related explicitly and the change point detections did not consider the influence of outliers, in this work, a unified detection framework was presented to deal with both of them. The framework is based on ALARCON-AQUINO and BARRIA's change points detection method and adopts two-stage detection to divide the outliers and change points. The advantages of it lie in that: firstly, unified structure for change detection and outlier detection further reduces the computational complexity and make the detective procedure simple; Secondly, the detection strategy of outlier detection before change point detection avoids the influence of outliers to the change point detection, and thus improves the accuracy of the change point detection. The simulation experiments of the proposed method for both model data and actual application data have been made and gotten 100% detection accuracy. The comparisons between traditional detection method and the proposed method further demonstrate that the unified detection structure is more accurate when the time series are contaminated by outliers.
文摘Trend analysis and change point detection in a time series are frequent analysis tools.Change point detection is the identification of abrupt variation in the process behaviour due to natural or artificial changes,whereas trend can be defined as estimation of gradual departure from past norms.We analyze the time series data in the presence of trend,using Cox-Stuart methods together with the change point algorithms.We applied the methods to the nearsurface wind speed time series for Australia as an example.The trends in near-surface wind speeds for Australia have been investigated based upon our newly developed wind speed datasets,which were constructed by blending observational data collected at various heights using local surface roughness information.The trend in wind speed at 10 m is generally increasing while at 2 m it tends to be decreasing.Significance testing,change point analysis and manual inspection of records indicate several factors may be contributing to the discrepancy,such as systematic biases accompanying instrument changes,random data errors(e.g.accumulation day error)and data sampling issues.Homogenization technique and multiple-period trend analysis based upon change point detections have thus been employed to clarify the source of the inconsistencies in wind speed trends.
文摘The aim of this study is to establish the prevailing conditions of changing climatic trends and change point dates in four selected meteorological stations of Uyo, Benin, Port Harcourt, and Warri in the Niger Delta region of Nigeria. Using daily or 24-hourly annual maximum series (AMS) data with the Indian Meteorological Department (IMD) and the modified Chowdury Indian Meteorological Department (MCIMD) models were adopted to downscale the time series data. Mann-Kendall (MK) trend and Sen’s Slope Estimator (SSE) test showed a statistically significant trend for Uyo and Benin, while Port Harcourt and Warri showed mild trends. The Sen’s Slope magnitude and variation rate were 21.6, 10.8, 6.00 and 4.4 mm/decade, respectively. The trend change-point analysis showed the initial rainfall change-point dates as 2002, 2005, 1988, and 2000 for Uyo, Benin, Port Harcourt, and Warri, respectively. These prove positive changing climatic conditions for rainfall in the study area. Erosion and flood control facilities analysis and design in the Niger Delta will require the application of Non-stationary IDF modelling.
基金Supported by Agricultural Poor-helping Monopoly of Graduate University of Chinese Academy of Science (40641002)
文摘Traditional studies on potential yield mainly referred to attainable yield: the maximum yield which could be reached by a crop in a given environment. The new concept of crop yield under average climate conditions was defined in this paper, which was affected by advancement of science and technology. Based on the new concept of crop yield, the time series techniques relying on past yield data was employed to set up a forecasting model. The model was tested by using average grain yields of Liaoning Province in China from 1949 to 2005. The testing combined dynamic n-choosing and micro tendency rectification, and an average forecasting error was 1.24%. In the trend line of yield change, and then a yield turning point might occur, in which case the inflexion model was used to solve the problem of yield turn point.
文摘Patterned-based time series segmentation (PTSS) is an important task for many time series data mining applications. In this paper, according to the characteristics of PTSS, a generalized model is proposed for PTSS. First, a new inter-pretation for PTSS is given by comparing this problem with the prototype-based clustering (PC). Then, a novel model, called clustering-inverse model (CI-model), is presented. Finally, two algorithms are presented to implement this model. Our experimental results on artificial and real-world time series demonstrate that the proposed algorithms are quite effective.
基金supported by the Initial Scientific Research Fund (No.2015QD02S)the Foundation Research Funds for the Central Universities (No.3122016A004, 3122017027)
文摘Electrostatic monitoring technology of particle charging information can facilitate online monitoring of aero-engine,which effectively enhances engine fault diagnosis and health managements.Unlike traditional engine state monitoring technologies,aircraft engine monitoring by gas path electrostatic monitoring not only covers the predicted information source itself,but also detects the information that can provide an early warnings for initial fault states through gas path charging levels.This paper establishes a non-stationary time sequence change-point model for anomaly recognition of electrostatic signals based on change-point theory combined with difference method of non-stationary time series.Finally,electrostatic induction data were utilized by the engine life test for a particular aircraft to validate the proposed algorithm.The results indicate that the activity level and the event rate were0.5—0.8(nc)and 50%,respectively,which were far greater than 4—12(pc)and 0—4% under normal working conditions of the engine.
文摘传统离线数据分析方法对于处理即时性高和流量大的数据存在缺陷,而在线检测模型可以满足数据流分析的实时性要求。文中提出了一种基于多阈值模板的在线检测方法。该方法结合多路搜索树突变点检测(Ternary Search Tree and Kolmogorov-Smirnov,TSTKS)算法进行在线检测,基于突变点密度更新窗口长度从而提高了突变点检测精度。采用等量分级策略实现对时序数据的自学习、匹配和分类,进而对大规模病变数据进行状态检测和预测。仿真实验和病变数据的实验结果表明,所提方法具有效果高、分类准确等优点,为大规模时序数据进行快速分类研究提供了新方法。
文摘针对现阶段用电设备状态监测技术存在的处理速度较慢、准确率较低等问题,文中基于多突变点检测和模板匹配策略提出了一种用电设备在线状态监测方法。该方法在缓冲区模型和滑动窗口模型的基础上,利用多路搜索树突变点检测(Ternary Search Tree and Kolmogorov-Smirnov,TSTKS)算法形成窗口维度和缓冲区维度的特征向量,通过两种维度的模板匹配实现用电设备的运行状态匹配和状态切换时刻定位。基于家用电冰箱的仿真实验结果表明,所提方法具有检测速度快、准确率高等优点,可为用电设备状态监测领域提供参考。
文摘针对在大规模时序医疗数据的分析中现有检测方法检测精度低、检测速度慢等问题,文中提出了一种基于深度学习的时序病变数据段分类方法。该方法在TSTKS(Ternary Search Trees and modified Kolmogorov-Smirnov)算法和滑动窗口理论的基础上,利用深度学习技术实现了对病变数据段的快速准确分类。文中以利用该方法对病变数据段进行分类的结果作为依据,实现了滑动窗口大小的动态调整。通过对真实癫痫脑电信号(Electroencephalogram,EEG)进行分析,证明了所提病变数据段分类方法和基于该分类方法的滑动窗口动态调整机制具有检测速度快、精度较高等优点,可以为大规模时序数据的快速分析研究提供一种新选择。