Missing value is one of the main factors that cause dirty data.Without high-quality data,there will be no reliable analysis results and precise decision-making.Therefore,the data warehouse needs to integrate high-qual...Missing value is one of the main factors that cause dirty data.Without high-quality data,there will be no reliable analysis results and precise decision-making.Therefore,the data warehouse needs to integrate high-quality data consistently.In the power system,the electricity consumption data of some large users cannot be normally collected resulting in missing data,which affects the calculation of power supply and eventually leads to a large error in the daily power line loss rate.For the problem of missing electricity consumption data,this study proposes a group method of data handling(GMDH)based data interpolation method in distribution power networks and applies it in the analysis of actually collected electricity data.First,the dependent and independent variables are defined from the original data,and the upper and lower limits of missing values are determined according to prior knowledge or existing data information.All missing data are randomly interpolated within the upper and lower limits.Then,the GMDH network is established to obtain the optimal complexity model,which is used to predict the missing data to replace the last imputed electricity consumption data.At last,this process is implemented iteratively until the missing values do not change.Under a relatively small noise level(α=0.25),the proposed approach achieves a maximum error of no more than 0.605%.Experimental findings demonstrate the efficacy and feasibility of the proposed approach,which realizes the transformation from incomplete data to complete data.Also,this proposed data interpolation approach provides a strong basis for the electricity theft diagnosis and metering fault analysis of electricity enterprises.展开更多
As the development of smart grid and energy internet, this leads to a significantincrease in the amount of data transmitted in real time. Due to the mismatch withcommunication networks that were not designed to carry ...As the development of smart grid and energy internet, this leads to a significantincrease in the amount of data transmitted in real time. Due to the mismatch withcommunication networks that were not designed to carry high-speed and real time data,data losses and data quality degradation may happen constantly. For this problem,according to the strong spatial and temporal correlation of electricity data which isgenerated by human’s actions and feelings, we build a low-rank electricity data matrixwhere the row is time and the column is user. Inspired by matrix decomposition, we dividethe low-rank electricity data matrix into the multiply of two small matrices and use theknown data to approximate the low-rank electricity data matrix and recover the missedelectrical data. Based on the real electricity data, we analyze the low-rankness of theelectricity data matrix and perform the Matrix Decomposition-based method on the realdata. The experimental results verify the efficiency and efficiency of the proposed scheme.展开更多
It is very important for the development of electric power big data technology to use the electric power knowledge.A new electric power knowledge theory model is proposed here to solve the problem of normalized modele...It is very important for the development of electric power big data technology to use the electric power knowledge.A new electric power knowledge theory model is proposed here to solve the problem of normalized modeled electric power knowledge for the management and analysis of electric power big data.Current modeling techniques of electric power knowledge are viewed as inadequate because of the complexity and variety of the relationships among electric power system data.Ontology theory and semantic web technologies used in electric power systems and in many other industry domains provide a new kind of knowledge modeling method.Based on this,this paper proposes the structure,elements,basic calculations and multidimensional reasoning method of the new knowledge model.A modeling example of the regulations defined in electric power system operation standard is demonstrated.Different forms of the model and related technologies are also introduced,including electric power system standard modeling,multi-type data management,unstructured data searching,knowledge display and data analysis based on semantic expansion and reduction.Research shows that the new model developed here is powerful and can adapt to various knowledge expression requirements of electric power big data.With the development of electric power big data technology,it is expected that the knowledge model will be improved and will be used in more applications.展开更多
Blasting is one of the most important operations in the mining projects that has effective role in the whole operation physically and economically. Unsuitable blasting pattern may lead to unwanted events such as poor ...Blasting is one of the most important operations in the mining projects that has effective role in the whole operation physically and economically. Unsuitable blasting pattern may lead to unwanted events such as poor fragmentation, back break and fly rock. Multi attribute decision making(MADM) can be useful method for selecting the most appropriate blasting pattern among previously performed patterns. In this work, initially, from various already performed patterns, efficient and inefficient patterns are determined using data envelopment analysis(DEA). In the second step, after weighting impressive attributes using experts' opinion, elimination Et choice translating reality(ELECTRE) was used for ranking the efficient patterns and recognizing the most appropriate pattern in the Sungun Copper Mine, Iran. According to the obtained results, blasting pattern with the hole diameter of 15.24 cm, burden of 3 m, spacing of 4 m and stemming of 3.2 m has selected as the best pattern and has selected for future operation.展开更多
In a home energy management system(HEMS),appliances are becoming diversified and intelligent,so that certain simple maintenance work can be completed by appliances themselves.During the measurement,collection and tran...In a home energy management system(HEMS),appliances are becoming diversified and intelligent,so that certain simple maintenance work can be completed by appliances themselves.During the measurement,collection and transmission of electricity load data in a HEMS sensor network,however,problems can be caused on the data due to faulty sensing processes and/or lost links,etc.In order to ensure the quality of retrieved load data,different solutions have been presented,but suffered from low recognition rates and high complexity.In this paper,a validation and repair method is presented to detect potential failures and errors in a domestic energy management system,which can then recover determined load errors and losses.A Kernel Extreme Learning Machine(K-ELM)based model has been employed with a Radial Basis Function(RBF)and optimised parameters for verification and recognition;whilst a Dual-spline method is presented to repair missing load data.According to the experiment results,the method outperforms the traditional B-spline and Cubic-spline methods and can effectively deal with unexpected data losses and errors under variant loss rates in a practical home environment.展开更多
基金This research was funded by the National Nature Sciences Foundation of China(Grant No.42250410321).
文摘Missing value is one of the main factors that cause dirty data.Without high-quality data,there will be no reliable analysis results and precise decision-making.Therefore,the data warehouse needs to integrate high-quality data consistently.In the power system,the electricity consumption data of some large users cannot be normally collected resulting in missing data,which affects the calculation of power supply and eventually leads to a large error in the daily power line loss rate.For the problem of missing electricity consumption data,this study proposes a group method of data handling(GMDH)based data interpolation method in distribution power networks and applies it in the analysis of actually collected electricity data.First,the dependent and independent variables are defined from the original data,and the upper and lower limits of missing values are determined according to prior knowledge or existing data information.All missing data are randomly interpolated within the upper and lower limits.Then,the GMDH network is established to obtain the optimal complexity model,which is used to predict the missing data to replace the last imputed electricity consumption data.At last,this process is implemented iteratively until the missing values do not change.Under a relatively small noise level(α=0.25),the proposed approach achieves a maximum error of no more than 0.605%.Experimental findings demonstrate the efficacy and feasibility of the proposed approach,which realizes the transformation from incomplete data to complete data.Also,this proposed data interpolation approach provides a strong basis for the electricity theft diagnosis and metering fault analysis of electricity enterprises.
文摘As the development of smart grid and energy internet, this leads to a significantincrease in the amount of data transmitted in real time. Due to the mismatch withcommunication networks that were not designed to carry high-speed and real time data,data losses and data quality degradation may happen constantly. For this problem,according to the strong spatial and temporal correlation of electricity data which isgenerated by human’s actions and feelings, we build a low-rank electricity data matrixwhere the row is time and the column is user. Inspired by matrix decomposition, we dividethe low-rank electricity data matrix into the multiply of two small matrices and use theknown data to approximate the low-rank electricity data matrix and recover the missedelectrical data. Based on the real electricity data, we analyze the low-rankness of theelectricity data matrix and perform the Matrix Decomposition-based method on the realdata. The experimental results verify the efficiency and efficiency of the proposed scheme.
基金supported by Science and Technology Foundation of the State Grid Corporation of China(XT71-14-043).
文摘It is very important for the development of electric power big data technology to use the electric power knowledge.A new electric power knowledge theory model is proposed here to solve the problem of normalized modeled electric power knowledge for the management and analysis of electric power big data.Current modeling techniques of electric power knowledge are viewed as inadequate because of the complexity and variety of the relationships among electric power system data.Ontology theory and semantic web technologies used in electric power systems and in many other industry domains provide a new kind of knowledge modeling method.Based on this,this paper proposes the structure,elements,basic calculations and multidimensional reasoning method of the new knowledge model.A modeling example of the regulations defined in electric power system operation standard is demonstrated.Different forms of the model and related technologies are also introduced,including electric power system standard modeling,multi-type data management,unstructured data searching,knowledge display and data analysis based on semantic expansion and reduction.Research shows that the new model developed here is powerful and can adapt to various knowledge expression requirements of electric power big data.With the development of electric power big data technology,it is expected that the knowledge model will be improved and will be used in more applications.
文摘Blasting is one of the most important operations in the mining projects that has effective role in the whole operation physically and economically. Unsuitable blasting pattern may lead to unwanted events such as poor fragmentation, back break and fly rock. Multi attribute decision making(MADM) can be useful method for selecting the most appropriate blasting pattern among previously performed patterns. In this work, initially, from various already performed patterns, efficient and inefficient patterns are determined using data envelopment analysis(DEA). In the second step, after weighting impressive attributes using experts' opinion, elimination Et choice translating reality(ELECTRE) was used for ranking the efficient patterns and recognizing the most appropriate pattern in the Sungun Copper Mine, Iran. According to the obtained results, blasting pattern with the hole diameter of 15.24 cm, burden of 3 m, spacing of 4 m and stemming of 3.2 m has selected as the best pattern and has selected for future operation.
文摘In a home energy management system(HEMS),appliances are becoming diversified and intelligent,so that certain simple maintenance work can be completed by appliances themselves.During the measurement,collection and transmission of electricity load data in a HEMS sensor network,however,problems can be caused on the data due to faulty sensing processes and/or lost links,etc.In order to ensure the quality of retrieved load data,different solutions have been presented,but suffered from low recognition rates and high complexity.In this paper,a validation and repair method is presented to detect potential failures and errors in a domestic energy management system,which can then recover determined load errors and losses.A Kernel Extreme Learning Machine(K-ELM)based model has been employed with a Radial Basis Function(RBF)and optimised parameters for verification and recognition;whilst a Dual-spline method is presented to repair missing load data.According to the experiment results,the method outperforms the traditional B-spline and Cubic-spline methods and can effectively deal with unexpected data losses and errors under variant loss rates in a practical home environment.