Event-Driven Non-Intrusive Load Monitoring Algorithm Based on Targeted Mining Multidimensional Load Characteristics

Nowadays,the advancement of nonintrusive load monitoring(NILM)has been hastened by the ever-increasing requirements for the reasonable use of electricity by users and demand side management.Although existing researches have tried their best to extract a wide variety of load features based on transient or steady state of electrical appliances,it is still very difficult for their algorithm to model the load decomposition problem of different electrical appliance types in a targeted manner to jointly mine their proposed features.This paper presents a very effective event-driven NILM solution,which aims to separately model different appliance types to mine the unique characteristics of appliances from multi-dimensional features,so that all electrical appliances can achieve the best classification performance.First,we convert the multi-classification problem into a serial multiple binary classification problem through a pre-sort model to simplify the original problem.Then,ConTrastive Loss K-Nearest Neighbour(CTLKNN)model with trainable weights is proposed to targeted mine appliance load characteristics.The simulation results show the effectiveness and stability of the proposed algorithm.Compared with existing algorithms,the proposed algorithm has improved the identification performance of all electrical appliance types.

A novel non-intrusive load monitoring technique using semi-supervised deep learning framework for smart grid

Non-intrusive load monitoring(NILM)is a technique which extracts individual appliance consumption and operation state change information from the aggregate power consumption made by a single residential or commercial unit.NILM plays a pivotal role in modernizing building energy management by disaggregating total energy consumption into individual appliance-level insights.This enables informed decision-making,energy optimization,and cost reduction.However,NILM encounters substantial challenges like signal noise,data availability,and data privacy concerns,necessitating advanced algorithms and robust methodologies to ensure accurate and secure energy disaggregation in real-world scenarios.Deep learning techniques have recently shown some promising results in NILM research,but training these neural networks requires significant labeled data.Obtaining initial sets of labeled data for the research by installing smart meters at the end of consumers’appliances is laborious and expensive and exposes users to severe privacy risks.It is also important to mention that most NILM research uses empirical observations instead of proper mathematical approaches to obtain the threshold value for determining appliance operation states(On/Off)from their respective energy consumption value.This paper proposes a novel semi-supervised multilabel deep learning technique based on temporal convolutional network(TCN)and long short-term memory(LSTM)for classifying appliance operation states from labeled and unlabeled data.The two thresholding techniques,namely Middle-Point Thresholding and Variance-Sensitive Thresholding,which are needed to derive the threshold values for determining appliance operation states,are also compared thoroughly.The superiority of the proposed model,along with finding the appliance states through the Middle-Point Thresholding method,is demonstrated through 15%improved overall improved F1micro score and almost 26%improved Hamming loss,F1 and Specificity score for the performance of individual appliance when compared to the benchmarking techniques that also used semi-supervised learning approach.

Non-intrusive Load Monitoring Based on Graph Total Variation for Residential Appliances

Non-intrusive load monitoring is a technique for monitoring the operating conditions of electrical appliances by collecting the aggregated electrical information at the household power inlet.Despite several studies on the mining of unique load characteristics,few studies have extensively considered the high computational burden and sample training.Based on lowfrequency sampling data,a non-intrusive load monitoring algorithm utilizing the graph total variation(GTV)is proposed in this study.The algorithm can effectively depict the load state without the need for prior training.First,the combined Kmeans clustering algorithm and graph signals are used to build concise and accurate graph structures as load models.The GTV representing the internal structure of the graph signal is introduced as the optimization model and solved using the augmented Lagrangian iterative algorithm.The introduction of the difference operator reduces the computing cost and addresses the inaccurate reconstruction of the graph signal.With low-frequency sampling data,the algorithm only requires a little prior data and no training,thereby reducing the computing cost.Experiments conducted using the reference energy disaggregation dataset and almanac of minutely power dataset demonstrated the stable superiority of the algorithm and its low computational burden.

Energy Disaggregation of Industrial Machinery Utilizing Artificial Neural Networks for Non-intrusive Load Monitoring

This paper explores the application of non-intrusive load monitoring techniques in the industrial sector for disaggregating the energy consumption of machinery in manufacturing processes. With an increasing focus on energy efficiency and decarbonization measures, achieving energy transparency in production becomes crucial. Utilizing non-intrusive load monitoring, energy data analysis and processing can provide valuable insights for informed decision-making on energy efficiency improvements and emission reductions. While non-intrusive load monitoring has been extensively researched in the building and residential sectors, the application in the industrial manufacturing domain needs to be further explored. This paper addresses this research gap by adapting established non-intrusive load monitoring techniques to an industrial dataset. By employing artificial neural networks for energy disaggregation, the determination of energy consumption of industrial machinery is made possible. Therefore, a generally applicable cross-energy carrier method to disaggregate the energy consumption of machinery in manufacturing processes is developed using a design science research approach and validated through a practical case study utilizing a compressed air demonstrator. The results show that the utilization of artificial neural networks is well-suited for energy disaggregation of industrial data, effectively identifying on and off states, multi-level states and continuously variable states. Non-intrusive load monitoring should be further considered in the research of emerging artificial intelligence technologies in energy consumption evaluation. It can be a viable alternative for intrusive load monitoring and is a prerequisite to installing energy meters for every machine.

A Review of NILM Applications with Machine Learning Approaches

In recent years,Non-Intrusive LoadMonitoring (NILM) has become an emerging approach that provides affordableenergy management solutions using aggregated load obtained from a single smart meter in the power grid.Furthermore, by integrating Machine Learning (ML), NILM can efficiently use electrical energy and offer less ofa burden for the energy monitoring process. However, conducted research works have limitations for real-timeimplementation due to the practical issues. This paper aims to identify the contribution of ML approaches todeveloping a reliable Energy Management (EM) solution with NILM. Firstly, phases of the NILM are discussed,along with the research works that have been conducted in the domain. Secondly, the contribution of machinelearning approaches in three aspects is discussed: Supervised learning, unsupervised learning, and hybridmodeling.It highlights the limitations in the applicability of ML approaches in the field. Then, the challenges in the realtimeimplementation are concerned with six use cases: Difficulty in recognizing multiple loads at a given time,cost of running the NILM system, lack of universal framework for appliance detection, anomaly detection andnew appliance identification, and complexity of the electricity loads and real-time demand side management.Furthermore, options for selecting an approach for an efficientNILMframework are suggested. Finally, suggestionsare provided for future research directions.

Methodology for the disaggregation and forecast of demand flexibility in large consumers with the application of non-intrusive load monitoring techniques

Technological advances,innovation and the new industry 4.0 paradigm guide Distribution System Operators towards a competitive market that requires the articulation of flexible demand response systems.The lack of measurement and standardization systems in the industry process chain in developing countries prevents the penetration of demand management models,generating inefficiency in the analysis and processing of informa-tion to validate the flexibility potential that large consumers can contribute to the network operator.In this sense,the research uses as input variables the energy and power of the load profile provided by the utility energy meter to obtain the disaggregated forecast in quarter-hour intervals in 4-time windows validated through metrics and its results evaluated by the RMS error to get the total error generated by the methodology with the appli-cation of Machine Learning and Big Data techniques in the Python computational tool through Combinatorial Disaggregation Optimization and Factorial Hidden Markov models.

Comparative Evaluation of Machine Learning Models and Input Feature Space for Non-intrusive Load Monitoring

Recent advancement in computational capabilities has accelerated the research and development of non-intrusive load disaggregation.Non-intrusive load monitoring(NILM)offers many promising applications in the context of energy efficiency and conservation.Load classification is a key component of NILM that relies on different artificial intelligence techniques,e.g.,machine learning.This study employs different machine learning models for load classification and presents a comprehensive performance evaluation of the employed models along with their comparative analysis.Moreover,this study also analyzes the role of input feature space dimensionality in the context of classification performance.For the above purposes,an event-based NILM methodology is presented and comprehensive digital simulation studies are carried out on a low sampling real-world electricity load acquired from four different households.Based on the presented analysis,it is concluded that the presented methodology yields promising results and the employed machine learning models generalize well for the invisible diverse testing data.The multi-layer perceptron learning model based on the neural network approach emerges as the most promising classifier.Furthermore,it is also noted that it significantly facilitates the classification performance by reducing the input feature space dimensionality.

Unsupervised Learning for Non-intrusive Load Monitoring in Smart Grid Based on Spiking Deep Neural Network

This paper investigates the intelligent load monitoring problem with applications to practical energy management scenarios in smart grids.As one of the critical components for paving the way to smart grids’success,an intelligent and feasible non-intrusive load monitoring(NILM)algorithm is urgently needed.However,most recent researches on NILM have not dealt with practical problems when applied to power grid,i.e.,①limited communication for slow-change systems;②requirement of low-cost hardware at the users’side;and③inconvenience to adapt to new households.Therefore,a novel NILM algorithm based on biology-inspired spiking neural network(SNN)has been developed to overcome the existing challenges.To provide intelligence in NILM,the developed SNN features an unsupervised learning rule,i.e.,spike-time dependent plasticity(STDP),which only requires the user to label one instance for each appliance while adapting to a new household.To upgrade the feasibility in NILM,the designed spiking neurons mimic the mechanism of human brain neurons that can be constructed by a resistor-capacitor(RC)circuit.In addition,a distributed computing system has been designed that divides the SNN into two parts,i.e.,smart outlets and local servers.Since the information flows as sparse binary vectors among spiking neurons in the developed SNN-based NILM,the high-frequency data can be easily compressed as the spike times,and are sent to the local server with limited communication capability,whereas it is unable to handle the traditional NILM.Finally,a series of experiments are conducted using a benchmark public dataset.Meanwhile,the effectiveness of developed SNN-based NILM can be demonstrated through comparisons with other emerging NILM algorithms such as the convolutional neural networks.

A systematic approach to ON-OFF event detection and clustering analysis of non-intrusive appliance load monitoring

The aim of non-intrusive appliance load monitoring （NIALM） is to disaggregate the energy consumption of individual electrical appliances from total power consumption utilizing non-intrusive methods. In this paper, a systematic approach to 0N-0FF event detection and clustering analysis for NIALM were presented. From the aggregate power consumption data set, the data are passed through median filtering to reduce noise and prepared for the event detection algorithm. The event detection algorithm is to determine the switching of ON and OFF status of electrical appliances. The goodness- of-fit （GOF） methodology is the event detection algorithm implemented. After event detection, the events detected were paired into ON-0FF pairing appliances. The results from the ON-OFF pairing algorithm were further clustered in groups utilizing the K-means clustering analysis. The K- means clustering were implemented as an unsupervised learning methodology for the clustering analysis. The novelty of this paper is the determination of the time duration an electrical appliance is turned ON through combination of event detection, ON-OFF pairing and K- means clustering. The results of the algorithm implemen- tation were discussed and ideas on future work were also proposed.

Analysis of Dynamic Appliance Flexibility Considering User Behavior via Non-intrusive Load Monitoring and Deep User Modeling

The research on non-intrusive load monitoring(NILM)and the growing deployment of home energy manage-ment system(HEMS)have made it possible for households to have a detailed understanding of their power usage and to make appliances participate in demand response(DR)programs.Appliance flexibility analysis helps the HEMS dispatching appli-ances to participate in DR programs without violating user’s comfort level.In this paper,a dynamic appliance flexibility analysis approach using the smart meter data is presented.In the training phase,the smart meter data is preprocessed by NILM to obtain user’s appliances usage behaviors,which is used to train the user model.During operation,the NILM is used to infer recent appliances usage behaviors,and then the user model predicts user’s appliances usage behaviors in the DR period considering long-term behaviors dependences,correlations between appliances and temporal information.The flexibility of each appliance is calculated based on the appliance characteristics as well as the predicted user’s appliances usage behaviors caused by the control of the appliance.The HEMS can choose the appliance with high flexibility to participate in the DR programs.The case study demonstrates the performance of the user model and illustrates how the appliance flexibility analysis is performed using a real-world case.

Non-invasive load-shed authentication model for demand response applications assisted by event-based non-intrusive load monitoring

With today’s growth of prosumers and renewable energy resources,it is inevitable to incorporate the demand-side approaches for reliable and sustainable grid operation.In this context,demand response is a promising technique facilitating the consumers to play a substantial role in the energy market by altering their energy consumption patterns in times of peak demand or other critical contingencies.However,effective demand response deployment faces numerous challenges including trust deficit among the concerned stakeholders.This paper addresses the mentioned issue by proposing a non-invasive load-shed authentication model for demand response applications,assisted by an improved event-based non-intrusive load monitoring approach.For the said purposes,an improved event detection algorithm and machine learning model:support vector machine with a combination of genetic algorithm and GridSearchCV,is presented.This paper also presents a comprehensive real-world case study to validate the effectiveness of the proposed model in a real-life scenario.In the given context,all the simulations are carried out on low sampling real-world load measurements:Pecan Street-Dataport,where electric vehicle and air conditioning are employed as potential load elements for evaluation purposes.Based on the presented case study and analysis of the results,it is established that the presented improved event-based non-intrusive load monitoring approach yields promising performance in the context of multi-class classification.Moreover,it is also concluded that the proposed low sampling event-based non-intrusive load monitoring assisted non-invasive load-shed authentication model is a viable and promising solution for the effective implementation of demand response applications.

基于NILM技术的家庭用户精确负荷建模方法

结合非侵入负荷监测NILM系统的负荷辨识流程,本文提出了一种基于NILM技术的家庭用户精确负荷建模方法。该方法应用NILM技术提取家庭主要设备负荷特性。然后通过模糊C聚类法实现家庭负荷模型归类,获得设备针对不同电价的转移灵敏度和自灵敏度用电特性,并在此基础上形成家庭负荷特性。通过电网公司分时电价环境下实测的家庭典型用电负荷数据验证可知,空调、洗衣机、热水器、电动汽车具有较大的弹性,其中洗衣机的自弹性和交叉弹性最大,在高电价时段可削减100%。该方法所获得的家庭负荷辨识的结果,可支持居民电价/激励等需求侧管理政策的制定,也可支持用户家庭用电设备状态监测服务等。

嵌入式NILM电力负荷识别及特征库构建系统设计

针对非侵入式电力负荷识别系统负荷特征库构建困难,算法复杂,硬件成本高的问题,构建了基于STM32嵌入式处理的电力负荷采集识别系统。介绍了系统硬件结构。分析了基于嵌入式处理器的电力数据通信方式。设计了低复杂度的快速滤波算法和基于最小二乘的负荷状态监测、识别算法。基于本系统,对常见家用电力负荷实际工作状态进行了实测。测试数据分析表明本系统的综合识别率符合要求,且算法更加适用于嵌入式硬件结构。系统硬件成本低,有利于推广应用。

基于金字塔网络的非侵入式负荷辨识及其隐私保护方案

智能电网融合了信息系统,能够为能源供应提供更有效的解决方案。智能电表是智能电网的关键部分,对智能电表数据的深入研究有助于为智能电网的管理和决策提供有效支持。非侵入式负荷辨识(NILM)技术为需求侧管理提供了技术支撑,但现有方式需要用户和NILM服务端进行数据交互,在这个过程中泄露了隐私信息。针对上述问题,设计了基于2D-卷积神经网络(2D-CNN)金字塔网络的NILM,并采用同态加密和安全多方计算技术进行隐私保护,针对金字塔网络的卷积、全连接、批标准化、平均池化、Re LU和上采样等算子设计隐私保护协议,组合隐私保护算子构建隐私保护的2D-CNN金字塔网络。整个过程没有还原数据和中间结果的原始信息,从而保护了双方隐私。在UK-DALE数据集上的实验结果表明,基于2D-CNN的金字塔网络能够表现出良好的效果,准确率达到95.81%,并且隐私保护的2D-CNN金字塔网络能够在保护客户端数据和服务端模型参数隐私性的情况下保持2D-CNN金字塔网络的推理效果,精确率、召回率和准确率等保持一致。同时,隐私保护的2DCNN金字塔网络在广域网中计算时间不到5 s,在局域网中不到0.5 s,并且通信量仅需4.79 MB,能够适用于NILM任务的现实场景。

基于先验统计模型的非侵入负荷辨识算法

针对传统非侵入负荷辨识技术中电热细分能力不足的问题,文中提出了一种基于先验知识与统计学习模型的居民非侵入式负荷辨识算法。文中对洗衣机辅热、电水壶、电饭锅、电热水器等设备进行了电热细分研究,通过设备运行关联算法实现了辅热设备的细分,并在用户有限反馈信息和专家标注的基础上,实现了非辅热设备分类的模型训练。实验结果表明,文中所提技术框架在事件检测负荷辨识算法的基础上实现了电热设备的细分,且在运行状态分解的F1分数指标中取得了0.9以上的优异效果。

基于物联网的非侵入式负荷状态监控系统设计

针对电子工艺实验室因设备多、类型多而带来的管理困难和安全隐患问题,利用物联网技术研发一种非侵入式负荷状态监控系统.该系统包含监测节点和服务器两部分,前者用于负荷状态识别,后者负责统计与控制.为准确识别节点上的设备状态,在监测节点端设计非侵入式负荷状态监测算法,其包括多状态负荷分离、状态特征提取和负荷识别等过程.真实场景的实验结果表明,研发的系统可以准确地监控电子工艺实验室的设备.

基于频谱图与时序成像的非侵入式负荷监测方法

针对在多种电器设备同时运行的场景下,当前非侵入式负荷监测方法存在分解困难的问题,本文提出了基于频谱图与时序成像的非侵入式负荷监测方法。首先进行负荷分解,利用频谱图变换原理将多种电器设备的聚合电流转换成频谱图矩阵,并通过词嵌入将频谱图矩阵变换到高维;然后通过k-均值聚类算法得到单个电器设备的频谱图矩阵并反变换为相应的时序电流;其次,进行负荷分类,将负荷分解得到的各类电器设备的时序电流转换为图像进行分类,分类模型为训练完成的深度神经网络模型。最后,利用公开数据集进行实验,结果表明所提方法具有较好的分解和分类效果。

Machine Learning: An Overview

Machine learning is an Artificial Intelligence (or AI) application, an idea that came into being by giving machines access to data and letting them learn by themselves. AI has been making headlines, especially since ChatGPT was introduced. Malaysia has taken many significant steps to embrace and integrate the technology into various sectors. These include encouraging large companies to build AI infrastructure, creating AI training opportunities (for example, the local media reported Microsoft and Google plan to invest USD 2.2 billion and USD 2 billion, respectively, in the said activities), and, as part of AI Talent Roadmap 2024-2030, establishing AI faculty in one of its public universities (i.e., “Universiti Teknologi Malaysia”) leading the way in the integration and teaching of AI throughout the country. This article introduces several products developed by the author (for the energy and transportation industries) and recommends their improvement by incorporating Machine learning.

基于NILM数据的电力用户能效量化分析方法

随着节能减排理念的普及,通过大数据技术分析用户用电情况,引导用户改善用电习惯、提高用电效率、降低用电成本已成为趋势。本文通过分析影响电力用户能效的因素,结合非侵入式负荷监测NILM(non-intru⁃sive load monitoring)技术可获得的数据,构建了易于获取和量化的家庭能效评估指标体系。在上述基础上提出了基于NILM数据的家庭电力用户能效量化分析方法,给出了能效量化分析和综合评估的具体流程,并提供了可构建的电力用户能效分析系统架构。最后,通过一些案例分析,验证了所提能效评估方法的有效性。

基于电器粗糙归类的无监督NILM结果自主标注

无监督非侵入式负荷监测(non-intrusiveload monitoring,NILM)方法通常无法自动确定分解结果所对应的电器名称,这影响NILM结果的用户可读性,阻碍了其规模应用。为此,该文提出一种基于电器粗糙归类的无监督NILM结果自主标注方法。从电器运行控制方式和使用时间分布2个方面,总结分析同类电器共同具有的通用运行特性。定义周期运行、密集波动、固定时长运行3种控制规律特性,给出基于聚类分析的电器相应特性自适应判别方法;对于受人类活动影响程度不同的不同电器,提出基于电器使用与人类活动强弱的时间分布之间相关性的电器使用规律特性判别方法,同时给出一种基于负荷成分变化的用户个性化人类活动强弱时段划分方法。在此基础上,基于粗糙集理论,依据上述2类通用运行特性进行电器粗糙归类,进而提出融合通用运行特性的电器名称两层决策方法,实现NILM结果标注。在私有和公开数据集中的实验表明,该方法能在不同场景下实现常见家用电器NILM结果准确标注。所提方法可作为任意无监督NILM方法的后续步骤与之集成,形成完全无监督NILM方案。