Withthe rapiddevelopment of deep learning,the size of data sets anddeepneuralnetworks(DNNs)models are also booming.As a result,the intolerable long time for models’training or inference with conventional strategies c...Withthe rapiddevelopment of deep learning,the size of data sets anddeepneuralnetworks(DNNs)models are also booming.As a result,the intolerable long time for models’training or inference with conventional strategies can not meet the satisfaction of modern tasks gradually.Moreover,devices stay idle in the scenario of edge computing(EC),which presents a waste of resources since they can share the pressure of the busy devices but they do not.To address the problem,the strategy leveraging distributed processing has been applied to load computation tasks from a single processor to a group of devices,which results in the acceleration of training or inference of DNN models and promotes the high utilization of devices in edge computing.Compared with existing papers,this paper presents an enlightening and novel review of applying distributed processing with data and model parallelism to improve deep learning tasks in edge computing.Considering the practicalities,commonly used lightweight models in a distributed system are introduced as well.As the key technique,the parallel strategy will be described in detail.Then some typical applications of distributed processing will be analyzed.Finally,the challenges of distributed processing with edge computing will be described.展开更多
Ensuring stability and reliability in power systems requires accurate state estimation, which is challenging due to the growing network size, noisy measurements, and nonlinear power-flow equations. In this paper, we i...Ensuring stability and reliability in power systems requires accurate state estimation, which is challenging due to the growing network size, noisy measurements, and nonlinear power-flow equations. In this paper, we introduce the Graph Attention Estimation Network (GAEN) model to tackle power system state estimation (PSSE) by capitalizing on the inherent graph structure of power grids. This approach facilitates efficient information exchange among interconnected buses, yielding a distributed, computationally efficient architecture that is also resilient to cyber-attacks. We develop a thorough approach by utilizing Graph Convolutional Neural Networks (GCNNs) and attention mechanism in PSSE based on Supervisory Control and Data Acquisition (SCADA) and Phasor Measurement Unit (PMU) measurements, addressing the limitations of previous learning architectures. In accordance with the empirical results obtained from the experiments, the proposed method demonstrates superior performance and scalability compared to existing techniques. Furthermore, the amalgamation of local topological configurations with nodal-level data yields a heightened efficacy in the domain of state estimation. This work marks a significant achievement in the design of advanced learning architectures in PSSE, contributing and fostering the development of more reliable and secure power system operations.展开更多
The current DSA system used in the dispatching control centers in China is a near real-time analysis system with response speed in the order of minutes.Based on a review of the state-of-the-art in online analysis and ...The current DSA system used in the dispatching control centers in China is a near real-time analysis system with response speed in the order of minutes.Based on a review of the state-of-the-art in online analysis and discussion of distributed data processing and computation architecture patterns,a new online analysis architecture is proposed.The primary goal of the new architecture is to increase the online analysis response speed to the order of seconds.A reference implementation of the proposed online analysis architecture to validate the feasibility of implementing the architecture and some performance testing results are presented.展开更多
The sequential method is easy to integrate with existing large-scale alternating current(AC)power flow solvers and is therefore a common approach for solving the power flow of AC/direct current(DC)hybrid systems.In th...The sequential method is easy to integrate with existing large-scale alternating current(AC)power flow solvers and is therefore a common approach for solving the power flow of AC/direct current(DC)hybrid systems.In this paper,a highperformance graph computing based distributed parallel implementation of the sequential method with an improved initial estimate approach for hybrid AC/DC systems is developed.The proposed approach is capable of speeding up the entire computation process without compromising the accuracy of result.First,the AC/DC network is intuitively represented by a graph and stored in a graph database(GDB)to expedite data processing.Considering the interconnection of AC grids via high-voltage direct current(HVDC)links,the network is subsequently partitioned into independent areas which are naturally fit for distributed power flow analysis.For each area,the fast-decoupled power flow(FDPF)is employed with node-based parallel computing(NPC)and hierarchical parallel computing(HPC)to quickly identify system states.Furthermore,to reduce the alternate iterations in the sequential method,a new decoupled approach is utilized to achieve a good initial estimate for the Newton-Raphson method.With the improved initial estimate,the sequential method can converge in fewer iterations.Consequently,the proposed approach allows for significant reduction in computing time and is able to meet the requirement of the real-time analysis platform for power system.The performance is verified on standard IEEE 300-bus system,extended large-scale systems,and a practical 11119-bus system in China.展开更多
Digital Earth has been a hot topic and research trend since it was proposed,and Digital China has drawn much attention in China.As a key technique to implement Digital China,grid is an excellent and promising concept ...Digital Earth has been a hot topic and research trend since it was proposed,and Digital China has drawn much attention in China.As a key technique to implement Digital China,grid is an excellent and promising concept to construct a dynamic,inter-domain and distributed computing environment.It is appropriate to process geographic information across dispersed computing resources in networks effectively and cooperatively.A distributed spatial computing prototype system is designed and implemented with the Globus Toolkit.Several important aspects are discussed in detail.The architecture is proposed according to the characteristics of grid firstly,and then the spatial resource query and access interfaces are designed for heterogeneous data sources.An open-up hierarchical architecture for resource discovery and management is represented to detect spatial and computing resources in grid.A standard spatial job management mechanism is implemented by grid service for convenient use.In addition,the control mechanism of spatial datasets access is developed based on GSI.The prototype system utilizes the Globus Toolkit to implement a common distributed spatial computing framework,and it reveals the spatial computing ability of grid to support Digital China.展开更多
Approaches to apply graph computing to power grid analysis are systematically explained using real-world application examples.Through exploring the nature of the power grid and the characteristics of power grid analys...Approaches to apply graph computing to power grid analysis are systematically explained using real-world application examples.Through exploring the nature of the power grid and the characteristics of power grid analysis,the guidelines for selecting appropriate graph computing techniques for the application to power grid analysis are outlined.A custom graph model for representing the power grid for the analysis and simulation purpose and an in-memory computing(IMC)based graph-centric approach with a shared-everything architecture are introduced.Graph algorithms,including network topology processing and subgraph processing,and graph computing application scenarios,including in-memory computing,contingency analysis,and Common Information Model(CIM)model merge,are presented.展开更多
The cycle structure in a power grid may lower the stability of the network;thus,it is of great significance to accu-rately and timely detect cycles in power grid networks.However,detecting possible cycles in a large-s...The cycle structure in a power grid may lower the stability of the network;thus,it is of great significance to accu-rately and timely detect cycles in power grid networks.However,detecting possible cycles in a large-scale network can be highly time consuming and computationally intensive.In addition,since the power grid's topology changes over time,cycles can appear and disappear,and it can be difficult to monitor them in real time.In traditional computing systems,cycle detection requires considerable computational resources,making real-time cycle detection in large-scale power grids an impossible task.Graph computing has shown excellent performance in many areas and has solved many practical graph-related problems,such as power flow calculation and state estimation.In this article,a cycle detection method,the Paton method,is implemented and optimized on a graph computing platform.Two cases are used to test its performance in an actual power grid topology scenario.The results show that the graph computing-based Paton method reduces the time consumption by at least 60%compared to that of other methods.展开更多
基金supported by the Natural Science Foundation of Jiangsu Province of China under Grant No.BK20211284the Financial and Science Technology Plan Project of Xinjiang Production,Construction Corps under Grant No.2020DB005the National Natural Science Foundation of China under Grant Nos.61872219,62002276 and 62177014。
文摘Withthe rapiddevelopment of deep learning,the size of data sets anddeepneuralnetworks(DNNs)models are also booming.As a result,the intolerable long time for models’training or inference with conventional strategies can not meet the satisfaction of modern tasks gradually.Moreover,devices stay idle in the scenario of edge computing(EC),which presents a waste of resources since they can share the pressure of the busy devices but they do not.To address the problem,the strategy leveraging distributed processing has been applied to load computation tasks from a single processor to a group of devices,which results in the acceleration of training or inference of DNN models and promotes the high utilization of devices in edge computing.Compared with existing papers,this paper presents an enlightening and novel review of applying distributed processing with data and model parallelism to improve deep learning tasks in edge computing.Considering the practicalities,commonly used lightweight models in a distributed system are introduced as well.As the key technique,the parallel strategy will be described in detail.Then some typical applications of distributed processing will be analyzed.Finally,the challenges of distributed processing with edge computing will be described.
文摘Ensuring stability and reliability in power systems requires accurate state estimation, which is challenging due to the growing network size, noisy measurements, and nonlinear power-flow equations. In this paper, we introduce the Graph Attention Estimation Network (GAEN) model to tackle power system state estimation (PSSE) by capitalizing on the inherent graph structure of power grids. This approach facilitates efficient information exchange among interconnected buses, yielding a distributed, computationally efficient architecture that is also resilient to cyber-attacks. We develop a thorough approach by utilizing Graph Convolutional Neural Networks (GCNNs) and attention mechanism in PSSE based on Supervisory Control and Data Acquisition (SCADA) and Phasor Measurement Unit (PMU) measurements, addressing the limitations of previous learning architectures. In accordance with the empirical results obtained from the experiments, the proposed method demonstrates superior performance and scalability compared to existing techniques. Furthermore, the amalgamation of local topological configurations with nodal-level data yields a heightened efficacy in the domain of state estimation. This work marks a significant achievement in the design of advanced learning architectures in PSSE, contributing and fostering the development of more reliable and secure power system operations.
基金This work was supported by the State Grid of China under the“Thousand Talents Plan”special research grant(5206001600A3).
文摘The current DSA system used in the dispatching control centers in China is a near real-time analysis system with response speed in the order of minutes.Based on a review of the state-of-the-art in online analysis and discussion of distributed data processing and computation architecture patterns,a new online analysis architecture is proposed.The primary goal of the new architecture is to increase the online analysis response speed to the order of seconds.A reference implementation of the proposed online analysis architecture to validate the feasibility of implementing the architecture and some performance testing results are presented.
基金supported by the State Grid Corporation Technology Project(No.5455HJ180022)。
文摘The sequential method is easy to integrate with existing large-scale alternating current(AC)power flow solvers and is therefore a common approach for solving the power flow of AC/direct current(DC)hybrid systems.In this paper,a highperformance graph computing based distributed parallel implementation of the sequential method with an improved initial estimate approach for hybrid AC/DC systems is developed.The proposed approach is capable of speeding up the entire computation process without compromising the accuracy of result.First,the AC/DC network is intuitively represented by a graph and stored in a graph database(GDB)to expedite data processing.Considering the interconnection of AC grids via high-voltage direct current(HVDC)links,the network is subsequently partitioned into independent areas which are naturally fit for distributed power flow analysis.For each area,the fast-decoupled power flow(FDPF)is employed with node-based parallel computing(NPC)and hierarchical parallel computing(HPC)to quickly identify system states.Furthermore,to reduce the alternate iterations in the sequential method,a new decoupled approach is utilized to achieve a good initial estimate for the Newton-Raphson method.With the improved initial estimate,the sequential method can converge in fewer iterations.Consequently,the proposed approach allows for significant reduction in computing time and is able to meet the requirement of the real-time analysis platform for power system.The performance is verified on standard IEEE 300-bus system,extended large-scale systems,and a practical 11119-bus system in China.
基金This work is supported in partial by Major State Basic Research Project (No. G19990328, Parallel Computations of the Large-Scale Reservoir Simulation (2003-2004) (Cooperated with China National 0ffshore 0il Corporation), and National Natural Science Foundation Project (No. 60303020, 2004.1-2006.12).
基金supported by the National High Technology Research and Development Program of China ("863" Program)(Grant Nos.2007AA120502,SQ2008AA12Z2475654)the National Natural Science Foundation of China (Grant Nos.40701134,40771171,40928001)National Key Technologies R&D Program of China (Grant Nos.2006BAJ14B04,2008BAJ11B04)
文摘Digital Earth has been a hot topic and research trend since it was proposed,and Digital China has drawn much attention in China.As a key technique to implement Digital China,grid is an excellent and promising concept to construct a dynamic,inter-domain and distributed computing environment.It is appropriate to process geographic information across dispersed computing resources in networks effectively and cooperatively.A distributed spatial computing prototype system is designed and implemented with the Globus Toolkit.Several important aspects are discussed in detail.The architecture is proposed according to the characteristics of grid firstly,and then the spatial resource query and access interfaces are designed for heterogeneous data sources.An open-up hierarchical architecture for resource discovery and management is represented to detect spatial and computing resources in grid.A standard spatial job management mechanism is implemented by grid service for convenient use.In addition,the control mechanism of spatial datasets access is developed based on GSI.The prototype system utilizes the Globus Toolkit to implement a common distributed spatial computing framework,and it reveals the spatial computing ability of grid to support Digital China.
基金supported by National Natural Science Foundation of China under the Grant U1766214.
文摘Approaches to apply graph computing to power grid analysis are systematically explained using real-world application examples.Through exploring the nature of the power grid and the characteristics of power grid analysis,the guidelines for selecting appropriate graph computing techniques for the application to power grid analysis are outlined.A custom graph model for representing the power grid for the analysis and simulation purpose and an in-memory computing(IMC)based graph-centric approach with a shared-everything architecture are introduced.Graph algorithms,including network topology processing and subgraph processing,and graph computing application scenarios,including in-memory computing,contingency analysis,and Common Information Model(CIM)model merge,are presented.
基金National Key Research and Development Program of China(2017YFE0132100)。
文摘The cycle structure in a power grid may lower the stability of the network;thus,it is of great significance to accu-rately and timely detect cycles in power grid networks.However,detecting possible cycles in a large-scale network can be highly time consuming and computationally intensive.In addition,since the power grid's topology changes over time,cycles can appear and disappear,and it can be difficult to monitor them in real time.In traditional computing systems,cycle detection requires considerable computational resources,making real-time cycle detection in large-scale power grids an impossible task.Graph computing has shown excellent performance in many areas and has solved many practical graph-related problems,such as power flow calculation and state estimation.In this article,a cycle detection method,the Paton method,is implemented and optimized on a graph computing platform.Two cases are used to test its performance in an actual power grid topology scenario.The results show that the graph computing-based Paton method reduces the time consumption by at least 60%compared to that of other methods.