Clustered Single-Board Devices with Docker Container Big Stream Processing Architecture

The expanding amounts of information created by Internet of Things(IoT)devices places a strain on cloud computing,which is often used for data analysis and storage.This paper investigates a different approach based on edge cloud applications,which involves data filtering and processing before being delivered to a backup cloud environment.This Paper suggest designing and implementing a low cost,low power cluster of Single Board Computers(SBC)for this purpose,reducing the amount of data that must be transmitted elsewhere,using Big Data ideas and technology.An Apache Hadoop and Spark Cluster that was used to run a test application was containerized and deployed using a Raspberry Pi cluster and Docker.To obtain system data and analyze the setup’s performance a Prometheusbased stack monitoring and alerting solution in the cloud based market is employed.This Paper assesses the system’s complexity and demonstrates how containerization can improve fault tolerance and maintenance ease,allowing the suggested solution to be used in industry.An evaluation of the overall performance is presented to highlight the capabilities and limitations of the suggested architecture,taking into consideration the suggested solution’s resource use in respect to device restrictions.

Edge-cloud Computing Systems for Smart Grid: State-of-the-art, Architecture, and Applications

The quantity and heterogeneity of intelligent energy generation and consumption terminals in the smart grid are increasing drastically over the years.These edge devices have created significant pressures on cloud computing(CC)system and centralised control for data storage and processing in realtime operation and control.The integration of edge computing(EC)can effectively alleviate the pressure and conduct real-time processing while ensuring data security.This paper conducts an extensive review of the EC-CC computing system and its application to the smart grid,which will integrate a vast number of dispersed devices.It first comprehensively describes the relationship among CC,fog computing(FC),and EC to provide a theoretical basis for the differentiation.It then introduces the architecture of the EC-CC computing system in the smart grid,where the architecture consists of both hardware structure and software platforms,and key technologies are introduced to support functionalities.Thereafter,the application to the smart grid is discussed across the whole supply chain,including energy generation,transportation(transmission and distribution networks),and consumption.Finally,future research opportunities and challenges of EC-CC while being applied to the smart grid are outlined.This paper can inform future research and industrial exploitations of these new technologies to enable a highly efficient smart grid under decarbonisation,digitalisation,and decentralisation transitions.