In a growing number of information processing applications,data takes the form of continuous data streams rather than traditional stored databases.Monitoring systems that seek to provide monitoring services in cloud e...In a growing number of information processing applications,data takes the form of continuous data streams rather than traditional stored databases.Monitoring systems that seek to provide monitoring services in cloud environment must be prepared to deal gracefully with huge data collections without compromising system performance.In this paper,we show that by using a concept of urgent data,our system can shorten the response time for most 'urgent' queries while guarantee lower bandwidth consumption.We argue that monitoring data can be treated differently.Some data capture critical system events;the arrival of these data will significantly influence the monitoring reaction speed which is called urgent data.High speed urgent data collections can help system to react in real time when facing fatal errors.A cloud environment in production,MagicCube,is used as a test bed.Extensive experiments over both real world and synthetic traces show that when using urgent data,monitoring system can lower the response latency compared with existing monitoring approaches.展开更多
Cloud computing system consists of private clouds and public clouds. It merges its resources on each layer(e.g. Iaa S, Paa S and Saa S), which poses a challenge for resource management. The cloud monitoring system is ...Cloud computing system consists of private clouds and public clouds. It merges its resources on each layer(e.g. Iaa S, Paa S and Saa S), which poses a challenge for resource management. The cloud monitoring system is a solution to managing cloud system data from the heterogeneous resources. This paper discusses the monitoring and collection of the heterogeneous resources, studies the adaptive system, and proposes a real-time extensible distributed framework of monitoring data processing. Based on this framework, a system of monitoring data distribution, publication and subscription is proposed. The simulation results show that the proposed mechanism can adaptively determine the distribution action of monitoring data flow, and effectively reduce the costs for data monitoring and distribution.展开更多
Cloud computing has recently emerged as a leading paradigm to allow customers to run their applications in virtualized large-scale data centers. Existing solutions for monitoring and management of these infrastructure...Cloud computing has recently emerged as a leading paradigm to allow customers to run their applications in virtualized large-scale data centers. Existing solutions for monitoring and management of these infrastructures consider virtual machines (VMs) as independent entities with their own characteristics. However, these approaches suffer from scalability issues due to the increasing number of VMs in modern cloud data centers. We claim that scalability issues can bc addressed by leveraging the similarity among VMs behavior in terms of resource usage patterns. In this paper we propose an automated methodology to cluster VMs starting from the usage of multiple resources, assuming no knowledge of the services executed on them. The innovative contribution of the proposed methodology is the use of the statistical technique known as principal component analysis (PCA) to automatically select the most relevant information to cluster similar VMs. We apply the methodology to two case studies, a virtualized testbed and a real enterprise data center. In both case studies, the automatic data selection based on PCA allows us to achieve high performance, with a percentage of correctly clustered VMs between 80% and 100% even for short time series (1 day) of monitored data. Furthermore, we estimate the potential reduction in the amount of collected data to demonstrate how our proposal may address the scalability issues related to monitoring and management in cloud computing data centers.展开更多
Cloud computing is a new computing model. The resource monitoring tools are immature compared to traditional distributed computing and grid computing. In order to better monitor the virtual resource in cloud computing...Cloud computing is a new computing model. The resource monitoring tools are immature compared to traditional distributed computing and grid computing. In order to better monitor the virtual resource in cloud computing, a periodically and event-driven push (PEP) monitoring model is proposed. Taking advantage of the push and event-driven mechanism, the model can provide comparatively adequate information about usage and status of the resources. It can simplify the communication between Master and Work Nodes without missing the important issues happened during the push interval. Besides, we develop "mon" to make up for the deficiency of Libvirt in monitoring of virtual CPU and memory.展开更多
The data and applications in cloud computing reside in cyberspace, that allowing to users access data through any connection device, when you need to transfer information over the cloud, you will lose control of it. T...The data and applications in cloud computing reside in cyberspace, that allowing to users access data through any connection device, when you need to transfer information over the cloud, you will lose control of it. There are multi types of security challenge must be understood and countermeasures. One of the major security challenges is resources of the cloud computing infrastructures are provided as services over the Internet, and entire data in the cloud computing are reside over network resources, that enables the data to be access through VMs. In this work, we describe security techniques for securing a VCCI, VMMs such as Encryption and Key Management (EKM), Access Control Mechanisms (ACMs), Virtual Trusted Platform Module (vTPM), Virtual Firewall (VF), and Trusted Virtual Domains (TVDs). In this paper we focus on security of virtual resources in Virtualized Cloud Computing Infrastructure (VCCI), Virtual Machine Monitor (VMM) by describing types of attacks on VCCI, and vulnerabilities of VMMs and we describe the techniques for securing a VCCI.展开更多
Service Level Agreement (SLA) is a fundamental contract between service consumer and service provider which defined the qualities of agreed service. After SLA contraction, it should be monitored during the service inv...Service Level Agreement (SLA) is a fundamental contract between service consumer and service provider which defined the qualities of agreed service. After SLA contraction, it should be monitored during the service invocations to confirm the service level objectives. Most of SLA structure and monitoring frameworks are brought from SOA and grid computing to cloud computing environment while they have different requirements. In this paper, a model is proposed as hierarchical autonomic (HA)-SLA based on cloud computing nature. It is proposed in this model that each SLA has connection with dependent SLAs in different layers of cloud computing, hierarchically, whereby each SLA should be able to monitor its attributes on its own. It is expected that HA-SLA model should able to increase SLA validity and users’ confidence without compromising the respond time. The results produced by this model should be used as one of cloud computing quality of service assurance.展开更多
针对传统消防监控系统存在开发成本高、误警率高、实时监控不便的问题,提出一种基于物联网云平台的智慧消防远程监控系统。采用STM32单片机作为中枢控制芯片,经多传感器采集温度、湿度、烟雾、火焰等环境数据,通过窄带物联网(NB-IoT,Nar...针对传统消防监控系统存在开发成本高、误警率高、实时监控不便的问题,提出一种基于物联网云平台的智慧消防远程监控系统。采用STM32单片机作为中枢控制芯片,经多传感器采集温度、湿度、烟雾、火焰等环境数据,通过窄带物联网(NB-IoT,Narrow Band Internet of Things)上传至OneNET云平台。经数据分析后以可视化方式呈现,对异常数据触发报警实时响应。通过手机APP实现数据实时监测及一键处置。经测试,监控系统报警准确率高于97.2%,数据延迟低于50 ms,表明该系统能够实现消防火警的无线远程监控,并做出快速反应,满足中小微企业和普通家庭用户的消防监控需要。展开更多
基于无线传输的方式设计了针对供热系统的二次网在小区单元间水力平衡的远程监控系统。该监控系统由可编程逻辑控制器(PLC)、电动调节阀和传感器等设备完成底层采集监控,通过PLC云网关和4G移动通信系统将二次网数据无线传输至云服务器,...基于无线传输的方式设计了针对供热系统的二次网在小区单元间水力平衡的远程监控系统。该监控系统由可编程逻辑控制器(PLC)、电动调节阀和传感器等设备完成底层采集监控,通过PLC云网关和4G移动通信系统将二次网数据无线传输至云服务器,采用OPC通信和SQL Server数据库实现云网关服务器和监控系统间的数据传输和存储;在KingSCADA软件和Visual Studio Code软件中分别设计编写本地监控系统和网页远程监控系统,使单元间水力平衡的调节参数可视化。测试结果表明,该监控系统可实现供热系统二次网单元间水力平衡调节的实时远程监控功能,对提高水力平衡调节效率具有现实意义。展开更多
基金supported by the National Key Technology R&D Program(Grant NO. 2012BAH17F01)NSFC-NSF International Cooperation Project(Grant NO. 61361126011)
文摘In a growing number of information processing applications,data takes the form of continuous data streams rather than traditional stored databases.Monitoring systems that seek to provide monitoring services in cloud environment must be prepared to deal gracefully with huge data collections without compromising system performance.In this paper,we show that by using a concept of urgent data,our system can shorten the response time for most 'urgent' queries while guarantee lower bandwidth consumption.We argue that monitoring data can be treated differently.Some data capture critical system events;the arrival of these data will significantly influence the monitoring reaction speed which is called urgent data.High speed urgent data collections can help system to react in real time when facing fatal errors.A cloud environment in production,MagicCube,is used as a test bed.Extensive experiments over both real world and synthetic traces show that when using urgent data,monitoring system can lower the response latency compared with existing monitoring approaches.
基金the Scientific Research Foundation of Zhejiang Provincial Education Department of China(No.Y201431192)
文摘Cloud computing system consists of private clouds and public clouds. It merges its resources on each layer(e.g. Iaa S, Paa S and Saa S), which poses a challenge for resource management. The cloud monitoring system is a solution to managing cloud system data from the heterogeneous resources. This paper discusses the monitoring and collection of the heterogeneous resources, studies the adaptive system, and proposes a real-time extensible distributed framework of monitoring data processing. Based on this framework, a system of monitoring data distribution, publication and subscription is proposed. The simulation results show that the proposed mechanism can adaptively determine the distribution action of monitoring data flow, and effectively reduce the costs for data monitoring and distribution.
文摘Cloud computing has recently emerged as a leading paradigm to allow customers to run their applications in virtualized large-scale data centers. Existing solutions for monitoring and management of these infrastructures consider virtual machines (VMs) as independent entities with their own characteristics. However, these approaches suffer from scalability issues due to the increasing number of VMs in modern cloud data centers. We claim that scalability issues can bc addressed by leveraging the similarity among VMs behavior in terms of resource usage patterns. In this paper we propose an automated methodology to cluster VMs starting from the usage of multiple resources, assuming no knowledge of the services executed on them. The innovative contribution of the proposed methodology is the use of the statistical technique known as principal component analysis (PCA) to automatically select the most relevant information to cluster similar VMs. We apply the methodology to two case studies, a virtualized testbed and a real enterprise data center. In both case studies, the automatic data selection based on PCA allows us to achieve high performance, with a percentage of correctly clustered VMs between 80% and 100% even for short time series (1 day) of monitored data. Furthermore, we estimate the potential reduction in the amount of collected data to demonstrate how our proposal may address the scalability issues related to monitoring and management in cloud computing data centers.
基金Project supported by the Shanghai Leading Academic Discipline Project(Grant No.J50103)the Ph D Programs Foundation of Ministry of Education of China(Grant No.200802800007)+1 种基金the Key Laboratory of Computer System and Architecture(Institute of Computing Technology,Chinese Academy of Sciences)the Innovation Project of Shanghai Municipal Education Commission(Grant No.11YZ09)
文摘Cloud computing is a new computing model. The resource monitoring tools are immature compared to traditional distributed computing and grid computing. In order to better monitor the virtual resource in cloud computing, a periodically and event-driven push (PEP) monitoring model is proposed. Taking advantage of the push and event-driven mechanism, the model can provide comparatively adequate information about usage and status of the resources. It can simplify the communication between Master and Work Nodes without missing the important issues happened during the push interval. Besides, we develop "mon" to make up for the deficiency of Libvirt in monitoring of virtual CPU and memory.
文摘The data and applications in cloud computing reside in cyberspace, that allowing to users access data through any connection device, when you need to transfer information over the cloud, you will lose control of it. There are multi types of security challenge must be understood and countermeasures. One of the major security challenges is resources of the cloud computing infrastructures are provided as services over the Internet, and entire data in the cloud computing are reside over network resources, that enables the data to be access through VMs. In this work, we describe security techniques for securing a VCCI, VMMs such as Encryption and Key Management (EKM), Access Control Mechanisms (ACMs), Virtual Trusted Platform Module (vTPM), Virtual Firewall (VF), and Trusted Virtual Domains (TVDs). In this paper we focus on security of virtual resources in Virtualized Cloud Computing Infrastructure (VCCI), Virtual Machine Monitor (VMM) by describing types of attacks on VCCI, and vulnerabilities of VMMs and we describe the techniques for securing a VCCI.
文摘Service Level Agreement (SLA) is a fundamental contract between service consumer and service provider which defined the qualities of agreed service. After SLA contraction, it should be monitored during the service invocations to confirm the service level objectives. Most of SLA structure and monitoring frameworks are brought from SOA and grid computing to cloud computing environment while they have different requirements. In this paper, a model is proposed as hierarchical autonomic (HA)-SLA based on cloud computing nature. It is proposed in this model that each SLA has connection with dependent SLAs in different layers of cloud computing, hierarchically, whereby each SLA should be able to monitor its attributes on its own. It is expected that HA-SLA model should able to increase SLA validity and users’ confidence without compromising the respond time. The results produced by this model should be used as one of cloud computing quality of service assurance.
文摘针对传统消防监控系统存在开发成本高、误警率高、实时监控不便的问题,提出一种基于物联网云平台的智慧消防远程监控系统。采用STM32单片机作为中枢控制芯片,经多传感器采集温度、湿度、烟雾、火焰等环境数据,通过窄带物联网(NB-IoT,Narrow Band Internet of Things)上传至OneNET云平台。经数据分析后以可视化方式呈现,对异常数据触发报警实时响应。通过手机APP实现数据实时监测及一键处置。经测试,监控系统报警准确率高于97.2%,数据延迟低于50 ms,表明该系统能够实现消防火警的无线远程监控,并做出快速反应,满足中小微企业和普通家庭用户的消防监控需要。
文摘基于无线传输的方式设计了针对供热系统的二次网在小区单元间水力平衡的远程监控系统。该监控系统由可编程逻辑控制器(PLC)、电动调节阀和传感器等设备完成底层采集监控,通过PLC云网关和4G移动通信系统将二次网数据无线传输至云服务器,采用OPC通信和SQL Server数据库实现云网关服务器和监控系统间的数据传输和存储;在KingSCADA软件和Visual Studio Code软件中分别设计编写本地监控系统和网页远程监控系统,使单元间水力平衡的调节参数可视化。测试结果表明,该监控系统可实现供热系统二次网单元间水力平衡调节的实时远程监控功能,对提高水力平衡调节效率具有现实意义。