Based on the features of marine environmental data and processing requirements,a cloud computing architecture of marine environment information is proposed,which provides a new cloud technology framework for the integ...Based on the features of marine environmental data and processing requirements,a cloud computing architecture of marine environment information is proposed,which provides a new cloud technology framework for the integration and sharing of marine environmental information resources.A physical layer,software platform layer and an application layer are illustrated systematically,at the same time,a corresponding solutions for many difficult technical problems such as parallel query processing of multi-dimensional,spatiotemporal information,data slice storage,software service flow customization,analysis,reorganization and so on.A prototype system is developed and many different data-size experiments and a comparative analysis are done based on it.The experiment results show that the cloud platform based on this framework can achieve high performance and scalability when dealing with large-scale marine data.展开更多
Data pre-deployment in the HDFS(Hadoop distributed file systems) is more complicated than that in traditional file systems. There are many key issues need to be addressed, such as determining the target location of th...Data pre-deployment in the HDFS(Hadoop distributed file systems) is more complicated than that in traditional file systems. There are many key issues need to be addressed, such as determining the target location of the data prefetching, the amount of data to be prefetched, the balance between data prefetching services and normal data accesses. Aiming to solve these problems, we employ the characteristics of digital ocean information service flows and propose a deployment scheme which combines input data prefetching with output data oriented storage strategies. The method achieves the parallelism of data preparation and data processing, thereby massively reducing I/O time cost of digital ocean cloud computing platforms when processing multi-source information synergistic tasks. The experimental results show that the scheme has a higher degree of parallelism than traditional Hadoop mechanisms, shortens the waiting time of a running service node, and significantly reduces data access conflicts.展开更多
According to the initial vision of "digital earth" (DE), the public should constitute a significant proportion of its users. However, to date, most of the studies and applications have focused on science, th...According to the initial vision of "digital earth" (DE), the public should constitute a significant proportion of its users. However, to date, most of the studies and applications have focused on science, the private sector and government. A DE-supported online oceanic educational public service and popularization system, iOcean, is studied. First, the vision for the public's engagement with "digital ocean" is described: an analysis is presented from four aspects, i.e., the space dimension, the time dimension, the state dimension and its relationship with human beings. Second, the technical framework of iOcean is discussed, including data updating and model computing, the data, the function, and the application layers. Third, two key technologies are studied in detail that will enable the construction of iOcean. More than half a million public viewers have used the current version's website. Practical demonstrations show that iOcean can bring virtual oceans to web browsers and desktops and construct a bridge between government departments and the general public.展开更多
基金the Ocean Public Welfare Scientific Research Project of State Oceanic Administration of China under contract No.201105033
文摘Based on the features of marine environmental data and processing requirements,a cloud computing architecture of marine environment information is proposed,which provides a new cloud technology framework for the integration and sharing of marine environmental information resources.A physical layer,software platform layer and an application layer are illustrated systematically,at the same time,a corresponding solutions for many difficult technical problems such as parallel query processing of multi-dimensional,spatiotemporal information,data slice storage,software service flow customization,analysis,reorganization and so on.A prototype system is developed and many different data-size experiments and a comparative analysis are done based on it.The experiment results show that the cloud platform based on this framework can achieve high performance and scalability when dealing with large-scale marine data.
基金The Ocean Public Welfare Scientific Research Project of State Oceanic Administration of China under contract No.20110533
文摘Data pre-deployment in the HDFS(Hadoop distributed file systems) is more complicated than that in traditional file systems. There are many key issues need to be addressed, such as determining the target location of the data prefetching, the amount of data to be prefetched, the balance between data prefetching services and normal data accesses. Aiming to solve these problems, we employ the characteristics of digital ocean information service flows and propose a deployment scheme which combines input data prefetching with output data oriented storage strategies. The method achieves the parallelism of data preparation and data processing, thereby massively reducing I/O time cost of digital ocean cloud computing platforms when processing multi-source information synergistic tasks. The experimental results show that the scheme has a higher degree of parallelism than traditional Hadoop mechanisms, shortens the waiting time of a running service node, and significantly reduces data access conflicts.
基金The National Natural Science Foundation of China under contract No.61074132the 908 Project of the State Oceanic Administration,China under contract No.908-03-03-02the Special Research Project for the Commonweal of the Ministry of Weater Resources of China under contract No.201201092
文摘According to the initial vision of "digital earth" (DE), the public should constitute a significant proportion of its users. However, to date, most of the studies and applications have focused on science, the private sector and government. A DE-supported online oceanic educational public service and popularization system, iOcean, is studied. First, the vision for the public's engagement with "digital ocean" is described: an analysis is presented from four aspects, i.e., the space dimension, the time dimension, the state dimension and its relationship with human beings. Second, the technical framework of iOcean is discussed, including data updating and model computing, the data, the function, and the application layers. Third, two key technologies are studied in detail that will enable the construction of iOcean. More than half a million public viewers have used the current version's website. Practical demonstrations show that iOcean can bring virtual oceans to web browsers and desktops and construct a bridge between government departments and the general public.
