This paper designs and develops a framework on a distributed computing platform for massive multi-source spatial data using a column-oriented database(HBase).This platform consists of four layers including ETL(extract...This paper designs and develops a framework on a distributed computing platform for massive multi-source spatial data using a column-oriented database(HBase).This platform consists of four layers including ETL(extraction transformation loading) tier,data processing tier,data storage tier and data display tier,achieving long-term store,real-time analysis and inquiry for massive data.Finally,a real dataset cluster is simulated,which are made up of 39 nodes including 2 master nodes and 37 data nodes,and performing function tests of data importing module and real-time query module,and performance tests of HDFS's I/O,the MapReduce cluster,batch-loading and real-time query of massive data.The test results indicate that this platform achieves high performance in terms of response time and linear scalability.展开更多
D GISs were developed simultaneously in the late 1980s in a number of different disciplines.The development of these 3D GISs can not yet meet all needs for new representations and analytical tools in 3D environments.I...D GISs were developed simultaneously in the late 1980s in a number of different disciplines.The development of these 3D GISs can not yet meet all needs for new representations and analytical tools in 3D environments.In this paper,the data structures,especially solid_based data representations are introduced.Then,a typical object_oriented data model is put forth to show a new data model.And at last,two data access methods are proposed to make the data model clear.展开更多
基金香港城市大学“香港基本法实施研究:中国与比较宪法视角”研究计划(Research Project on the Implementation of the Hong Kong Basic Law:Chinese and Comparative Constitutional Law Perspectives,9220093)。
基金Supported by the National Science and Technology Support Project(No.2012BAH01F02)from Ministry of Science and Technology of Chinathe Director Fund(No.IS201116002)from Institute of Seismology,CEA
文摘This paper designs and develops a framework on a distributed computing platform for massive multi-source spatial data using a column-oriented database(HBase).This platform consists of four layers including ETL(extraction transformation loading) tier,data processing tier,data storage tier and data display tier,achieving long-term store,real-time analysis and inquiry for massive data.Finally,a real dataset cluster is simulated,which are made up of 39 nodes including 2 master nodes and 37 data nodes,and performing function tests of data importing module and real-time query module,and performance tests of HDFS's I/O,the MapReduce cluster,batch-loading and real-time query of massive data.The test results indicate that this platform achieves high performance in terms of response time and linear scalability.
文摘D GISs were developed simultaneously in the late 1980s in a number of different disciplines.The development of these 3D GISs can not yet meet all needs for new representations and analytical tools in 3D environments.In this paper,the data structures,especially solid_based data representations are introduced.Then,a typical object_oriented data model is put forth to show a new data model.And at last,two data access methods are proposed to make the data model clear.
