When using distributed storage systems to store gridded remote sensing data in large,distributed clusters,most solutions utilize big table index storage strategies.However,in practice,the performance of big table inde...When using distributed storage systems to store gridded remote sensing data in large,distributed clusters,most solutions utilize big table index storage strategies.However,in practice,the performance of big table index storage strategies degrades as scenarios become more complex,and the reasons for this phenomenon are analyzed in this paper.To improve the read and write performance of distributed gridded data storage,this paper proposes a storage strategy based on Ceph software.The strategy encapsulates remote sensing images in the form of objects through a metadata management strategy to achieve the spatiotemporal retrieval of gridded data,finding the cluster location of gridded data through hash-like calculations.The method can effectively achieve spatial operation support in the clustered database and at the same time enable fast random read and write of the gridded data.Random write and spatial query experiments proved the feasibility,effectiveness,and stability of this strategy.The experiments prove that the method has higher stability than,and that the average query time is 38%lower than that for,the large table index storage strategy,which greatly improves the storage and query efficiency of gridded images.展开更多
基金This work was funded by the Department of Science and Technology of Henan Province through grant 201400210100the National Key R&D Program of China through grant 2019YFE0127000this work was supported by National Supercomputing Center in Zhengzhou.
文摘When using distributed storage systems to store gridded remote sensing data in large,distributed clusters,most solutions utilize big table index storage strategies.However,in practice,the performance of big table index storage strategies degrades as scenarios become more complex,and the reasons for this phenomenon are analyzed in this paper.To improve the read and write performance of distributed gridded data storage,this paper proposes a storage strategy based on Ceph software.The strategy encapsulates remote sensing images in the form of objects through a metadata management strategy to achieve the spatiotemporal retrieval of gridded data,finding the cluster location of gridded data through hash-like calculations.The method can effectively achieve spatial operation support in the clustered database and at the same time enable fast random read and write of the gridded data.Random write and spatial query experiments proved the feasibility,effectiveness,and stability of this strategy.The experiments prove that the method has higher stability than,and that the average query time is 38%lower than that for,the large table index storage strategy,which greatly improves the storage and query efficiency of gridded images.
