摘要
Increasingly there is a need to process graphs that are larger than the available memory on today's machines.Many systems have been developed with grapli representations that are efficient and compact for out-of-core processing.A necessary task in these systems is memory management.This paper presents a system called Cacheap which automatically and efficiently manages the available memory to maximize the speed of grapli processing,minimize the amount of disk access,and maximize the utilization of memory for graph data.It has a simple interface that can be easily adopted by existing graph engines.The paper describes the new system,uses it in recent graph engines,and demonstrates its integer factor improvements in the speed of large-scale grapli processing.
基金
the National Key Research and Development Program of China under Grant No.2017YFB1003103
the National Natural Science Foundation of China under Grant Nos.6143201&61432016,61332009,and 61521092
the National Science Foundation of USA under Contract Nos.CCF-1717877 and CCF-1629376
an IBM CAS Faculty Fellowship.
