期刊文献+

一种高性能计算网络下的TCP查找哈希算法

A High Performance Computing Network TCP Optimization Algorithm Based on Hash Table
下载PDF
导出
摘要 在计算机与通信网络紧密结合的时代,智能电网中的数据处理需要依靠计算机集群来完成,数据传输主要依靠高性能计算网络完成,而高性能计算网络在广域网中主要依赖于TCP协议来实现。由于一般的基于哈希表的TCP查找算法的性能会在TCP会话过多的情况下急剧恶化,且会导致计算机查找TCP会话时产生缓存占用过多的情况,因此提出了一种优化后用来支持高性能计算网络中计算机查找大量TCP会话的高效的TCP查找算法。该算法主要对计算机通过哈希函数生成TCP会话的哈希值的方法以及哈希表的数据结构和映射方式两方面进行优化,并实现了一种适合现代计算机体系的数据结构。为了验证该算法的性能,在Intel多核处理器上进行了并行化堆栈。实验表明,该算法减少了大量TCP会话情况下计算机的TCP会话查找时间和占用的计算机缓存大小,并能在并行平台上同时处理百万级个会话。 In the era of the close connection between computer and the communication network, the data processing in the smart grid needs to be done by computer clusters,the data transmission is mainly done by the high performance computing network,and the high perform- ance computing network mainly depends on TCP in the wide area network. As the performance of the typical hash based TCP lookup al- gorithm is drastically deteriorated in the case of too many TCP sessions, it will contribute to the situation where too much cache of the computers is occupied by TCP sessions. Therefore, we present a high-efficient TCP lookup algorithm that alms at supporting large num- ber of sessions in high performance computing network. It mainly optimizes the TCP session in beth the way of generating the hash value and the data structure and mapping mode of the hash table that well fits the modem computer architectures well. In order to verify the per- formance of the algorithm, we parallelize the stack on the Intel multi core processors. Experiments show that the algorithm reduces the TCP session lookup time and the cache size of a computer in the situation of a large number of TCP sessions, and can handle millions of conversations on a parallel platform at the same time.
作者 张立武 冯宝 周建华 李洋 茅天奇 ZHANG Li-wu;FENG Bao;ZHOU Jian-hua;LI Yang;MAO Tian-qi(NARI Group Corporation Co. ,Ltd., ( State Grid Electric Power Research Institute Co. ,Ltd. ), Nanjing 211000, China;Electric Power Research Institute of State Grid Jiangsu Electric Power Co. Ltd. ,Nanjing 211103 ,China;School of Communication and Information Engineering ,Nanjing University of Posts and Telecommunications, Nanjing 210003, China)
出处 《计算机技术与发展》 2018年第5期94-98,共5页 Computer Technology and Development
基金 国家自然科学基金(61471203) 教育部博士点基金资助项目(20133223120002) 国家电网公司2016年科技项目
关键词 TCP查找 哈希表 高性能计算网络 数据结构 TCP lookup hash table high performance computing network data structure
  • 相关文献

参考文献6

二级参考文献37

  • 1何素贞,李书平,吴晨旭.高性能计算集群系统的设计和实现[J].厦门大学学报(自然科学版),2004,43(6):879-881. 被引量:8
  • 2程光,龚俭,丁伟,徐加羚.面向IP流测量的哈希算法研究[J].软件学报,2005,16(5):652-658. 被引量:54
  • 3谢向辉,彭龙根,吴志兵,卢德平.基于InfiniBand的高性能计算机技术研究[J].计算机研究与发展,2005,42(6):905-912. 被引量:12
  • 4张科.多次Hash快速分词算法[J].计算机工程与设计,2007,28(7):1716-1718. 被引量:22
  • 5Oliker L, Canning A, Carter J, et al. Scientific Application Performance on Candidate PetaScale Platforms[C]//Proc of Int'l Parallel & Distributed Processing Symposium, 2007:1- 12.
  • 6Michael T. Heath Scientific Computing: An Introductory Survey[M]. 2nd Edition. McGraw-Hill Companies Inc, 2002.
  • 7Bader D A面向千万亿次计算的算法与应用(Petascale Computing Algorithms and Applications)[M].都志辉译.北京:清华大学出版社,2008.
  • 8Cao P, Wang Z. Efficient Top-K Query Calculation in Distributed Networks[C]//Proc of Session: P2P and Network Algorithms, 2004: 206-215.
  • 9Patterson D A,Hennessy J L.计算机体系结构:量化研究方法(英文版.第3版)[M].北京:机械工业出版社,2002.
  • 10NEC. NEC SX-6 Mult-Node Scalable to Meet Even Utmost Demands[EB/OL]. [2009-05-28]. http://parallel, ru/ftp/ computers/nec/SX-6-Multi-node. pdf.

共引文献53

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部