摘要
为满足大数据时代海量数据的高速处理需求,在深入分析大数据匹配特点的基础上,设计了一种基于改进CRC的大规模多模式匹配硬件电路并进行了仿真。电路采用滑动窗口方式,利用FPGA强大的并行处理能力和改进的循环冗余校验码公式计算出匹配值,将其与模式库中的模式进行粗略匹配,过滤掉绝大部分不可能匹配的数据。然后将可能匹配的少量数据进行精确匹配。仿真实验结果表明,硬件匹配电路能有效过滤掉90%以上的不相关字符串,并且具有极高的数据处理速率,满足目前大规模数据的实时在线处理要求,能推广应用到电子通信、工业控制等诸多领域。
To satisfy the requirement of high speed processing of big data, a new multiple patternmatch hardware circuit based on improved CRC is designed and simulated by analyzing the characteristicsof the big data matching. The circutt uses the sliding window method. It can that impossibly match the models by using parallel processingcapabilitiesofFPGA andcalculating thematching values ofimproved cyclic redundancy check code formula. Then a small amount of data which ispossible to match w il be matched accurately. Simulation results show that the match circutt can achieve effectivereal - tm e processing of large - scale data as t has a high processing speed and can filter out morethan 90 % of irrelevant strings. It can be applied to many fields such as electronic communications and industrialcontrol.
作者
廖春蓝
LIAO Chunlan(School of Mechanical and Electrical Engineering of Guangzhou Panyu Polytechnic, Guangzhou 511483, China)
出处
《机械与电子》
2016年第6期62-64,67,共4页
Machinery & Electronics
基金
广东省自然科学基金项目(10151148301000001)
关键词
大数据
多模式匹配
循环冗余校验
仿真
big data
multi -pattern matching
cyclic redundancy check
simulation
