一种LZ4无损压缩电路设计

The design of the lossless compression circuit based on LZ4 algorithm

为缓解存储系统中软件压缩算法对计算资源的大量占用,使用LZ4算法设计了一种无损压缩电路。提出了一种循环队列结构的滑动字典,结合散列表模块构建LZ4无损压缩电路,最后使用Calgary和Canterbury语料库,在Xilinx KC705 FPGA平台对电路进行验证并与软件压缩对比。结果表明所设计的LZ4无损压缩电路保持了软件压缩相同的压缩率的同时,在压缩效率上远超过软件压缩。

To decrease the costs of the implementation of compression by software in a storage system,the lossless compression circuit based on LZ4 algorithm is proposed in this paper.The sliding dictionary with circulating queue structure is used,together with the Hash Table module to design the lossless compression circuit based on LZ4.Finally,the design is tested and verified with Calgary corpus and Canterbury corpus on Xilinx KC705 FPGA platform.The results are compared with LZ4 software method and it can be concluded that the compression efficiency of LZ4 circuit method greatly faster than the software method obviously,while the compress ratios keep the same.