期刊文献+

一种索引结构的压缩存储及其查询处理技术 被引量:1

Compression and query processing methods of kind of index
下载PDF
导出
摘要 在全文信息检索系统中,存储文本及其上关键词的索引结构需要大量的空间。位图索引不能支持基于信息量的查询,倒排文件需要的空间比较大。提出了频率向量这种索引结构的压缩存储方法,设计并实现了基于这种压缩存储方法的存储结构,理论分析表明该压缩方法与存储结构可以获得较高的压缩比;此外,还讨论了压缩频率向量上的查询处理技术,实验结果表明这种压缩的索引结构能够保证查询结果的完备性,并能有效地提高频率向量的存储和查询效率。 In full-text retrieval systems ,keyword-based indexes is always an important technique for efficient information retrieval. Existing bitmaps can't support queries based on the quantum of keywords and inverted files need a large amount of storage space.A compression method and a storage structure for a kind of index named frequency vectors are presented in this paper. Theoretical analysis gives a upper bound of compression ratio.Query processing method based on the compressed index is also discussed.Experimental results indicate that this compressed index can guarantee to obtain complete query results and high efficiency.
出处 《计算机工程与应用》 CSCD 北大核心 2007年第8期149-153,共5页 Computer Engineering and Applications
关键词 频率向量 压缩 离散化 查询处理 倒排索引 frequency vectors compression discretization query procession inverted index
  • 相关文献

参考文献13

  • 1Ziviani N,Moura E S,Navarro G,et al.Compression:A key for next-generation text retrieval system[J].IEEE Computer,2000,33(11):37-44.
  • 2Adiego J,Navarro G,Pable de la Fuente.Compressing semistructured text databases[C]//Fabrizio Sebastiani.the Proceedings of 25th European Conference on IR Research:ECIR'2003.German:Springer,2003:482-490.
  • 3Moura E.Fast and flexible word searching on Compressed text[J].ACM Trans Information systems,2000,18(2):113-139.
  • 4Scholer F,Williams H E,Yiannis J,et al.Compression of inverted indexes for fast query evaluation[C]//Beaulieu M,Baeza-Yates R,Myaeng S H,et al.Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval:SIGIR'2002.New York,USA:ACM Press,2002:222-229.
  • 5Johnson D S,Shankar Krishman,Jatin Chhugani,et al.Compressing large Boolean matrices using reordering technique[C]//Mario A Nascimento,M Tamer (o)zsu.proceedings of 30th International Conference on Very Large Data Base,Toronto,Canada,2004.San Fransisco:CA,Morgan Kaufmann publisher Inc,2004:13-23.
  • 6Ali Pinar,Tao Tao,Hakan Ferhatosmanpglu.Compressing bitmap indices by data reorganization[C]//Stephanie Kawada.the preceedings of 21th Internaltional Conference on Data Engineering,2005,Tokyo,Janpan.IEEE comperter society,2005:310-321.
  • 7Bookstein A,Klein S T.Compression of correlated bit-vectors[J].Information Systems,1991,16(4):387-400.
  • 8Moffat A,Zobel J.Parameterised compression for sparse bitmaps[C]//Nicholas J Belkin,Peter Ingwersen,Annelise Mark Pejtersen.Proc ACM-SIGIR International Conference on Research and Development in Information Retrieval:SIGIR'1992.New York:ACM Press,1992:.274-285.
  • 9Linoff G,Staufill.Compression of indexes with full positional information in very large text database G[C]//Korfhage R,Rasmussen E,Willett P.Proc ACM-SIGIR International Conference on Research and Development in Information Retrieval:SIGIR'1999.New York:ACM Press,1999:88-97.
  • 10Baeza-Yates R,Gonnet G.A new approach to text Searching[J].Comm ACM,1992,10:74-82.

同被引文献8

引证文献1

二级引证文献4

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部