摘要
针对汉语分词词典中双字哈希索引机制未能充分利用索引分词,而分词效率又明显优于首字哈希索引机制的问题,在充分分析汉语构词特点的基础上,提出了基于三字哈希索引的分词词典机制,并通过将字串的三态标记与下一索引指针的乘积作为哈希值的链地址法,简化了词典结构,节省了内存空间。理论分析和真实语料仿真均证明了三字哈希索引机制与不同字数的其他索引机制相比,具有更好的分词效率。
According to the Chinese dictionary word segmentation efficiency that based on the Double-Character-Hash-Index（DCHI） mechanism exceeds clearly based on the First-Character-Hash-Index（FCHI） mechanism,this paper lucubrates to the Chinese word-building characteristic and provides a new segmentation dictionary mechanism named Three-Character-Hash-Indexing（TCHI） mechanism,which exploits character coding index sufficiently.The results show that the TCHI dictionary mechanism can improve speed and achieve more efficiency than FCHI,DCHI and four;character-hash-index in Chinese dictionary word segmentation mechanism.
出处
《计算机工程与应用》
CSCD
北大核心
2008年第26期135-137,共3页
Computer Engineering and Applications
关键词
计算机应用
中文分词
词典机制
三字哈希索引
computer application
Chinese word segmentation
dictionary mechanism
Three Character Hash Index（TCHI）
