期刊文献+
共找到22篇文章
< 1 2 >
每页显示 20 50 100
网页查重算法Shingling和Simhash研究 被引量:17
1
作者 马成前 毛许光 《计算机与数字工程》 2009年第1期15-17,108,共4页
随着网络信息爆炸式增长,人们对信息检索有了更高的要求。在海量的网页中,有很多重复的网页。网页查重可以节省网络带宽,降低存储成本,提高搜索引擎的性能。在网页查重算法中shingling和simhash是比较重要和经典的算法,文中对两种算法... 随着网络信息爆炸式增长,人们对信息检索有了更高的要求。在海量的网页中,有很多重复的网页。网页查重可以节省网络带宽,降低存储成本,提高搜索引擎的性能。在网页查重算法中shingling和simhash是比较重要和经典的算法,文中对两种算法做了介绍,包括算法的原理,存在的问题及改进等。 展开更多
关键词 网页查重 搜索引擎 shingling simhash
下载PDF
基于Newshingling的相似文本检测算法 被引量:1
2
作者 赵德平 蔡丽静 李鹏 《沈阳建筑大学学报(自然科学版)》 CAS 北大核心 2011年第4期771-775,共5页
目的构造一种新的文本查重算法,改变传统的Shingling网页去重算法,提高文本的相似度计算率,提高查准率和查全率.方法改变传统的Shingling算法,先删除文本中无意义的虚词,再根据语意对文本进行分片,进而利用文本相似度计算公式对文本相... 目的构造一种新的文本查重算法,改变传统的Shingling网页去重算法,提高文本的相似度计算率,提高查准率和查全率.方法改变传统的Shingling算法,先删除文本中无意义的虚词,再根据语意对文本进行分片,进而利用文本相似度计算公式对文本相似度进行计算.结果该算法提高了文本相似度计算的准确性,同时文本的查准率提高了10%左右,查全率提高了5%左右.结论实验表明,笔者所提算法实现简单、可行、具有良好的文本相似度计算效果,具有一定的优越性. 展开更多
关键词 空间向量模型 文本相似度 shingling算法 分词
下载PDF
Ambispective epidemiological observational study of varicella-zoster virus infection: An 18 year-single-center Bulgarian experience
3
作者 Hristiana M Batselova Tsvetelina V Velikova 《World Journal of Virology》 2024年第3期82-88,共7页
BACKGROUND Varicella(chickenpox)and herpes zoster(shingles)are outcomes of varicella-zoster virus(VZV)infection,and understanding their incidence trends is vital for public health planning.AIM To conduct an ambispecti... BACKGROUND Varicella(chickenpox)and herpes zoster(shingles)are outcomes of varicella-zoster virus(VZV)infection,and understanding their incidence trends is vital for public health planning.AIM To conduct an ambispective epidemiological study by analyzing the main epidemiological characteristics of VZV infection during an 18 year-period(2000-2018).METHODS We used descriptive and epidemiological methods to characterize chickenpox in Bulgaria,the city of Plovdiv and the region for a period of 18 years(2000-2018).RESULTS The average incidence of varicella-zoster infection for the period 2000–2018 in the Plovdiv region was estimated at 449.58‰.The highest relative share of the infection was assessed in the month of January at 13.6%,and the lowest in the months of August and September at 2.9%(both months).The age group most affected by the infection was 1-4 years,followed by 5-9 years.This corresponds to the so-called"pro-epidemic population"-a phenomenon typical for airborne infections,confirming their mass impact on the perpetuation of VZV infection.CONCLUSION Our findings reveal significant insights into VZV epidemiology,including age-specific incidence rates,clinical manifestations,and vaccination impact.This comprehensive analysis contributes to the broader understanding of VZV infec-tion dynamics and may inform evidence-based preventive measures. 展开更多
关键词 Varicella-zoster virus Epidemiology Incidence trends CHICKENPOX SHINGLES Public health Pro-epidemic population Age-specific incidence Clinical manifestations Vaccination impact
下载PDF
一种基于Hadoop的文本相似度仿真检测模型 被引量:3
4
作者 吴云 许抗震 黄瑞章 《新疆大学学报(自然科学版)》 CAS 北大核心 2017年第3期308-315,共8页
随着信息时代数据量成倍的增长,传统的文本相似度检测方法已经无法处理大规模的文本数据.为此,提出了一种基于Hadoop集群技术的文本相似度仿真检测模型.该检测模型分为三步:第一步,利用Hadoop工具搭建实验平台,并针对该平台进行硬件和... 随着信息时代数据量成倍的增长,传统的文本相似度检测方法已经无法处理大规模的文本数据.为此,提出了一种基于Hadoop集群技术的文本相似度仿真检测模型.该检测模型分为三步:第一步,利用Hadoop工具搭建实验平台,并针对该平台进行硬件和软件的优化;第二步,把文档转化为集合,使用改进的基于Map Reduce编程模型的Shingling算法;第三步,提出一种分布式的New Minhash算法求签名矩阵,然后利用Jaccard系数计算出相似度,选出相似的文档.实验证明:对于相同操作,优化后的性能耗时减少了近5.65%.该仿真模型不仅能够更加精确的求出文本相似度,而且能够更好的适应分布式平台处理大规模的文本数据,同时拥有良好的扩展性. 展开更多
关键词 文本相似 Minhash shingling HADOOP
下载PDF
一种两阶段的多媒体教育资源网页消重方法
5
作者 杨晓娟 廖晨辉 《现代教育技术》 CSSCI 2012年第9期93-96,共4页
随着开放教育资源运动开展与深入,在互联网络中形成开放的、超大规模的、世界范围内最先进的多媒体教育资源网页集群。然而使用搜索引擎检索的结果中存在大量的重复网页,导致资源获取难、利用率低的问题。文章在总结现有网页消重方法的... 随着开放教育资源运动开展与深入,在互联网络中形成开放的、超大规模的、世界范围内最先进的多媒体教育资源网页集群。然而使用搜索引擎检索的结果中存在大量的重复网页,导致资源获取难、利用率低的问题。文章在总结现有网页消重方法的基础上提出一种可行的两阶段的多媒体教育资源网页消重方法,实验证明,通过对网页文本信息及多媒体信息分开消重,能有效地提高消重的效果。 展开更多
关键词 开放教育资源 基于签名的消重方法 基于关键词的消重方法 shingling算法
下载PDF
一种双层网页去重方法研究
6
作者 毛晓蛟 《电脑编程技巧与维护》 2010年第20期66-67,84,共3页
利用Bloom Filter数据结构、shingling算法和MD5编码,构造双层网页去重模型。通过Bloom Filter结构,在网络蜘蛛程序下载网页时,去除重复的网址,并讨论了Bloom Filter出错概率。对已下载的网页用shingling算法去重,阐述了相似网页的判断... 利用Bloom Filter数据结构、shingling算法和MD5编码,构造双层网页去重模型。通过Bloom Filter结构,在网络蜘蛛程序下载网页时,去除重复的网址,并讨论了Bloom Filter出错概率。对已下载的网页用shingling算法去重,阐述了相似网页的判断方法。通过实验,得到了最后的结果,并指出了模型存在的缺点和该方法的后续研究方向。 展开更多
关键词 BLOOM FILTER 错误率 shingling MD5 相似网页
下载PDF
一种高效的分布式相似短文本聚类算法 被引量:4
7
作者 原默晗 唐晋韬 王挺 《计算机与数字工程》 2016年第5期895-900,943,共7页
近似重复在微博等网络短文本中十分常见,查找和消除近似重复对于网络信息的有效处理具有非常重要的意义。论文针对相似短文本聚类的特点,在改进shingling、最小哈希和局部敏感哈希算法相结合的文件相似检测方法的基础上,设计了一个高效... 近似重复在微博等网络短文本中十分常见,查找和消除近似重复对于网络信息的有效处理具有非常重要的意义。论文针对相似短文本聚类的特点,在改进shingling、最小哈希和局部敏感哈希算法相结合的文件相似检测方法的基础上,设计了一个高效的短文本聚类方法。该方法通过将文本表示成连续短字符串集合,并应用最小哈希将集合简化成一组由数字组成的文本签名,通过局部敏感哈希算法得到符合相似度条件的文本聚类。为了适应网络信息规模大的特点,论文进一步利用Apache Spark集群计算框架对聚类算法进行了并行化,提高了数据处理的效率,并分析了影响算法性能的因素。 展开更多
关键词 文本聚类 最小哈希 局部敏感哈希 shingling SPARK
下载PDF
一种基于特征向量的改进DSC网页去重算法 被引量:1
8
作者 徐朝辉 赵淑梅 +1 位作者 闫付亮 秦杰 《科学技术与工程》 北大核心 2013年第8期2250-2253,共4页
网页去重具有很重要的实际意义,也是信息检索领域近几年研究的热点。分析现有的网页去重算法,并对经典的DSC(digital syntactic clustering)网页去重算法进行改进。为每篇文档生成一个特征向量集合,用该特征向量集合筛选shin-gles;然后... 网页去重具有很重要的实际意义,也是信息检索领域近几年研究的热点。分析现有的网页去重算法,并对经典的DSC(digital syntactic clustering)网页去重算法进行改进。为每篇文档生成一个特征向量集合,用该特征向量集合筛选shin-gles;然后进行相似性比较。实验表明,该算法对重复网页判定具有很好的准确率和召回率。 展开更多
关键词 搜索引擎 网页去重 特征项 shingle
下载PDF
基于标题与文本相似度的网页正文提取算法 被引量:1
9
作者 苏秀芝 《科技创新与应用》 2016年第25期57-58,共2页
主题型网页标题是网页正文内容的高度概括,利于标题与正文相似性之间的关系,提出了基于标题与文本相似度的网页正文提取算法。该算法首先把网页解析成DOM树,再生成STU-DOM,接着对STU-DOM进行粗剪枝。对剪枝后的语义树通过Shingle算法对... 主题型网页标题是网页正文内容的高度概括,利于标题与正文相似性之间的关系,提出了基于标题与文本相似度的网页正文提取算法。该算法首先把网页解析成DOM树,再生成STU-DOM,接着对STU-DOM进行粗剪枝。对剪枝后的语义树通过Shingle算法对网页标题与节点文本进行切分,生成标题和节点文本词汇单元集合,利用改进后的Dice系数计算标题与文本的相似性实现网页正文提取。实验结果表明,该抽取方法准确率达到90%以上,具有可观的实用价值。 展开更多
关键词 网页去噪 DOM STU Shingle DICE
下载PDF
Probabilistic, Statistical and Algorithmic Aspects of the Similarity of Texts and Application to Gospels Comparison
10
作者 Soumaila Dembele Gane Samb Lo 《Journal of Data Analysis and Information Processing》 2015年第4期112-127,共16页
The fundamental problem of similarity studies, in the frame of data-mining, is to examine and detect similar items in articles, papers, and books with huge sizes. In this paper, we are interested in the probabilistic,... The fundamental problem of similarity studies, in the frame of data-mining, is to examine and detect similar items in articles, papers, and books with huge sizes. In this paper, we are interested in the probabilistic, and the statistical and the algorithmic aspects in studies of texts. We will be using the approach of k-shinglings, a k-shingling being defined as a sequence of k consecutive characters that are extracted from a text (k ≥ 1). The main stake in this field is to find accurate and quick algorithms to compute the similarity in short times. This will be achieved in using approximation methods. The first approximation method is statistical and, is based on the theorem of Glivenko-Cantelli. The second is the banding technique. And the third concerns a modification of the algorithm proposed by Rajaraman et al. ([1]), denoted here as (RUM). The Jaccard index is the one being used in this paper. We finally illustrate these results of the paper on the four Gospels. The results are very conclusive. 展开更多
关键词 SIMILARITY Web MINING Jaccard SIMILARITY RU Algorithm Minhashing Data MINING shingling Bible’s GOSPELS Glivenko-Cantelli EXPECTED SIMILARITY STATISTICAL Estimation
下载PDF
Varicella zoster virus vaccines: potential complications and possible improvements 被引量:5
11
作者 Benjamin Silver Hua Zhu 《Virologica Sinica》 SCIE CAS CSCD 2014年第5期265-273,共9页
Varicella zoster virus(VZV) is the causative agent of varicella(chicken pox) and herpes zoster(shingles). After primary infection, the virus remains latent in sensory ganglia, and reactivates upon weakening of the cel... Varicella zoster virus(VZV) is the causative agent of varicella(chicken pox) and herpes zoster(shingles). After primary infection, the virus remains latent in sensory ganglia, and reactivates upon weakening of the cellular immune system due to various conditions, erupting from sensory neurons and infecting the corresponding skin tissue. The current varicella vaccine(v-Oka) is highly attenuated in the skin, yet retains its neurovirulence and may reactivate and damage sensory neurons. The reactivation is sometimes associated with postherpetic neuralgia(PHN), a severe pain along the affected sensory nerves that can linger for years, even after the herpetic rash resolves. In addition to the older population that develops a secondary infection resulting in herpes zoster, childhood breakthrough herpes zoster affects a small population of vaccinated children. There is a great need for a neuro-attenuated vaccine that would prevent not only the varicella manifestation, but, more importantly, any establishment of latency, and therefore herpes zoster. The development of a genetically-defined live-attenuated VZV vaccine that prevents neuronal and latent infection, in addition to primary varicella, is imperative for eventual eradication of VZV, and, if fully understood, has vast implications for many related herpesviruses and other viruses with similar pathogenic mechanisms. 展开更多
关键词 VARICELLA ZOSTER virus HERPESVIRUS vaccine NEUROVIRULENCE neuro-attenuation latency latent infection herpes ZOSTER SHINGLES chicken pox ORF7
下载PDF
消除重复藏文网页的完整解决方案
12
作者 王海洪 戴玉刚 《科技信息》 2009年第4期21-21,23,共2页
消除重复网页是搜索引擎不可或缺的一部分,藏文搜索引擎也是如此。从信息处理的角度而言,藏文属于"复杂文字"的范畴,其编码在实际使用当中仍不统一。本论文实现了统一的藏文编码并选择合适的Shingle粒度,提出了消除重复藏文... 消除重复网页是搜索引擎不可或缺的一部分,藏文搜索引擎也是如此。从信息处理的角度而言,藏文属于"复杂文字"的范畴,其编码在实际使用当中仍不统一。本论文实现了统一的藏文编码并选择合适的Shingle粒度,提出了消除重复藏文网页的完整解决方案。经过试验其效果能够满足藏文搜索引擎消除重复网页的需求。 展开更多
关键词 消除重复 藏文网页 统一藏文编码 Shingle算法
下载PDF
一种基于相似度的互联网信息去重算法的设计与实现
13
作者 蓝煜 《电信交换》 2010年第3期26-32,共7页
提出一种基于文档特征相似度技术的互联网信息去重算法及其实现。通过对文档特征码的有效降维和收敛及高效存储和查找,使整个系统具有极高的处理效率。克服了相似度识别理论模型在多语种环境中特征判断准确率低、处理速度慢等缺点。通... 提出一种基于文档特征相似度技术的互联网信息去重算法及其实现。通过对文档特征码的有效降维和收敛及高效存储和查找,使整个系统具有极高的处理效率。克服了相似度识别理论模型在多语种环境中特征判断准确率低、处理速度慢等缺点。通过对大量互联网邮件和网页的测试与分析,该算法能实现近似常量的时间复杂度的互联网信息去重功能,并具有较高的判断准确率。 展开更多
关键词 相似度 全文检索 shingle算法 最小独立相关置换 降维
下载PDF
A meta-analysis of randomized controlled trials of acupuncture bloodletting for shingles
14
作者 Li Lin Xiao-Ning Yan +1 位作者 Wen-Bin Li Yi-Ding Zhao 《Journal of Hainan Medical University》 2020年第21期42-47,共6页
Objective:To systematically evaluate the clinical efficacy of acupuncture bloodletting therapy for herpes zoster.Methods:The computer searched the CNKI,WanFang,VIP,CBM,PubMed,and Cochrane Library databases.The time li... Objective:To systematically evaluate the clinical efficacy of acupuncture bloodletting therapy for herpes zoster.Methods:The computer searched the CNKI,WanFang,VIP,CBM,PubMed,and Cochrane Library databases.The time limit was from the establishment of the database to December 31,2019.Relevant literatures on randomized controlled trials of spinal bloodletting for shingles were retrieved.Data were extracted and quality evaluated based on the Cochrane bias risk assessment method.Meta analysis was performed using Rev Man5.3 and Stata15 statistical software.Results:(1)A total of 21 Chinese literatures were included,with a total of 1,533 patients;(2)Meta-analysis was performed using a fixed effect model,and the results showed that the total effective rate of the experimental group(OR=5.11,95%CI:(3.48,7.50),Z=8.33,P<0.00001)is better than the control group,the difference is statistically significant;(3)VAS score analysis using a random effects model(MD-2.23,95%CI(-2.46,-1.99),p<0.0001)(4)The incidence of sequela neuralgia was analyzed using a random effects model(OR=0.21,95%CI:(0.09,0.51),Z=3.48,P=0.0005).Conclusion:The effect of spinal bloodletting on the treatment of shingles and VAS scores,symptomatic relief,and the incidence of sequela neuralgia have advantages. 展开更多
关键词 Spinous bloodletting SHINGLES Randomized contro META-ANALYSIS Systematic review
下载PDF
A Case Report: PCR-Assisted Diagnosis of Varicella in an Adult
15
作者 Satish K. Mehta Don Gilden +3 位作者 Brian E. Crucian Clarence F. Sams Randall J. Cohrs Duane L. Pierson 《Open Journal of Medical Microbiology》 2012年第3期131-132,共2页
A 41-year-old woman developed skin lesions on her upper back and arm. Initially, a definitive diagnosis could not be made. Subsequently, PCR detected VZV DNA in skin lesions and saliva. Immediate antiviral treatment l... A 41-year-old woman developed skin lesions on her upper back and arm. Initially, a definitive diagnosis could not be made. Subsequently, PCR detected VZV DNA in skin lesions and saliva. Immediate antiviral treatment led to a quick recovery without complicating prolonged fatigue and weakness typically seen in adults with varicella. 展开更多
关键词 CHICKENPOX SHINGLES VARICELLA-ZOSTER VIRUS
下载PDF
Shingles and Pericarditis: A Rare Combination
16
作者 Rakan M. Nasreddine Chirine A. Mollaei +2 位作者 Joudy N. Bahous Eid E. Azar Claude M. Afif 《International Journal of Clinical Medicine》 2015年第5期322-325,共4页
Clinical infection with varicella in both its’ forms, primary and reactivation, can be associated with a variety of complications. Cardiac complications, though very rare, have been associated with the primary form o... Clinical infection with varicella in both its’ forms, primary and reactivation, can be associated with a variety of complications. Cardiac complications, though very rare, have been associated with the primary form of varicella zoster and as such should be recognized in order to initiate early treatment and prevent morbidity and mortality. However, cardiac complications have not been described in association with the reactivation form of varicella. We report a case of an adult immunocompetent male who presented with herpes zoster complicated by pericarditis with pericardial effusion and a positive varicella zoster virus (VZV) polymerase chain reaction (PCR) in pericardial fluid. 展开更多
关键词 HERPES ZOSTER SHINGLES PERICARDITIS
下载PDF
Celiac sprue-a cryptic disease:A case report
17
作者 Lisa R Maness 《World Journal of Medical Genetics》 2022年第1期1-6,共6页
BACKGROUND Celiac sprue,or celiac disease,is a relatively common disease whereby many are unaware that they have it.It often manifests with symptoms outside of the digestive system.Many health care providers are unawa... BACKGROUND Celiac sprue,or celiac disease,is a relatively common disease whereby many are unaware that they have it.It often manifests with symptoms outside of the digestive system.Many health care providers are unaware of the wide variety of symptoms of celiac disease as well as diseases that are associated with it,often delaying diagnosis and treatment.CASE SUMMARY The following case indicates an otherwise healthy 20-year-old female who presents with a variety of symptoms and is ultimately diagnosed with shingles,infectious mononucleosis,and celiac disease CONCLUSION Although it is known that risk-factors are genetic as well as environmental,much more research is needed to better understand the relationship of potential causes.In addition,continuing education is needed in health care so that more practitioners better understand celiac disease. 展开更多
关键词 Celiac disease Autoimmune disease SHINGLES Infectious mononucleosis Case report
下载PDF
Shingles vaccination reduces the risk of Parkinson's disease
18
作者 Steven Lehrer Peter H.Rheinstein 《Chronic Diseases and Translational Medicine》 CSCD 2023年第1期54-57,共4页
The most prevalent age-related movement condition,Parkinson's disease(PD),is characterized by bradykinesia,resting tremor,unbalanced gait,muscular rigidity,postural instability,as well as some nonmotor symptoms li... The most prevalent age-related movement condition,Parkinson's disease(PD),is characterized by bradykinesia,resting tremor,unbalanced gait,muscular rigidity,postural instability,as well as some nonmotor symptoms like autonomic and cognitive dysfunctions. 展开更多
关键词 herpes zoster Parkinson's disease SHINGLES VACCINE
原文传递
RAID 4SMR:RAID Array with Shingled Magnetic Recording Disk for Mass Storage Systems 被引量:2
19
作者 Quoc Le Ahmed Amer JoAnne Holliday 《Journal of Computer Science & Technology》 SCIE EI CSCD 2019年第4期854-868,共15页
One way to increase storage density is using a shingled magnetic recording(SMR)disk.We propose a novel use of SMR disks with RAID(redundant array of independent disks)arrays,specifically building upon and compared wit... One way to increase storage density is using a shingled magnetic recording(SMR)disk.We propose a novel use of SMR disks with RAID(redundant array of independent disks)arrays,specifically building upon and compared with a basic RAID 4 arrangement.The proposed scheme(called RAID 4SMR)has the potential to improve the performance of a traditional RAID 4 array with SMR disks.Our evaluation shows that compared with the standard RAID 4,when using update in-place in RAID arrays,RAID 4SMR with garbage collection not just can allow the adoption of SMR disks with a reduced performance penalty,but offers a performance improvement of up to 56%. 展开更多
关键词 DISK ARRAY redundant ARRAY of independent disks(RAID) shingled magnetic recording(SMR) shingled WRITE
原文传递
Recycled asphalt shingle modified asphalt mixture design and performance evaluation 被引量:1
20
作者 He Wang Punyaslok Rath William GButtlar 《Journal of Traffic and Transportation Engineering(English Edition)》 CSCD 2020年第2期205-214,共10页
The inclusion of recycled asphalt shingles(RAS)in asphalt mixtures has become increasingly common;however,the underlying design principles vary significantly by agency.The primary objectives of this study included:(1)... The inclusion of recycled asphalt shingles(RAS)in asphalt mixtures has become increasingly common;however,the underlying design principles vary significantly by agency.The primary objectives of this study included:(1)evaluating the‘binder availability’concept for RAS mixtures through a carefully designed laboratory experiment;(2)demonstrating a balanced mixture performance testing approach for the design of RAS mixtures;and(3)evaluating the field data of RAS mixtures placed in the Midwest region of the U.S.Three asphalt mixture designs with RAS contents of 0,2.5%and 5.0%,which were designed to have nearly identical volumetric characteristics,were investigated.The binder availability was determined to be approximately 100%in the two RAS mixtures considered.In addition,Hamburg wheel tracking and disk-shaped compact tension tests were conducted to evaluate the high-and low-temperature mixture performance.As expected,the addition of RAS significantly improved the rutting resistance.Disk-shaped compact tension(DC(T))test results demonstrated that a soft base binder effectively permitted the design of thermal-crack-resistant RAS mixtures.Field investigations indicated that the performance of pavement surfaces containing RAS was similar to that of surfaces containing only reclaimed asphalt pavement or virgin materials.This study also highlights a performanceengineered mix design approach,which is currently being adopted by several agencies in the Midwest(e.g.,Illinois Toll way,Missouri DOT,etc.)and can provide mix designers a reliable approach for designing innovative asphalt mixtures with higher recycling levels and a modern,heterogeneous composition.Furthermore,the proposed approach may prove to be a simpler,more mixture-centric alternative to the primary method suggested in AASHTO PP78-17,which recommends arbitrary VMA bumping plus binder extraction,recovery,and advanced binder testing. 展开更多
关键词 PAVEMENT Recycled ASPHALT SHINGLES RAS DC(T) CRACKING
原文传递
上一页 1 2 下一页 到第
使用帮助 返回顶部