期刊文献+
共找到2,674篇文章
< 1 2 134 >
每页显示 20 50 100
Stress Path Analysis of Deep-Sea Sediments Under the Compression-Shear Coupling Load of Crawler Collectors
1
作者 ZHANG Ning MA Ning +2 位作者 YIN Shiyang CHEN Xuguang SONG Yuheng 《Journal of Ocean University of China》 SCIE CAS CSCD 2023年第1期65-74,共10页
The mechanical properties of deep-sea sediments during the driving process of crawler collectors are essential factors in the design of mining systems.In this study,a crawler load is divided into a normal compression ... The mechanical properties of deep-sea sediments during the driving process of crawler collectors are essential factors in the design of mining systems.In this study,a crawler load is divided into a normal compression load and a horizontal shear load.Then,the internal stress state of sedimentary soil is examined through a theoretical calculation and finite element numerical simulation.Finally,the driving of crawlers is simulated by changing the relative spatial position between the load and stress unit,obtaining the stress path of the soil unit.Based on the calculation results,the effect of the horizontal shear load on the soil stress response is analyzed at different depths,and the spatial variation law of the soil stress path is examined.The results demonstrate that the horizontal shear load has a significant effect on the rotation of the principal stress,and the reverse rotation of the principal stress axis becomes obvious with the increase in the burial depth.The stress path curve of the soil is different at various depths.The spatial variation rule of the stress path of the shallow soil is complex,whereas the stress path curve of the deep soil tends to shrink as the depth increases.The stress path of the corresponding depth should be selected according to the actual research purpose and applied to the laboratory test. 展开更多
关键词 deep-sea sediment crawler collector compression-shear coupling load stress path principal stress axis direction
下载PDF
Analysis on steering characteristics of crawler pipeline robot
2
作者 耿林康 RAO Jinjun LEI Jingtao 《High Technology Letters》 EI CAS 2023年第1期60-67,共8页
In order to improve the elbow passing performance and different diameter adaptability of pipeline robot,a supported crawler pipeline robot is designed,which adopts screw nut mechanism and hinge four-bar mechanism to a... In order to improve the elbow passing performance and different diameter adaptability of pipeline robot,a supported crawler pipeline robot is designed,which adopts screw nut mechanism and hinge four-bar mechanism to adapt to the complex environment such as variable diameter pipeline and elbow.The steering characteristics passing through the elbow are studied,the kinematic of pipeline robot bending steering is established,the geometric constraint(GC)and steering constraint(SC)in the elbow are analyzed,and the steering experiment is conducted.The results show that the robot can pass through the elbow by the SC model.The SC model can reduce the motor current and energy consumption when the robot passes through the elbow. 展开更多
关键词 crawler pipeline robot steering characteristics geometric constraint(GC) steering constraint(SC)
下载PDF
基于神经网络的增量式crawler重访频率研究 被引量:1
3
作者 周英飚 王军 《华中科技大学学报(自然科学版)》 EI CAS CSCD 北大核心 2004年第12期32-33,45,共3页
crawler是搜索引擎必备的核心组件 ,以何种频率对变化的Web页面进行重访是增量式crawler要解决的主要问题 .结合人工神经网络建立页面变化模型 ,由模型确定增量式crawler重访时间 ,同时分析模型在实践中的应用 ,提出一种应用方案 ,具有... crawler是搜索引擎必备的核心组件 ,以何种频率对变化的Web页面进行重访是增量式crawler要解决的主要问题 .结合人工神经网络建立页面变化模型 ,由模型确定增量式crawler重访时间 ,同时分析模型在实践中的应用 ,提出一种应用方案 ,具有较好的自适应性 . 展开更多
关键词 搜索引擎 crawler 增量式crawler 神经网络
下载PDF
一种并行Crawler系统中的URL分配算法设计 被引量:1
4
作者 万源 万方 王大震 《计算机工程与应用》 CSCD 北大核心 2006年第A01期117-119,共3页
研究了分布式体系结构下的并行Crawler采集模型,分析了各组件的功能及各Cmwler在并行搜索时,为保证系统的负载均衡而应遵循的基本规则,并提出了一种基于散列(hash)的URL的调度算法。
关键词 分布式crawler 散列算法 URL分配
下载PDF
面向动态网页爬行的Crawler架构 被引量:7
5
作者 严亚兰 《图书情报知识》 CSSCI 北大核心 2003年第4期51-53,共3页
 本文分析了Crawler动态网页爬行功能,提出了面向动态网页爬行的Crawler架构,并对相应模块进行了探讨。
关键词 crawler架构 爬行 动态网页
下载PDF
面向主题Crawler的设计与实现 被引量:1
6
作者 苗长芬 冯伟华 《平原大学学报》 2005年第3期110-112,共3页
针对目前通用搜索引擎所搜索到的结果过多,与主题相关性不强的情况,提出了面向主题的搜索引擎,文章以主题相关度为核心研究和设计了主题crawler,为进行主题搜索引擎的研究奠定了良好的基础.
关键词 crawler 主题搜索引擎 相关度
下载PDF
基于Crawler技术的超链接测试系统
7
作者 吉向东 《信息技术》 2009年第9期106-108,共3页
设计和实现了一个基于搜索引擎Crawler技术的超链接测试系统。通过将Crawler的爬行范围限制在一个网站之内,系统可以自动对待测网站进行扫描,有效地找出烂链和孤页。测试表明,相对于其它超链接测试产品而言,系统的测试自动化程度较高,... 设计和实现了一个基于搜索引擎Crawler技术的超链接测试系统。通过将Crawler的爬行范围限制在一个网站之内,系统可以自动对待测网站进行扫描,有效地找出烂链和孤页。测试表明,相对于其它超链接测试产品而言,系统的测试自动化程度较高,为测试人员提供了较为丰富的控制手段。 展开更多
关键词 crawler 超链接 测试 烂链 孤页
下载PDF
分布式Crawler系统研究与设计
8
作者 万方 王大震 《软件导刊》 2007年第5期45-46,共2页
分布式Crawler系统是在传统集中式信息采集系统基础上,结合分布式并行技术的产物,是搜索引擎的一个重要组成部分。研究了分布式Crawler系统中并行调度和URL处理的主要实现技术,并设计了一个分布式Crawler系统,对其中的任务划分机制和UR... 分布式Crawler系统是在传统集中式信息采集系统基础上,结合分布式并行技术的产物,是搜索引擎的一个重要组成部分。研究了分布式Crawler系统中并行调度和URL处理的主要实现技术,并设计了一个分布式Crawler系统,对其中的任务划分机制和URL检索算法作了详细描述。 展开更多
关键词 分布式crawler 并行调度 URL检索
下载PDF
分布式Web Crawler的研究:结构、算法和策略 被引量:23
9
作者 叶允明 于水 +2 位作者 马范援 宋晖 张岭 《电子学报》 EI CAS CSCD 北大核心 2002年第12A期2008-2011,共4页
本文介绍了一个大型分布式Web Crawler系统——Igloo 1.2版。它采用分布式的系统结构,通过我们设计的二级哈希映射算法使系统可以进行高效的任务分割,并且系统的规模动态可扩展.爬行网页的质量是评价Crawler的一个重要指标,Igloo以PageR... 本文介绍了一个大型分布式Web Crawler系统——Igloo 1.2版。它采用分布式的系统结构,通过我们设计的二级哈希映射算法使系统可以进行高效的任务分割,并且系统的规模动态可扩展.爬行网页的质量是评价Crawler的一个重要指标,Igloo以PageRank值作为网页质量评价的标准,从而提高了爬行质量.加快爬行速度的关键是如何解除Crawler系统中的性能瓶颈,本文对此也作了详细的讨论,并提出了一种基于“滞后合并”策略的UBL数据库存取方法.实验表明,Igloo在保持高性能的同时能快速爬行到高质量的网页. 展开更多
关键词 WEB爬虫 爬行策略 分布式系统 计算机网络 网页
下载PDF
一个P2P IPTV多协议爬行器——TVCrawler 被引量:5
10
作者 姜志宏 王晖 +1 位作者 樊鹏翼 袁雪美 《计算机应用》 CSCD 北大核心 2010年第3期715-718,728,共5页
P2PIPTV网络测量是研究P2PIPTV行为和特征的重要手段,不仅有利于设计出更符合真实网络环境的系统或协议,也是实现P2PIPTV监测、引导和控制等方面的重要依据和基础。爬行器是P2PIPTV网络的一种主动测量技术,也是目前P2PIPTV测量的主要方... P2PIPTV网络测量是研究P2PIPTV行为和特征的重要手段,不仅有利于设计出更符合真实网络环境的系统或协议,也是实现P2PIPTV监测、引导和控制等方面的重要依据和基础。爬行器是P2PIPTV网络的一种主动测量技术,也是目前P2PIPTV测量的主要方式之一。提出了一个P2PIPTV多协议爬行器——TVCrawler,能够对PPLive、PPStream和UUSee三个系统的直播频道进行测量。TVCrawler主要具有三个特点:1)采用基于反馈的引导节点集构造机制;2)采用主从结构,并行爬行获取拓扑数据;3)采用基于拓扑增长系数的自适应爬行时长控制。实验表明,TVCrawler的爬行测量速度达到20~100节点/秒和130~500边/秒。 展开更多
关键词 网络测量 对等网络 网络电视 爬行器 覆盖网络
下载PDF
智能专题化信息搜集Crawler 被引量:4
11
作者 钱榕 徐新华 +1 位作者 郑莹 杨炳儒 《计算机工程》 CAS CSCD 北大核心 2006年第3期57-59,共3页
介绍了基于Web内容和结构挖掘的专题化智能Web爬行Crawler系统,并重点介绍其中CA(C&S)算法,该算法充分利用神经网络可以方便地模拟网络的拓扑结构和并行计算的特点,采用加强学习判断网页与主题的相关度,在进行相关度计算时,不考虑... 介绍了基于Web内容和结构挖掘的专题化智能Web爬行Crawler系统,并重点介绍其中CA(C&S)算法,该算法充分利用神经网络可以方便地模拟网络的拓扑结构和并行计算的特点,采用加强学习判断网页与主题的相关度,在进行相关度计算时,不考虑网页的全部内容,而通过提取网页的HTML描述中的重要标记,对Web网页进行内容和结构分析,从而判断爬行到的网页与主题的相关性,以提高信息搜集的效率和精确性。 展开更多
关键词 专题化爬行 WEB挖掘 神经网络 加强学习
下载PDF
增量更新Crawler进行Web收集方法研究 被引量:2
12
作者 程菲 汪建海 罗键 《计算机工程与科学》 CSCD 2006年第12期28-30,98,共4页
本文针对目前Web信息挖掘中存在的各种问题,对网络爬虫系统进行研究,提出了一种基于HTTP协议原理、旨在减少网络爬虫系统运行时网络流量的Web页面收集方法———增量更新Crawler方法。该方法通过Web预取技术对现有的Web链接数据库进行... 本文针对目前Web信息挖掘中存在的各种问题,对网络爬虫系统进行研究,提出了一种基于HTTP协议原理、旨在减少网络爬虫系统运行时网络流量的Web页面收集方法———增量更新Crawler方法。该方法通过Web预取技术对现有的Web链接数据库进行演化更新,可以在减少网络流量的同时获得接近现有网络爬虫系统的效果。 展开更多
关键词 信息检索 网络爬虫 增量更新
下载PDF
Experimental Study on the Ride Comfort of a Crawler Power Chassis Scale Model Based on the Similitude Theory 被引量:2
13
作者 ZHAO Jianzhu WANG Fengchen +2 位作者 YU Bin TONG Pengcheng CHEN Kuifu 《Chinese Journal of Mechanical Engineering》 SCIE EI CAS CSCD 2015年第3期496-503,共8页
The ride comfort experimental assessment of crawler off-road vehicle is relatively overlooked, and is expensive and difficult to execute with higher and higher ride comfort performance requirements. To trade off betwe... The ride comfort experimental assessment of crawler off-road vehicle is relatively overlooked, and is expensive and difficult to execute with higher and higher ride comfort performance requirements. To trade off between precise and cost, an experimental method based on the similitude theory is proposed. Under the guidance of the similitude theory, a 1:5 crawler power chassis scale model equipped with a kind of variable stiffness suspension system is used. The power spectrum density(PSD), the root mean square(RMS) of weighed acceleration, peak factor, average absorbed power(AAP) and vibration dose value(VDV) are selected as ride comfort evaluation indexes, and tests results are transformed via similarity indexes to predict the performance of full-scale power chassis. PSD shows that the low-order natural frequency of the vertical natural frequency(z axis) is 1.1 Hz, and the RMS, AAP and VDV values indicate the ride comfort performance of this kind of power chassis is between the "A little uncomfortable" and "Rather uncomfortable". From the results, low-order vertical natural frequency, obtained by PSD, validates that the similarity relationship between two models is satisfied, and 1:5 scale model used in experiment meets the similarity relationship with the full-scale model; consequently, the ride comfort prophase evaluation with the 1:5 scale model is feasible. The attempt of applying the similitude theory to crawler vehicle ride comfort test study decreases the cost and improves the test feasibility with sufficient test precise. 展开更多
关键词 crawler power chassis scale model similitude theory off-road vehicle ride comfort
下载PDF
聚焦式Web Crawler工具的设计与开发
14
作者 唐详 《情报杂志》 CSSCI 北大核心 2005年第4期58-60,共3页
进行了一种面向特定领域主题搜索的实践——聚焦式WebCrawler。分析了搜索引擎和聚类算法的一般工作原理,并指出其不足。在此基础上,综合两者的优点形成了聚焦式WebCrawler工具,介绍了该工具的主要技术及实现方式。
关键词 主题挖掘 搜索引擎 WEB crawler 自动分类 聚类算法
下载PDF
BP网络在Web Crawler中的应用
15
作者 张艳艳 《微计算机信息》 北大核心 2008年第27期95-96,119,共3页
本文介绍了Web Crawler和BP网络的基本原理,在此基础上,应用BP网络对网页变化的时间间隔进行建模,通过BP算法训练得到一个预测模型,预测出各网页的变化时间间隔,通过与实际采集的时间间隔相比较判断网页是否发生变化。实验证明,BP网络... 本文介绍了Web Crawler和BP网络的基本原理,在此基础上,应用BP网络对网页变化的时间间隔进行建模,通过BP算法训练得到一个预测模型,预测出各网页的变化时间间隔,通过与实际采集的时间间隔相比较判断网页是否发生变化。实验证明,BP网络能够有效预测网页变化的时间间隔,指导增量更新。 展开更多
关键词 Webcrawler BP网络 预测模型
下载PDF
Body Structure Design, Simulation and Parameter Optimization of a Crawler Type Mobile Flat Bedplate Frame Composite Car 被引量:1
16
作者 LUO Qing-sheng HOU Yuan +1 位作者 ZHANG Ze-zheng ZHAO Hai-bo 《Computer Aided Drafting,Design and Manufacturing》 2013年第4期53-57,共5页
The report mainly studied the crawler frame motion platform to reduce weight and increase the intensity. Report described the structural design process which using CAD/CAE technology for solid modeling, simulation ana... The report mainly studied the crawler frame motion platform to reduce weight and increase the intensity. Report described the structural design process which using CAD/CAE technology for solid modeling, simulation analysis, parameter optimization. And it also explained the outstanding advantages of CAD/CAE technology in mechanical design as well as simulation analysis. 展开更多
关键词 crawler robot flame solid modeling simulation Analysis parameter optimization CAD/CAE technology
下载PDF
A Survey about Algorithms Utilized by Focused Web Crawler
17
作者 Yong-Bin Yu Shi-Lei Huang +3 位作者 Nyima Tashi Huan Zhang Fei Lei Lin-Yang Wu 《Journal of Electronic Science and Technology》 CAS CSCD 2018年第2期129-138,共10页
Abstract—Focused crawlers (also known as subjectoriented crawlers), as the core part of vertical search engine, collect topic-specific web pages as many as they can to form a subject-oriented corpus for the latter ... Abstract—Focused crawlers (also known as subjectoriented crawlers), as the core part of vertical search engine, collect topic-specific web pages as many as they can to form a subject-oriented corpus for the latter data analyzing or user querying. This paper demonstrates that the popular algorithms utilized at the process of focused web crawling, basically refer to webpage analyzing algorithms and crawling strategies (prioritize the uniform resource locator (URLs) in the queue). Advantages and disadvantages of three crawling strategies are shown in the first experiment, which indicates that the best-first search with an appropriate heuristics is a smart choice for topic-oriented crawlingwhile the depth-first search is helpless in focused crawling. Besides, another experiment on comparison of improved ones (with a webpage analyzing algorithm added) is carried out to verify that crawling strategies alone are not quite efficient for focused crawling and in most cases their mutual efforts are taken into consideration. In light of the experiment results and recent researches, some points on the research tendency of focused crawler algorithms are suggested. 展开更多
关键词 Crawling strategies focused crawler harvest rate uniform resource locator(URL) prioritizing webpage analyzing
下载PDF
Crawler for Nodes in the Internet of Things
18
作者 Xuemeng Li Yongyi Wang +1 位作者 Fan Shi Wenchao Jia 《ZTE Communications》 2015年第3期46-50,共5页
Determining the application and version of nodes in the Internet of Things (IoT) is very important for warning about and managing vulnerabilities in the IoT. This article defines the attributes for determining the a... Determining the application and version of nodes in the Internet of Things (IoT) is very important for warning about and managing vulnerabilities in the IoT. This article defines the attributes for determining the application and version of nodes in the roT. By improving the structure of the Internet web crawler, which obtains raw data from nodes, we can obtain data from nodes in the IoT. We improve on the existing strategy, in which only determinations are stored, by also storing downloaded raw data locally in MongoDB. This stored raw data can be conveniently used to determine application type and node version when a new determination method emerges or when there is a new application type or node version. In such instances, the crawler does not have to scan the Internet again. We show through experimentation that our crawler can crawl the loT and obtain data necessary for determining the application type and node version. 展开更多
关键词 crawler local storage NODES Internet of Things
下载PDF
基于Crawler4j和Quartz的分布式爬虫系统
19
作者 刘晓东 林凤德 朱文欢 《科技创新与应用》 2020年第13期15-16,共2页
网络爬虫是实现数据分析的重要基础,通过网络爬虫可实现对数据的获取。针对爬虫的渠道广、数量多且杂、单点效率低的问题,引入了轻量级的多线程爬虫框架Crawler4j和分布式定时任务调度框架Quartz,文章主要基于这两个框架来搭建稳定、高... 网络爬虫是实现数据分析的重要基础,通过网络爬虫可实现对数据的获取。针对爬虫的渠道广、数量多且杂、单点效率低的问题,引入了轻量级的多线程爬虫框架Crawler4j和分布式定时任务调度框架Quartz,文章主要基于这两个框架来搭建稳定、高效的分布式爬虫系统。 展开更多
关键词 网络爬虫 分布式 crawler4j QUARTZ
下载PDF
Design of a Web Crawler for Water Quality Monitoring Data and Data Visualization
20
作者 Ziwen Yu Jianjun Zhang +6 位作者 Wenwu Tan Ziyi Xiong Peilun Li Liangqing Meng Haijun Lin Guang Sun Peng Guo 《Journal on Big Data》 2022年第2期135-143,共9页
Many countries are paying more and more attention to the protection of water resources at present,and how to protect water resources has received extensive attention from society.Water quality monitoring is the key wo... Many countries are paying more and more attention to the protection of water resources at present,and how to protect water resources has received extensive attention from society.Water quality monitoring is the key work to water resources protection.How to efficiently collect and analyze water quality monitoring data is an important aspect of water resources protection.In this paper,python programming tools and regular expressions were used to design a web crawler for the acquisition of water quality monitoring data from Global Freshwater Quality Database(GEMStat)sites,and the multi-thread parallelism was added to improve the efficiency in the process of downloading and parsing.In order to analyze and process the crawled water quality data,Pandas and Pyecharts are used to visualize the water quality data to show the intrinsic correlation and spatiotemporal relationship of the data. 展开更多
关键词 Water quality monitoring data web crawler data visualization
下载PDF
上一页 1 2 134 下一页 到第
使用帮助 返回顶部