期刊文献+
共找到2篇文章
< 1 >
每页显示 20 50 100
Scrapy框架下区域人口数据爬虫的设计与实现 被引量:8
1
作者 李通 姚新强 《软件导刊》 2021年第11期152-157,共6页
防震减灾对策研究中,区域人口数据起着至关重要的参考作用。用区域人口数据乘以一定震级下对应人口的伤亡率,可以初步判断该区域因地震导致的人员伤亡数。为减小在传统搜索引擎下人工采集数据出现的误差,提高采集海量人口数据的工作效率... 防震减灾对策研究中,区域人口数据起着至关重要的参考作用。用区域人口数据乘以一定震级下对应人口的伤亡率,可以初步判断该区域因地震导致的人员伤亡数。为减小在传统搜索引擎下人工采集数据出现的误差,提高采集海量人口数据的工作效率,以北京市人口数据为例,首先使用Xpath方式分析网页结构布局和数据分布,利用正则表达式进行数据筛选,再对网页进行多层URL爬取,直至获取到北京市社区一级的6859条数据,最后将其保存至MySQL数据库中进行持久化存储。实验结果表明,该爬虫能够有效避免人工采集数据过程中出现的数据误差,有效数据率达83.1%。数据采集过程达到高效、准确及可视化要求。 展开更多
关键词 Scrapy PYTHON 数据爬取 地理人口数据 爬虫
下载PDF
APPLICATION OF GEOGRAPHICAL PARAMETER DATABASE TO ESTABLISHMENT OF UNIT POPULATION DATABASE 被引量:4
2
作者 WUXi-zhi DONGChun +2 位作者 ZHAORong LIUJi-ping WANGGui-xin 《Chinese Geographical Science》 SCIE CSCD 2003年第1期34-38,共5页
Now GIS is turning into a good tool in handling geographical, economical, and population data, so we can obtain more and more information from these data. On the other hand, in some cases, for a calamity, such as hurr... Now GIS is turning into a good tool in handling geographical, economical, and population data, so we can obtain more and more information from these data. On the other hand, in some cases, for a calamity, such as hurricane, earthquake, flood, drought etc., or a decision-making, such as setting up a broadcasting transmitter, building a chemical plant etc., we have to evaluate the total population in the region influenced by a calamity or a project. In this paper, a method is put forward to evaluate the population in such special region. Through exploring the correlation of geographical parameters and the distribution of people in the same region by means of quantitative analysis and qualitative analysis, unit population database (1km× 1km) is established. In this way, estimating the number of people in a special region is capable by adding up the population in every grid involved in this region boundary. The geographical parameters are obtained from topographic database and DEM database on the scale of 1: 250 000. The fundamental geographical parameter database covering county administrative boundaries and 1km × 1km grid is set up and the population database at county level is set up as well. Both geographical parameter database and unit population database are able to oiler sufficient conditions for quantitative analysis. They will have important role in the research fields of data mining (DM), Decision-making Support Systems (DSS), and regional sustainable development. 展开更多
关键词 geographical parameter database unit population database quantitative analysis weight coefficient standardized weight coefficient
下载PDF
上一页 1 下一页 到第
使用帮助 返回顶部