基于python+requests的数据采集技术

本文指出在数据采集、数据分析等方面,python语言是人们的不二选择。针对许多人刚开始学习采用python语言进行数据采集时思路混乱的问题,本文首先分析了基于python语言的数据采集基本流程,然后介绍了第三方请求模块requests库向目标地址发送请求的功能,最后通过采集某网站中的单条数据、单页数据、多页数据乃至整个网站的数据案例,逐步为初学者解释了python语言数据采集的基本步骤,并为初学者理清了python语言数据采集的思路,以此为python语言数据采集的初学者提供了一定的参考价值和学习思路。

基于Python和Requests快速获取网页数据的方法研究

随着“互联网+”和大数据时代的到来,网络上充斥着各种各样的数据,过滤并获取有用的数据在当今环境下至关重要。文章提出一种基于Python和Requests模块的快速获取网页数据的方法,使用该方法可以获取解析前的网页源代码文本和图片数据,并保存为本地文件,为之后的数据分析和深入学习大数据技术奠定基础。实验结果表明,该方法步骤和代码编写简单易学,运行结果较好,具有一定的实用性。

基于Python与Requests模块的网络图片爬虫程序设计

在互联网的时代背景下,从大量的网络信息中快速获取批量的图片资源,是一个值得研究的论题。在此基于Python爬虫框架中的5个部分,按照Requests模块的6个步骤,实现快速且批量获取网络图片的爬虫程序设计。实验结果表明,该爬虫程序代码量少、思路清晰、简单易学、结果正确,具有一定的实用性。

prAMD:一种GitHub pull-request协作机制自动设计方法

社会协作编码的开放性使得软件在开发过程中可以汇聚集体智慧。pull-request作为GitHub中开发人员贡献代码的主要方式,若开发人员之间不能有效地沟通协作,整个开发过程就会变得迟缓低效。因此为了提高协作效率,将pull开发模型下开发人员之间的协作过程建模为一种Agent协作模型。结合实际开发过程中开发人员扮演的不同角色,以及各个角色具有的相关特征,基于自动机制设计方法计算得到满足优化目标的协作机制,一定程度上可以更好地促进开发人员协作,提高开发效率。

Assessment of the Drafting Quality of Request Forms Submitted to the Malaria and Parasitology Units at the Institut Pasteur de Cote d’Ivoire

Biological tests provide information on the medical analysis requested by both the patient and the prescriber. It is a communication link between the prescriber and the laboratory staff. The lack of some information on request forms not only affects the drafting quality of the test and patient care, but could also make thousands of data produced by healthcare centers unusable. The aim of this study was to assess the drafting quality of request forms submitted to the Malaria and Parasitology Units at the Institut Pasteur de Côte d’Ivoire. Methods: It was a descriptive cross-sectional study to assess the drafting quality of request forms of various prescribers received at the Institut Pasteur de Côte d’Ivoire. This study was conducted at the Malaria and Parasitology Units, department of Parasitology and Mycology (Institut Pasteur de Côte d’Ivoire), from 6th December 2020 to 6th December 2021. The information on each request forms was recorded on a data collection form designed for this purpose. Each data collection form corresponds to a request forms and each test to a patient. Results: Out of a total of 1990 request forms received, the patient’s age and sex were missing on 18% and 26.8% of the tests respectively. More than half (51.80%) of request forms did not indicate the patient’s place of residence. Clinical information was not provided on 45.90% of the tests. Prescribers omitting their signatures were 51%, stamps were 50.3% and contacts were 71.2%. Only 5.4% of request forms were of good drafting quality. Providing all the required information on the forms could facilitate the use and analysis of data and samples.

Floating Waste Discovery by Request via Object-Centric Learning

Discovering floating wastes,especially bottles on water,is a crucial research problem in environmental hygiene.Nevertheless,real-world applications often face challenges such as interference from irrelevant objects and the high cost associated with data collection.Consequently,devising algorithms capable of accurately localizing specific objects within a scene in scenarios where annotated data is limited remains a formidable challenge.To solve this problem,this paper proposes an object discovery by request problem setting and a corresponding algorithmic framework.The proposed problem setting aims to identify specified objects in scenes,and the associated algorithmic framework comprises pseudo data generation and object discovery by request network.Pseudo-data generation generates images resembling natural scenes through various data augmentation rules,using a small number of object samples and scene images.The network structure of object discovery by request utilizes the pre-trained Vision Transformer(ViT)model as the backbone,employs object-centric methods to learn the latent representations of foreground objects,and applies patch-level reconstruction constraints to the model.During the validation phase,we use the generated pseudo datasets as training sets and evaluate the performance of our model on the original test sets.Experiments have proved that our method achieves state-of-the-art performance on Unmanned Aerial Vehicles-Bottle Detection(UAV-BD)dataset and self-constructed dataset Bottle,especially in multi-object scenarios.

Framework to Model User Request Access Patterns in the World Wide Web

In this paper, we present a novel approach to model user request patterns in the World Wide Web. Instead of focusing on the user traffic for web pages, we capture the user interaction at the object level of the web pages. Our framework model consists of three sub-models: one for user file access, one for web pages, and one for storage servers. Web pages are assumed to consist of different types and sizes of objects, which are characterized using several categories: articles, media, and mosaics. The model is implemented with a discrete event simulation and then used to investigate the performance of our system over a variety of parameters in our model. Our performance measure of choice is mean response time and by varying the composition of web pages through our categories, we find that our framework model is able to capture a wide range of conditions that serve as a basis for generating a variety of user request patterns. In addition, we are able to establish a set of parameters that can be used as base cases. One of the goals of this research is for the framework model to be general enough that the parameters can be varied such that it can serve as input for investigating other distributed applications that require the generation of user request access patterns.

Indirectness and Politeness in English Requests

Foreign language teachers may have long observed learners' grammatically correct, yet situationally inappropriate verbal communication. To make sure they conduct speech acts appropriately, language learners should possess communicative skills and pragmatic competence. This paper addresses how to raise learners' pragmatic awareness through making requests in English.By exploring the verbal indirectness and politeness of requests, the paper aims to facilitate learners' ability to make socially appropriate utterances.

基于BeautifulSoup+requests和selenium爬虫网页自动化处理的实现和性能对比

网络爬虫是一种按照一定的规则,自动地抓取网页信息的程序或者脚本,因此编写特定的网络爬虫可以用来对网页进行自动化处理,从而达到提升工作效率的目的。文章针对同一个任务清单系统,分别使用BeautifulSoup+requests和selenium两种不同的爬虫方法实现了网页自动化处理功能。并且通过对两种方法的实现原理和运行结果进行分析,对两种爬虫方法进行对比。

CTCPPre: A prediction method for accepted pull requests in GitHub

As the popularity of open source projects,the volume of incoming pull requests is too large,which puts heavy burden on integrators who are responsible for accepting or rejecting pull requests.An accepted pull request prediction approach can help integrators by allowing them either to enforce an immediate rejection of code changes or allocate more resources to overcome the deficiency.In this paper,an approach CTCPPre is proposed to predict the accepted pull requests in GitHub.CTCPPre mainly considers code features of modified changes,text features of pull requests’description,contributor features of developers’previous behaviors,and project features of development environment.The effectiveness of CTCPPre on 28 projects containing 221096 pull requests is evaluated.Experimental results show that CTCPPre has good performances by achieving accuracy of 0.82,AUC of 0.76 and F1-score of 0.88 on average.It is compared with the state of art accepted pull request prediction approach RFPredict.On average across 28 projects,CTCPPre outperforms RFPredict by 6.64%,16.06%and 4.79%in terms of accuracy,AUC and F1-score,respectively.

Accompanying the Primary Grocery Shopper Is Positively Related to Requests for Purchase of Fruits &Vegetables in Third &Fourth Grade Students

Consumption of fruits and vegetables is important for growth and development yet intake remains below recommended levels in children in the US. The purpose of this study was to determine whether children accompanying the primary grocery shopper impacts requests for fruit and vegetables and if those children requesting fruits and vegetables like to consume them on a daily basis. A cross-sectional survey design of matched pairs of third- and fourth-grade students and their parents/guardians in an urban Midwest school district was utilized. Third- and fourth-grade participants who asked for fruits and vegetables were more likely to accompany the primary grocery shopper and more prone to liking these key foods as part of their regular diet. Grocery shoppers should consider taking children along when food shopping, emphasizing strategies to find a variety of fruits and vegetables.

Relevance of Chest CT Scan Requests in Two University Teaching Hospitals in a Developing Country

Chest investigation is common in hospital practice. Chest X-ray is readily available and usually the first chest investigation. Thoracic CT scan constitutes an alternative and complimentary chest investigation. It is currently the most efficient investigation for the chest and its contents. Objectives: To evaluate the relevance of chest CT Scan requests in two university teaching hospitals in Cameroon. Material and Methods: We conducted a cross-sectional, retrospective and descriptive study at the Radiology and imaging units of the Yaounde Central Hospital and the Yaounde University Teaching Hospital Centre. Included in our study were files of patients who had a chest CT scan investigation during three years. Results: We had a study population of 323 subjects. The age interval was 23 months to 91 years old. Pulmonologist were the most prescribers with 27.2%. We had 80% conformity of indications with French Society of Radiology (FSR) standards. 50 over of 323 indications were not recommended by the FSR. Conclusion: There is a conformity rate of 80% between indications and the FSR recommendations.

Relevance and Compliance of Requests for Dental Panoramic Radiography Examination at Yaounde (Cameroon)

Background: Research studies made in Cameroon on compliance and relevance in the various areas of imaging, show the failure to comply with administrative and clinical criteria. These research studies led to recommendations meant for result amelioration. However, the orthopantomogram (OPT) field remains less studied in that regard in Cameroon. Aim: Evaluate the relevance and compliance of examination requests for panoramic dental radiography. Setting and Design: It is a descriptive cross-sectional study with a consecutive sample of dental panoramic requests identified during the study period in 4 radiology centres of Yaoundé. Material and Methods: Variables studied here were the validity criteria of imaging examination. Request: Five of which are of administrative order (date of the request, requesting department, patient’s identity, patient’s age, applicant’s identity) and three of clinical order (anatomic region, reason for the examination and the purpose of the examination). Statistical Analysis: Chi-squared test was used with confidence interval of 95%. Results: Patient’s identity (name) was the criteria carrying the highest information (98.9%), followed by the name of the applicant physician (91.6%). Out of 179 requests analysed, 8.6% had complete information. 46.4% of requests had no indications. Dental surgeon was the top prescriber with a total of 112 (62.6%). Conclusion: The quality of dental panoramic requests was not optimal in Yaounde, with lack of precision mostly noted at the level of clinical criteria.

The Automatic HTTP Requests Logging and Replaying Subsystem for CMS Plone

In the paper, the problem of storing and replaying of HTTP requests to websites in order to improve their debugging efficiency during development and further support is considered. To solve this problem, the automatic HTTP requests logging and replaying subsystem Dagger that provides storage and playback of the requests sent to a website, which is developed by CMS （content management system） Plone means, is offered. The subsystem consists of the three components： Detector, Logger and Player. Detector detects filters user＇s requests, creates a log and sends it to Logger. Logger is a daemon program that stores logs of user＇s work with a website. The logs are stored in the files in one of the supported formats： JSON, CSV, PICKLE. Player replays the GET and POST HTTP requests that users sent to a server.

Comparison of the Speech Act of Requests between English and Chinese

Here it will make a comparison of the speech act of requests between English and Chinese.And then it is good for people to know and master the skill of making requests.

New ICV standardization requests released

Nine standardization requests were released at the 6th International Symposium on Intelligent and Connected Vehicles(ICV)Technologies,Standards and Regulations jointly held by National Technical Committee of Auto Standardization(SAC/TC 114)and National Technical Standards Innovation Base for Automobiles on September 15-16 in North China's Tianjin municipality.

Variational Pragmatics in Chinese Social Media Requests:The Influence of Gender

In the studies of variational pragmatics(VP),the factor of gender-based difference has not been investigated to a full extent.Gender,without any doubt,is a very vital factor influencing the production of requests while researches about this are very few in number.This paper studied the influence of gender in terms of making requests in WeChat and this study included 22 Chinese participants who were divided into two groups based on their gender,11 males and 11 females.There were in total 61 requests collected from the WeChat.And the results showed that the female group preferred to use indirect strategies while the male group preferred direct strategies.

Chinese Learners'Realization of Requests in English

Requests are face-threatening in nature and closely related to politeness strategies.The present paper makes an attempt to investigate the realization of requests by the Chinese learners of English to see whether they commit some pragmatic failures in common with other subjects invested,and whether the Chinese learners demonstrate some unique characteristics in realizing requests.

Simple requests

Match the information on the left with the requests on the right.1.I want to keep these papers in one place.2.I need to speak to you before the meeting tonight.

Textile Machinery Sector Takes on Economic Crisis,but Requests Urgent Measures

Preliminary year-end 2008 figures for Italy’s textile machinery industry register a 18% drop in production compared to the previous year,with a total production value estimated at 2,285 billion Euros.This decline affects both Italy’s domestic market and export sales.