基于Cookie的身份认证网站信息采集研究与实现

Research and Realization for Information Collection of Website which Achieve Identity Authentication Based on Cookie Technology

越来越多的需要认证才能访问的网站,对互联网内容安全管控平台中的网络信息采集单元提出了更高的要求。考虑到传统网络信息采集系统在应对身份认证网站时表现出的不足,基于Cookie内容协商机制,首创性地提出了面向身份认证网站发布信息的普适采集方案,并通过系列实验证明该信息采集方案的有效性与实用性。

As the development of Internet technolugy, there are more and more Web pages that can＇t be visited without idemity authentication. In order to implement content security management over these Web pages, the abilities of current information collection unit should be improved. In order to resolve the problem that traditional information collection unit can not retrieve Web page through identity authentication, proposes the project “the Information Collection Unit for the Website which Need Identity Authentication”. After intro-ducing of Cookie technology and Website＇s identity authentication negotiation, adds the Cookie content negotiation mechanism to the original information collection unit to retrieve Web page that the original unit can＇t support. In addition,provides an experiment to prove the effectivity and practicability of the new information collection unit.