75
妈妈再也不用担心爬虫被封号了！手把手教你搭建Cookies池
source link: https://juejin.im/post/5acc5b2ef265da239d49a155
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
很多时候，在爬取没有登录的情况下，我们也可以访问一部分页面或请求一些接口，因为毕竟网站本身需要做SEO，不会对所有页面都设置登录限制。但是，不登录直接爬取会有一些弊端，弊端主要有以下两点。设置了登录限制的页面无法爬取。如某论坛设置了登录才可查看资源，某博客设置
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK