96

跟繁琐的命令行说拜拜!Gerapy分布式爬虫管理框架来袭! | 静觅

 6 years ago
source link: https://cuiqingcai.com/4959.html?
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
背景 用 Python 做过爬虫的小伙伴可能接触过 Scrapy,GitHub:https://github.com/scrapy/scrapy。Scrapy 的确是一个非常强大的爬虫框架,爬取效率高,扩展性好,基本上是使用 Python 开发爬虫的必备利器。如果使用 Scrapy

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK