67

GitHub - facert/scrapy_helper: Dynamic configurable crawl (动态可配置化爬虫)

 6 years ago
source link: https://github.com/facert/scrapy_helper?
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

scrapy_helper

Dynamic configurable crawl (动态可配置化爬虫)

Install

  • git clone [email protected]:facert/scrapy_helper.git && cd scrapy_helper
  • virtualenv .env
  • source .env/bin/activate
  • pip install -r requirements.txt
  • python manage.py migrate
  • python manage.py runserver
  • open browser http://127.0.0.1:8000/
  • use test account (username: demo/password: demo ) to login

Online site

http://www.anycrawl.info/

Screenshots

68747470733a2f2f706963332e7a68696d672e636f6d2f76322d63636133376565303834346363653163346137326134663535663263353465375f622e6a7067

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK