3
请教一下， GoogleBot 抓取的方式跟控制台调试有关吗？
source link: https://www.v2ex.com/t/845762
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
一个 Ban 控制台的脚本： https://github.com/fz6m/console-ban
我这边简单试了一下，把回调定为发送 IP 给服务器保存日志。结果记录了一大堆 googlebot 的 IP
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK