Python：使用scrapy下载网站数据

Question

问题描述

我想使用scrapy下载网站数据，并且以原目录结构进行保存，以便可以直接在本地访问，
请问有类似的代码可以参考吗？
注：刚接触scrapy，很多资源不知道在哪里找

Answer 1

I think scrapy’s documentation is good, but I may not be used to callbacks at first.

http://doc.scrapy.org/en/latest/intro/tutorial.html

Someone has written a few examples, but I haven’t read them, so I don’t know how.

https://github.com/geekan/scrapy-examples

Personally, I think you should go through the document first, at least the simple example in the tutorial above, and it will become much easier after that.

Answer 2

There is a blog that talks about a lot of scrapy technology. I suggest you check it out, http://tech.my-coffees.com