If scrapy wants to crawl the content of the entire website, does it need to get the URLs of all pages into the queue before starting to extract the content?
Laical2020-04-30 16:05:00
0
0
1035
scrapy If you want to crawl the entire site, do you need to get the URLs of all pages into the queue before starting to extract the content?
![[Web front-end] Node.js quick start](https://img.php.cn/upload/course/000/000/067/662b5d34ba7c0227.png)
