If scrapy wants to crawl the content of the entire website, does it need to get the URLs of all pages into the queue before starting to extract the content?
Laical2020-04-30 16:05:00
0
0
1014
scrapy If you want to crawl the entire site, do you need to get the URLs of all pages into the queue before starting to extract the content?