光阴似箭催人老,日月如移越少年。
Turn off Lanten~
Answer source address: CSDN blog: Scrapy usage problems
At the end of the answer, it is mentioned that proxy problems cause some websites to be inaccessible. The solution is to modify it in settings.py: DOWNLOADER_MIDDLEWARES = {
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware': None,
}
After testing and modification, the program can run
It should be that Lanten has changed the system's proxy, causing your crawler to be forced to use this proxy IP to access
Turn off Lanten~
Answer source address: CSDN blog: Scrapy usage problems
At the end of the answer, it is mentioned that proxy problems cause some websites to be inaccessible. The solution is to modify it in settings.py:
DOWNLOADER_MIDDLEWARES = {
}
After testing and modification, the program can run
It should be that Lanten has changed the system's proxy, causing your crawler to be forced to use this proxy IP to access