What does it mean that mongodb has few remote links? You can install mongodb on the server yourself
Crawlers mainly require high downlink bandwidth. In fact, using an external server is not a good choice. Once the IP is blocked, there is no way to change it. I used to crawl several machines on the intranet, and then did port mapping on the intranet so that I could check the status externally. Finally, after the crawling is completed, the index is imported into the database and then synchronized to the external network.
What does it mean that mongodb has few remote links? You can install mongodb on the server yourself
Crawlers mainly require high downlink bandwidth. In fact, using an external server is not a good choice. Once the IP is blocked, there is no way to change it.
I used to crawl several machines on the intranet, and then did port mapping on the intranet so that I could check the status externally.
Finally, after the crawling is completed, the index is imported into the database and then synchronized to the external network.