It is recommended to use the Archer Cloud Crawler. The crawler is completely written and executed on the cloud. There is no need to configure any development environment, and rapid development and implementation are possible.
With just a few lines of javascript, you can implement complex crawlers and provide many functional functions: anti-anti-crawlers, js rendering, data publishing, chart analysis, anti-leeching, etc. These are problems that are often encountered in the process of developing crawlers. The Archer will help you solve it all.
Here is an existing example, you can refer to it: How to crawl business information on Dianping.com (with chestnuts and codes attached) https://www.douban.com/group/...
![[Web front-end] Node.js quick start](https://img.php.cn/upload/course/000/000/067/662b5d34ba7c0227.png)
https://code.google.com/p/web-crawler-cpp/
It is recommended to use the Archer Cloud Crawler. The crawler is completely written and executed on the cloud. There is no need to configure any development environment, and rapid development and implementation are possible.
With just a few lines of javascript, you can implement complex crawlers and provide many functional functions: anti-anti-crawlers, js rendering, data publishing, chart analysis, anti-leeching, etc. These are problems that are often encountered in the process of developing crawlers. The Archer will help you solve it all.
Here is an existing example, you can refer to it:
How to crawl business information on Dianping.com (with chestnuts and codes attached)
https://www.douban.com/group/...