javascript - How can the front-end prevent collection as much as possible?

WBOY
Release: 2016-09-15 11:30:58
Original
1887 people have browsed it

How can the front-end prevent collection as much as possible? What are some good implementation solutions?

Reply content:

How can the front-end prevent collection as much as possible? What are some good implementation solutions?

Know yourself and know the enemy

Go and learn crawl the websiteor anti-anti-crawler, and then come up with countermeasures one by one, haha

I usually check the referer, but it’s of no use...

Has no one done any research?

Prevent crawlers from crawling? It seems there is no perfect solution

There is no perfect method. There are some auxiliary methods that block the IP based on the number of IP requests, such as 100 visits in a short period of time. . But there are agents, so it’s useless and can only protect against newbies.
There may be concurrency restrictions, one end can only have 10 concurrencies, etc.
In fact, it’s the same, IP proxy + multi-threading still breaks through the concurrency limit, so it’s just for newbies.

Common methods to prevent front-end collection include:

  • ajax obtains data and displays it; general collection does not support js execution

  • Add garbled symbols, but use div and other tags to prevent the garbled characters from being displayed (such as invisible, smallest font size, and the same color as the background color). This method has been used before on the official website of "Reader".

Whoever can achieve the anti-collection effect on the front end, haha, can win the Nobel Prize in Physics -- By phantomjs

Add hidden controls, including url. The one who accesses this url is the machine

Related labels:
source:php.cn
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Popular Tutorials
More>
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template