python - csdn crawler review

Question

https://github.com/xchaoinfo/fuck-login/blob/master/015 CSDN/csdn.py

According to the comments on lines 87-88, why does it need to be converted into this link when using a crawler to comment on csdn articles? How did this link come about? I looked at the web page code and there was no relevant link. I checked it on Baidu. There are no relevant articles in the information.

Answer 1

Understand it, click on this button, the data will be transmitted through the interface, the author directly from

http://blog.csdn.net/marksinoberg/article/digg?ArticleId=69569353

Get the json data here, and then get the like and dislike data

Answer 2

Capture the packet. The best way is to do it manually first. During the operation, use the packet capture tool to capture the packet and look at its request address.
When writing a crawler, you must learn to capture packets! When writing a crawler, you must learn to capture packets! When writing a crawler, you must learn to capture packets! Say important things three times