使用curl抓取一个网页出现瓶颈解决办法
Jun 13, 2016 am 11:48 AM
使用curl抓取一个网页出现瓶颈
http://www.sgs.gov.cn/lz/etpsInfo.do?method=index
这个网站
输入上海科波勒之后查询后可以得到
点击查看详情后他发送了一个post到http://www.sgs.gov.cn/lz/etpsInfo.do?method=viewDetail
$etpsId = 290000032004051700672
用curl总是返回非法的访问方式,
我设置了refer,设置了setcookie都还是不成。哪位大神能解决吗
------解决方案--------------------
跳转打开
模拟浏览器参数加上
所有的参数都要提交清楚
如果目标页面有对提交的IP做判断,那就直接死心吧.
------解决方案--------------------

Hot Article

Hot tools Tags

Hot Article

Hot Article Tags

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics

Solution: Your organization requires you to change your PIN

How to adjust window border settings on Windows 11: Change color and size

How to enable or disable taskbar thumbnail previews on Windows 11

How to change title bar color on Windows 11?

OOBELANGUAGE Error Problems in Windows 11/10 Repair

10 Ways to Adjust Brightness on Windows 11

How to realize the mutual conversion between CURL and python requests in python
