CURL抓取失败请教

WBOY
Freigeben: 2016-06-23 14:38:47
Original
1441 Leute haben es durchsucht

问个问题哈~
用curl抓取不到这个页面的数据~请教一下方法
http://mybus.xiamentd.com/LineDetailQuery?lineId=118&direction=1
thx!


回复讨论(解决方案)

根据返回的头调整你的程序

$url = 'http://mybus.xiamentd.com/LineDetailQuery?lineId=118&direction=1';print_r(get_headers($url));
Nach dem Login kopieren
Nach dem Login kopieren
Array(    [0] => HTTP/1.1 302 Moved Temporarily    [1] => Server: nginx    [2] => Date: Tue, 03 Dec 2013 12:00:53 GMT    [3] => Content-Length: 0    [4] => Connection: close    [5] => Set-Cookie: JSESSIONID=8852C73A784F0B95C9DE7FB33812EDA0; Path=/    [6] => P3P: CP=CAO PSA OUR    [7] => Set-Cookie: HttpOnly=true    [8] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3FlineId%3D118%26direction%3D1%26random%3D1386072053450; Path=/    [9] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [10] => HTTP/1.1 302 Moved Temporarily    [11] => Server: nginx    [12] => Date: Tue, 03 Dec 2013 12:00:53 GMT    [13] => Content-Type: text/html;charset=utf-8    [14] => Content-Length: 0    [15] => Connection: close    [16] => Set-Cookie: Wcity_xm=4F706AE207628F6A3DE165FA08BE9E20; Path=/; HttpOnly    [17] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [18] => HTTP/1.1 302 Moved Temporarily    [19] => Server: nginx    [20] => Date: Tue, 03 Dec 2013 12:00:53 GMT    [21] => Content-Length: 0    [22] => Connection: close    [23] => Set-Cookie: JSESSIONID=09C8413DA570C390ED8F9F1346C1D78E; Path=/    [24] => P3P: CP=CAO PSA OUR    [25] => Set-Cookie: HttpOnly=true    [26] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3Freturn%3D2%26tel%3Dnull%26model%3Dnull%26random%3D1386072053965; Path=/    [27] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [28] => HTTP/1.1 302 Moved Temporarily    [29] => Server: nginx    [30] => Date: Tue, 03 Dec 2013 12:00:54 GMT    [31] => Content-Type: text/html;charset=utf-8    [32] => Content-Length: 0    [33] => Connection: close    [34] => Set-Cookie: Wcity_xm=E1C22FC11A9DC09587B66D224257D91C; Path=/; HttpOnly    [35] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [36] => HTTP/1.1 302 Moved Temporarily    [37] => Server: nginx    [38] => Date: Tue, 03 Dec 2013 12:00:54 GMT    [39] => Content-Length: 0    [40] => Connection: close    [41] => Set-Cookie: JSESSIONID=B3034C324C287382DED4EF07D81CA04F; Path=/    [42] => P3P: CP=CAO PSA OUR    [43] => Set-Cookie: HttpOnly=true    [44] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3Freturn%3D2%26tel%3Dnull%26model%3Dnull%26random%3D1386072054419; Path=/    [45] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [46] => HTTP/1.1 302 Moved Temporarily    [47] => Server: nginx    [48] => Date: Tue, 03 Dec 2013 12:00:54 GMT    [49] => Content-Type: text/html;charset=utf-8    [50] => Content-Length: 0    [51] => Connection: close    [52] => Set-Cookie: Wcity_xm=C38E38FF759C0707F5D45057227AA363; Path=/; HttpOnly    [53] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [54] => HTTP/1.1 302 Moved Temporarily    [55] => Server: nginx    [56] => Date: Tue, 03 Dec 2013 12:00:54 GMT    [57] => Content-Length: 0    [58] => Connection: close    [59] => Set-Cookie: JSESSIONID=CEA724315DE5284BA898B7BDED29BAB8; Path=/    [60] => P3P: CP=CAO PSA OUR    [61] => Set-Cookie: HttpOnly=true    [62] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3Freturn%3D2%26tel%3Dnull%26model%3Dnull%26random%3D1386072054876; Path=/    [63] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [64] => HTTP/1.1 302 Moved Temporarily    [65] => Server: nginx    [66] => Date: Tue, 03 Dec 2013 12:00:55 GMT    [67] => Content-Type: text/html;charset=utf-8    [68] => Content-Length: 0    [69] => Connection: close    [70] => Set-Cookie: Wcity_xm=8A85502B900F458662118B57E5CEA9A5; Path=/; HttpOnly    [71] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [72] => HTTP/1.1 302 Moved Temporarily    [73] => Server: nginx    [74] => Date: Tue, 03 Dec 2013 12:00:55 GMT    [75] => Content-Length: 0    [76] => Connection: close    [77] => Set-Cookie: JSESSIONID=5BE8764088155917F3F2EB96D785244E; Path=/    [78] => P3P: CP=CAO PSA OUR    [79] => Set-Cookie: HttpOnly=true    [80] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3Freturn%3D2%26tel%3Dnull%26model%3Dnull%26random%3D1386072055352; Path=/    [81] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [82] => HTTP/1.1 302 Moved Temporarily    [83] => Server: nginx    [84] => Date: Tue, 03 Dec 2013 12:00:55 GMT    [85] => Content-Type: text/html;charset=utf-8    [86] => Content-Length: 0    [87] => Connection: close    [88] => Set-Cookie: Wcity_xm=D152A1B50778E8C4B541694ABFC67B4F; Path=/; HttpOnly    [89] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [90] => HTTP/1.1 302 Moved Temporarily    [91] => Server: nginx    [92] => Date: Tue, 03 Dec 2013 12:00:55 GMT    [93] => Content-Length: 0    [94] => Connection: close    [95] => Set-Cookie: JSESSIONID=7FB9C88B0499882CB2E6020EF71CD936; Path=/    [96] => P3P: CP=CAO PSA OUR    [97] => Set-Cookie: HttpOnly=true    [98] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3Freturn%3D2%26tel%3Dnull%26model%3Dnull%26random%3D1386072055777; Path=/    [99] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [100] => HTTP/1.1 302 Moved Temporarily    [101] => Server: nginx    [102] => Date: Tue, 03 Dec 2013 12:00:56 GMT    [103] => Content-Type: text/html;charset=utf-8    [104] => Content-Length: 0    [105] => Connection: close    [106] => Set-Cookie: Wcity_xm=14DE39508CA07769CDA8E7ABC0A0E74C; Path=/; HttpOnly    [107] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [108] => HTTP/1.1 302 Moved Temporarily    [109] => Server: nginx    [110] => Date: Tue, 03 Dec 2013 12:00:56 GMT    [111] => Content-Length: 0    [112] => Connection: close    [113] => Set-Cookie: JSESSIONID=A32F3833ADFDF773B3F097A76EFC682A; Path=/    [114] => P3P: CP=CAO PSA OUR    [115] => Set-Cookie: HttpOnly=true    [116] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3Freturn%3D2%26tel%3Dnull%26model%3Dnull%26random%3D1386072056242; Path=/    [117] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [118] => HTTP/1.1 302 Moved Temporarily    [119] => Server: nginx    [120] => Date: Tue, 03 Dec 2013 12:00:56 GMT    [121] => Content-Type: text/html;charset=utf-8    [122] => Content-Length: 0    [123] => Connection: close    [124] => Set-Cookie: Wcity_xm=4016ABA220428B15BFE4AD64599830A9; Path=/; HttpOnly    [125] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [126] => HTTP/1.1 302 Moved Temporarily    [127] => Server: nginx    [128] => Date: Tue, 03 Dec 2013 12:00:56 GMT    [129] => Content-Length: 0    [130] => Connection: close    [131] => Set-Cookie: JSESSIONID=65B7BF224ECE837BF5E1DDC9C170E3FE; Path=/    [132] => P3P: CP=CAO PSA OUR    [133] => Set-Cookie: HttpOnly=true    [134] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3Freturn%3D2%26tel%3Dnull%26model%3Dnull%26random%3D1386072056735; Path=/    [135] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [136] => HTTP/1.1 302 Moved Temporarily    [137] => Server: nginx    [138] => Date: Tue, 03 Dec 2013 12:00:57 GMT    [139] => Content-Type: text/html;charset=utf-8    [140] => Content-Length: 0    [141] => Connection: close    [142] => Set-Cookie: Wcity_xm=32F478E1B2F062FD1E6737996280A263; Path=/; HttpOnly    [143] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [144] => HTTP/1.1 302 Moved Temporarily    [145] => Server: nginx    [146] => Date: Tue, 03 Dec 2013 12:00:57 GMT    [147] => Content-Length: 0    [148] => Connection: close    [149] => Set-Cookie: JSESSIONID=E2DC3FBFC8AF3DB7EA9208D13E3B9AB1; Path=/    [150] => P3P: CP=CAO PSA OUR    [151] => Set-Cookie: HttpOnly=true    [152] => Set-Cookie: CALLBACKURL=http%3A%2F%2Fmybus.xiamentd.com%2FLineDetailQuery%3Freturn%3D2%26tel%3Dnull%26model%3Dnull%26random%3D1386072057198; Path=/    [153] => Location: http://xiamentd.com/getphoneinfo2.do?code=aHR0cDovL215YnVzLnhpYW1lbnRkLmNvbS9MaW5lRGV0YWlsUXVlcnk=    [154] => HTTP/1.1 302 Moved Temporarily    [155] => Server: nginx    [156] => Date: Tue, 03 Dec 2013 12:00:57 GMT    [157] => Content-Type: text/html;charset=utf-8    [158] => Content-Length: 0    [159] => Connection: close    [160] => Set-Cookie: Wcity_xm=96AB72F98012ABF5D1A396EF2259D203; Path=/; HttpOnly    [161] => Location: http://mybus.xiamentd.com/LineDetailQuery?return=2&tel=null&model=null    [162] => HTTP/1.1 302 Moved Temporarily    [163] => Server: nginx.....
Nach dem Login kopieren

根据返回的头调整你的程序

$url = 'http://mybus.xiamentd.com/LineDetailQuery?lineId=118&direction=1';print_r(get_headers($url));
Nach dem Login kopieren
Nach dem Login kopieren
Array(    [0] => HTTP/1.1 302 Moved Temporarily    [1] => Server: nginx    [2] => Date: Tue, 03 Dec 2013 12:00:53 GMT    [3] => Content-Length: 0    [4] => Connection: close    [5] => Set-Cookie: JSESSIONID=8852C73A784F0B95C9DE7FB33812EDA0; Path=/.....
Nach dem Login kopieren


页面好像不停的302 跳转的页面抓取也没数据

所以你要调整你的程序
如有 302 则需要设置 CURLOPT_FOLLOWLOCATION
如有 cookie 需要设置 CURLOPT_COOKIEJAR 和 CURLOPT_COOKIEFILE

活人还能被尿憋死了?

所以你要调整你的程序
如有 302 则需要设置 CURLOPT_FOLLOWLOCATION
如有 cookie 需要设置 CURLOPT_COOKIEJAR 和 CURLOPT_COOKIEFILE

活人还能被尿憋死了?
这两个昨晚试了 但是不行 所以来指教下

$url = 'http://mybus.xiamentd.com/LineDetailQuery?lineId=118&direction=1';$cookie = tempnam('./','cookie');$ch = curl_init($url);curl_setopt($ch,CURLOPT_RETURNTRANSFER,1);curl_setopt($ch,CURLOPT_COOKIEJAR,$cookie);curl_setopt($ch, CURLOPT_FOLLOWLOCATION,1);curl_exec($ch);curl_close($ch);$ch = curl_init($url);curl_setopt($ch,CURLOPT_RETURNTRANSFER,1);curl_setopt($ch,CURLOPT_COOKIEFILE,$cookie);curl_setopt($ch, CURLOPT_FOLLOWLOCATION, 1);$content = curl_exec($ch);echo $content; //空
Nach dem Login kopieren

Verwandte Etiketten:
Quelle:php.cn
Erklärung dieser Website
Der Inhalt dieses Artikels wird freiwillig von Internetnutzern beigesteuert und das Urheberrecht liegt beim ursprünglichen Autor. Diese Website übernimmt keine entsprechende rechtliche Verantwortung. Wenn Sie Inhalte finden, bei denen der Verdacht eines Plagiats oder einer Rechtsverletzung besteht, wenden Sie sich bitte an admin@php.cn
Beliebte Tutorials
Mehr>
Neueste Downloads
Mehr>
Web-Effekte
Quellcode der Website
Website-Materialien
Frontend-Vorlage