抓取源码 - php抓取网页源码的问题
抓取一般的页面没问题·。
但近期给一个网站个搞晕了·。请大神们帮帮忙看看是什么原因导致失败。谢谢
地址:http://183.36.249.82/
我们学校的图书馆。
我用的代码如下
<code><?php header ( "Content-type: text/html; charset=utf-8" ); $url = "http://183.36.249.82/"; $contents = file_get_contents($url); echo $contents; ?> </code>
但会出现这个错误:
Server Error in '/' Application.
Runtime Error
我用的服务器是SAE。也试过用SAE提供的fetch
功能。
但可惜也是报错。
错误是:string(3) "500" string(21) "Internal Server Error"
多天研究原因不解。求解答。谢谢
回复内容:
抓取一般的页面没问题·。
但近期给一个网站个搞晕了·。请大神们帮帮忙看看是什么原因导致失败。谢谢
地址:http://183.36.249.82/
我们学校的图书馆。
我用的代码如下
<code><?php header ( "Content-type: text/html; charset=utf-8" ); $url = "http://183.36.249.82/"; $contents = file_get_contents($url); echo $contents; ?> </code>
但会出现这个错误:
Server Error in '/' Application.
Runtime Error
我用的服务器是SAE。也试过用SAE提供的fetch
功能。
但可惜也是报错。
错误是:string(3) "500" string(21) "Internal Server Error"
多天研究原因不解。求解答。谢谢
用file_get_contents
抓取的时候,一般要设置一下HTTP context.抓取网页还是用cURL比较好.
<?php $header = <<<HEADER Connection: keep-alive Cache-Control: max-age=0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8 User-Agent: Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/34.0.1847.116 Safari/537.36 DNT: 1 Referer: http://183.36.249.82/ Accept-Encoding: gzip,deflate,sdch Accept-Language: zh-CN,zh;q=0.8 HEADER; $context = stream_context_create(array( 'http' => array( 'method' => 'GET', 'header' => $header, 'timeout' => 10, 'protocol_version' => '1.1', ), )); $contents = file_get_contents('http://183.36.249.82/', false, $context); echo $contents;
你没发现网站要求重定向了吗?是刚学php呢吧?换用curl吧,file_get_contents抓不下来这个的吧(显然我错了,看别人的回答就知道是可以的,没文化真可怕啊)。
给你个参考连接吧,我不想写代码了
http://segmentfault.com/q/1010000000484804#a-1020000000484819
问问题的人虽然问得是ruby的问题,但是人家的php代码估计够你参考用了。

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics



PHP 8.4 brings several new features, security improvements, and performance improvements with healthy amounts of feature deprecations and removals. This guide explains how to install PHP 8.4 or upgrade to PHP 8.4 on Ubuntu, Debian, or their derivati

Working with database in CakePHP is very easy. We will understand the CRUD (Create, Read, Update, Delete) operations in this chapter.

To work with date and time in cakephp4, we are going to make use of the available FrozenTime class.

To work on file upload we are going to use the form helper. Here, is an example for file upload.

In this chapter, we are going to learn the following topics related to routing ?

CakePHP is an open-source framework for PHP. It is intended to make developing, deploying and maintaining applications much easier. CakePHP is based on a MVC-like architecture that is both powerful and easy to grasp. Models, Views, and Controllers gu

Validator can be created by adding the following two lines in the controller.

Logging in CakePHP is a very easy task. You just have to use one function. You can log errors, exceptions, user activities, action taken by users, for any background process like cronjob. Logging data in CakePHP is easy. The log() function is provide
