Home > Backend Development > PHP Tutorial > Comparison of php file_get_contents and curl() functions_PHP tutorial

Comparison of php file_get_contents and curl() functions_PHP tutorial

WBOY
Release: 2016-07-13 10:44:47
Original
1211 people have browsed it

In PHP, both the file_get_contents and curl() functions can be used to grab data from the other party’s website and save it to the local server, but in general, file_get_contents() is slightly less efficient. Commonly used failure situations and curl() efficiency It is quite advanced and supports multi-threading, but you need to enable the curl extension, which means that to use the curl function, you must enable the curl extension, and the file_get_contents function system is the default.

The following are the steps to enable curl extension:

1. Copy the three files php_curl.dll, libeay32.dll, and ssleay32.dll under the PHP folder to system32;
2. Remove the semicolon from extension=php_curl.dll in php.ini (c:WINDOWS directory);

3. Restart apache or IIS.

Let’s first look at simple examples of two functions

curl() function

The code is as follows Copy code
 代码如下 复制代码

$ch = curl_init("http://www.bKjia.c0m/");
curl_exec($ch);
curl_close($ch);

//$ch = curl_init("要采集的网址");  curl_init()函数的作用初始化一个curl会话

//curl_exec($ch);执行$ch

//curl_close($ch); 关闭$ch

$ch = curl_init("http://www.bKjia.c0m/");

curl_exec($ch); curl_close($ch);

//$ch = curl_init("URL to be collected"); The function of curl_init() function initializes a curl session

//curl_exec($ch); execute $ch
 代码如下 复制代码
echo file_get_contents("http://www.hzhuti.com");
?>

//curl_close($ch); Close $ch

 代码如下 复制代码

This is a test file with test text.

file_get_contents function

Example

The code is as follows Copy code
echo file_get_contents("http://www.hzhuti.com");
?>
Output:

The code is as follows Copy code

This is a test file with test text.
Summary
 代码如下 复制代码

$config['context'] = stream_context_create(array('http' => array('method' => "GET",'timeout' => 5))); 


fopen / file_get_contents will re-do the DNS query for each request and does not cache the DNS information.

But CURL will automatically cache DNS information. Requests for web pages or images under the same domain name only require one DNS query. This greatly reduces the number of DNS queries.
 代码如下 复制代码
file_get_contents(http://***): failed to open stream… 
So the performance of CURL is much better than fopen/file_get_contents. file_get_contents and curl efficiency and stability issues
The code is as follows Copy code
$config['context'] = stream_context_create(array('http' => array('method' => "GET",'timeout' => 5)));
'timeout' => 5//This timeout is unstable and often difficult to use. At this time, if you look at the server's connection pool, you will find a bunch of errors similar to the following, which will give you a headache:

As a last resort, I installed the curl library and wrote a function replacement:

curl_setopt($ch, CURLOPT_REFERER,_REFERER_); //Set referer curl_setopt($ch,CURLOPT_FOLLOWLOCATION,1); //Track 301
The code is as follows
 代码如下 复制代码

function curl_get_contents($url)  
{  
   $ch = curl_init();  
   curl_setopt($ch, CURLOPT_URL, $url);            //设置访问的url地址  
   //curl_setopt($ch,CURLOPT_HEADER,1);            //是否显示头部信息  
   curl_setopt($ch, CURLOPT_TIMEOUT, 5);           //设置超时  
   curl_setopt($ch, CURLOPT_USERAGENT, _USERAGENT_);   //用户访问代理 User-Agent  
   curl_setopt($ch, CURLOPT_REFERER,_REFERER_);        //设置 referer  
    curl_setopt($ch,CURLOPT_FOLLOWLOCATION,1);      //跟踪301  
    curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);        //返回结果  
    $r = curl_exec($ch);  
    curl_close($ch);  
    return $r;  

Copy code



function curl_get_contents($url) {
 代码如下 复制代码

1.2.31319094  
2.2.30374217  
3.2.21512604  
4.3.30553889  
5.2.30124092 

curl使用的时间:

1.0.68719101  
2.0.64675593  
3.0.64326  
4.0.81983113  
5.0.63956594 

$ch = curl_init();

curl_setopt($ch, CURLOPT_URL, $url); //Set the accessed url address
//curl_setopt($ch,CURLOPT_HEADER,1); //Whether to display header information

curl_setopt($ch, CURLOPT_TIMEOUT, 5); //Set timeout
 代码如下 复制代码

< ?php
function vita_get_url_content($url) {
if(function_exists('file_get_contents')) {
$file_contents = file_get_contents($url);
} else {
$ch = curl_init();
$timeout = 5;
curl_setopt ($ch, CURLOPT_URL, $url);
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt ($ch, CURLOPT_CONNECTTIMEOUT, $timeout);
$file_contents = curl_exec($ch);
curl_close($ch);
}
return $file_contents;
}
?>

curl_setopt($ch, CURLOPT_USERAGENT, _USERAGENT_); //User access agent User-Agent
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1); //return result $r = curl_exec($ch);

curl_close($ch);

Return $r; So no more problems other than real network issues. Here is a test of curl and file_get_contents done by others: Number of seconds file_get_contents takes to crawl google.com:
The code is as follows Copy code
1.2.31319094 2.2.30374217 3.2.21512604
4.3.30553889
5.2.30124092 Time used by curl: 1.0.68719101 2.0.64675593 3.0.64326 4.0.81983113 5.0.63956594 So how to use file_get_contents or curl() according to the server situation? Below we can use the function_exists function to determine whether PHP supports a function. We can easily write the following function
The code is as follows Copy code
< ?php <🎜> function vita_get_url_content($url) { <🎜> if(function_exists('file_get_contents')) { <🎜> $file_contents = file_get_contents($url); <🎜> } else { <🎜> $ch = curl_init(); <🎜> $timeout = 5; <🎜> curl_setopt ($ch, CURLOPT_URL, $url); <🎜> curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1); <🎜> curl_setopt ($ch, CURLOPT_CONNECTTIMEOUT, $timeout); <🎜> $file_contents = curl_exec($ch); <🎜> curl_close($ch); <🎜> } <🎜> return $file_contents; <🎜> } <🎜> ?> http://www.bkjia.com/PHPjc/633083.htmlwww.bkjia.comtruehttp: //www.bkjia.com/PHPjc/633083.htmlTechArticleIn php, the file_get_contents and curl() functions can be used to grab the data of the other party's website and save it to the local server , but generally speaking, file_get_contents() is slightly less efficient and often fails...
Related labels:
source:php.cn
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Popular Tutorials
More>
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template