How to crawl Baidu pages and corresponding strings in php-PHP Tutorial-php.cn

Home

Backend Development

PHP Tutorial

How to crawl Baidu pages and corresponding strings in php

Jun 11, 2018 pm 05:36 PM

php Obtain

This article mainly introduces the method of php to obtain Baidu included, Baidu hot words and Baidu snapshots. It analyzes the techniques of php to capture Baidu pages and corresponding string analysis with examples. It is of great practical value. Friends who need it can refer to it.

The example in this article describes the method of using PHP to obtain Baidu included, Baidu hot words and Baidu snapshots. The details are as follows:

Get Baidu included:

&lt;?php
/*
抓取百度收录代码
*/
function baidu($s){
 $baidu=&quot;http://www.baidu.com/s?wd=site%3A&quot;.$s;
 $site=file_get_contents($baidu);
 //$site=iconv(&quot;gb2312&quot;, &quot;UTF-8&quot;, $site);
 ereg(&quot;找到相关网页(.*)篇，&quot;, $site,$count);
 $count=str_replace(&quot;找到相关网页&quot;,&quot;&quot;,$count);
 $count=str_replace(&quot;篇，&quot;,&quot;&quot;,$count);
 $count=str_replace(&quot;约&quot;,&quot;&quot;,$count);
 $count=str_replace(&quot;,&quot;,&quot;&quot;,$count);
 return $count[0];
}
echo baidu(www.jb51.net);
 //获取脚本之家在百度中的收录数量
?&gt;

Copy after login

Get Baidu’s hot words

&lt;?php 
/** 
* @return array 返回百度的热词数据(数组返回) 
*/ 
function getBaiduHotKeyWord()
{
$templateRss = file_get_contents(&#39;http://top.baidu.com/rss_xml.php?p=top10&#39;);
if (preg_match(&#39;/&lt;table&gt;(.*)&lt;\/table&gt;/is&#39;, $templateRss, $_description)) {
$templateRss = $_description [0];
$templateRss = str_replace(&quot;&amp;&quot;, &quot;&amp;&quot;, $templateRss);
}
$templateRss = &quot;&lt;?xml version=1.0 encoding=GBK?&gt;&quot; . $templateRss;
$xml = @simplexml_load_String($templateRss);
foreach ($xml-&gt;tbody-&gt;tr as $temp) {
if (!empty ($temp-&gt;td-&gt;a)) {
$keyArray [] = trim(($temp-&gt;td-&gt;a));
}
}
return $keyArray;
}
print_r(getBaiduHotKeyWord());

Copy after login

This is what I found online and was slightly modified. Write the following code into the php file
Baidu included and Baidu snapshot time

&lt;?php
 $domain = &quot;//www.jb51.net/&quot;; *欲查询的域名*/
 $site_url = &#39;http://www.baidu.com/s?wd=site%3A&#39;;
 $all = $site_url.$domain; /*域名所有收录的网址*/
 $today = $all.&#39;&amp;lm=1&#39;; /*域名今日收录的网址*/
 $utf_pattern = &quot;/找到相关结果数(.*)个/&quot;;
 $kz_pattern = &quot;/&lt;span class=&quot;g&quot;&gt;(.*)&lt;/span&gt;/&quot;; /*用以匹配快照日期的字符串*/
 $times = &quot;/d{4}-d{1,2}-d{1,2}/&quot;; /*匹配快照日期的正则表达式，如:2011-8-4*/
 $s0 = @file_get_contents($all); /*将site:www.jb51.net的网页置入$s0字符串中*/
 $s1 = @file_get_contents($today);
 preg_match($utf_pattern,$s0,$all_num); /*匹配&quot;找到相关结果数*个&quot;*/
 preg_match($utf_pattern,$s1,$today_num);
 preg_match($kz_pattern,$s0,$temp);
 preg_match($times,$temp[0],$screenshot);
 if($all_num[1] == &quot;&quot;)
  $all_num[1] = 0;
 if($today_num[1] == &quot;&quot;)
  $today_num[1] = 0;
 if($screenshot[0] == &quot;&quot;)
  $screenshot[0] = &quot;暂无快照&quot;;
?&gt;
&lt;html&gt;
 &lt;head&gt;
 &lt;title&gt;Test&lt;/title&gt;
 &lt;/head&gt;
&lt;body&gt;
 &lt;table&gt;
 &lt;tr&gt;
  &lt;td&gt;日期&lt;/td&gt;&lt;td&gt;百度收录&lt;/td&gt;&lt;td&gt;百度今日收录&lt;/td&gt;&lt;td&gt;百度快照日期&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
  &lt;td&gt;&lt;?php echo date(&#39;m月d日G时&#39;);?&gt; &lt;/td&gt;&lt;td&gt;
  &lt;?php echo $all_num[1]; ?&gt;&lt;/td&gt;&lt;td&gt;
  &lt;?php echo $today_num[1]; ?&gt;&lt;/td&gt;&lt;td&gt;
  &lt;?php echo $screenshot[0]; ?&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;/table&gt;
 &lt;p&gt;百度收录：&lt;a href=&quot;&lt;?php echo $all; ?&gt;&quot; target=&quot;_blank&quot;&gt;
 &lt;?php echo $all_num[1]; ?&gt;&lt;/a&gt;&lt;/p&gt;
 &lt;p&gt;百度今日收录：&lt;a href=&quot;&lt;?php echo $today; ?&gt;&quot; target=&quot;_blank&quot;&gt;
 &lt;?php echo $today_num[1]; ?&gt;&lt;/a&gt;&lt;/p&gt;
 &lt;p&gt;百度快照日期：&lt;a href=&quot;&lt;?php echo $all; ?&gt;&quot;&gt;
 &lt;?php echo $screenshot[0]; ?&gt;&lt;/a&gt;&lt;/p&gt;
&lt;/body&gt;
&lt;/html&gt;

Copy after login

Summary: The above is the entire content of this article, I hope it will be helpful to everyone's study.

Related recommendations:

php method to implement multi-dimensional array traversal and unset deletion

php implementation for Tips for copying and moving files

php method to capture Thunder VIP accounts based on the collection class Snoopy

The above is the detailed content of How to crawl Baidu pages and corresponding strings in php. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website

The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn