php 匹配博客目录里的文章链接
最近在写爬虫练手,但是发现匹配出来数据很少
以博客园为例,这个是我的正则
<code>/http\:\/\/www\.cnblogs\.com\/' . $name . '\/[^\" ]+.html/i </code>
然后匹配这位同学:http://www.cnblogs.com/hoojo/default.html?page=1
发现只有42条数据,但是这位同学明显不止42篇文章,请问如何优化我的正则
回复内容:
最近在写爬虫练手,但是发现匹配出来数据很少
以博客园为例,这个是我的正则
<code>/http\:\/\/www\.cnblogs\.com\/' . $name . '\/[^\" ]+.html/i </code>
然后匹配这位同学:http://www.cnblogs.com/hoojo/default.html?page=1
发现只有42条数据,但是这位同学明显不止42篇文章,请问如何优化我的正则
首先,你这个http://www.cnblogs.com/hoojo/default.html?page=1 只是第一页,第一页好像只有这么多篇文章吧?http://www.cnblogs.com/hoojo/default.html?page=2 是第二页。
首先,你要确定他的博客里面有多少页。你就从第二页http://www.cnblogs.com/hoojo/default.html?page=2 取它的总页数共6页: 上一页 1 2 3 4 5 6
,再在你原来的代码外面加个 for 循环
http://www.cnblogs.com/hoojo/default.html?page={$page_number}
这样就好了。
不太懂您的正则写法。
我数了下第一页一共50条文章,然后我是这么实现的:
<code><?php $aa = file_get_contents('http://www.cnblogs.com/hoojo/default.html?page=1'); preg_match_all ("|class=\"postTitle2\" href=\"(.*)\">|i", $aa, $m); var_dump($m[1]); </code>
这样的结果就是文章链接数组了。
在测试过程中发现文章作者会把其他文章链接写在摘要里,并且被显示。所以您的方法会把摘要内的链接也读出来。
我这里是用文章原文链接的特性获取到的链接。
希望能够帮到你。

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics

In this chapter, we will understand the Environment Variables, General Configuration, Database Configuration and Email Configuration in CakePHP.

PHP 8.4 brings several new features, security improvements, and performance improvements with healthy amounts of feature deprecations and removals. This guide explains how to install PHP 8.4 or upgrade to PHP 8.4 on Ubuntu, Debian, or their derivati

To work with date and time in cakephp4, we are going to make use of the available FrozenTime class.

To work on file upload we are going to use the form helper. Here, is an example for file upload.

In this chapter, we are going to learn the following topics related to routing ?

CakePHP is an open-source framework for PHP. It is intended to make developing, deploying and maintaining applications much easier. CakePHP is based on a MVC-like architecture that is both powerful and easy to grasp. Models, Views, and Controllers gu

Visual Studio Code, also known as VS Code, is a free source code editor — or integrated development environment (IDE) — available for all major operating systems. With a large collection of extensions for many programming languages, VS Code can be c

Validator can be created by adding the following two lines in the controller.
