Table of Contents
回复讨论(解决方案)
Home Backend Development PHP Tutorial 如何使用php模拟获取百度搜索结果并和百度一样传送给客户端?

如何使用php模拟获取百度搜索结果并和百度一样传送给客户端?

Jun 23, 2016 pm 01:21 PM

【http://m.baidu.com】【以百度移动端为准,我主要测试这个移动端的】
直接模拟链接获取百度搜索结果达到300多KB,推送到客户端浏览器即使用Gzip压缩也要100KB左右,耗时接近1.0s。但是百度自己的第一个get内容到浏览器只有30KB左右。怎样才能和百度一样。试过PHP几种方式获取百度搜索结果但是其实都一样,样式什么都一起加载过来了。
例如:
$url="http://m.baidu.com /s?word=".$kw;
$html=file_get_contents($url);
//$html > 300KB
//Apache开启网页压缩之后发送到浏览器还有97.8KB


第一个get实际上已经有样式了

但是实际百度自己发送的第一个get只有30.3KB,并且第一个get没有样式


如何才能和百度一样,用最快速度推送到客户端浏览器,样式应该是在浏览器端再自己加载的


回复讨论(解决方案)

问题有点长可能没全读懂
刚刚分析了一下百度移动端网页,如果想把300K压缩到30K,有2个关键点:
1:请求的header中需要添加:Accept-Encoding:gzip, deflate, sdch,这样返回了100K,gzip解码搞定
2:带上访问过百度首页的cookie,这样就变30K了。具体做法是先抓一次cookie然后缓存到文件中,需要查询时把这些cookie都带上。

看着有点似懂非懂。你的具体做法是怎样子的呢?能直接贴代码么?
【我上面的问题的意思就是想嵌套一个内百度在我的页面里,但是抓取过来的搜索结果内容我要自己做二次处理再展示出来的意思,但是这个过程发现很耗时,抓取过来第一次消耗的时间,二次处理的时间【这个可以控制】,推送到页面展示这个时间(这个推送文件发现没办法和百度一样很小)】

问题有点长可能没全读懂
刚刚分析了一下百度移动端网页,如果想把300K压缩到30K,有2个关键点:
1:请求的header中需要添加:Accept-Encoding:gzip, deflate, sdch,这样返回了100K,gzip解码搞定
2:带上访问过百度首页的cookie,这样就变30K了。具体做法是先抓一次cookie然后缓存到文件中,需要查询时把这些cookie都带上。


看着有点似懂非懂。你的具体做法是怎样子的呢?能直接贴代码么?
【我上面的问题的意思就是想嵌套一个内百度在我的页面里,但是抓取过来的搜索结果内容我要自己做二次处理再展示出来的意思,但是这个过程发现很耗时,抓取过来第一次消耗的时间,二次处理的时间【这个可以控制】,推送到页面展示这个时间(这个推送文件发现没办法和百度一样很小)】 
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Best Graphic Settings
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. How to Fix Audio if You Can't Hear Anyone
4 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
WWE 2K25: How To Unlock Everything In MyRise
1 months ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

cURL in PHP: How to Use the PHP cURL Extension in REST APIs cURL in PHP: How to Use the PHP cURL Extension in REST APIs Mar 14, 2025 am 11:42 AM

The PHP Client URL (cURL) extension is a powerful tool for developers, enabling seamless interaction with remote servers and REST APIs. By leveraging libcurl, a well-respected multi-protocol file transfer library, PHP cURL facilitates efficient execution of various network protocols, including HTTP, HTTPS, and FTP. This extension offers granular control over HTTP requests, supports multiple concurrent operations, and provides built-in security features.

Explain JSON Web Tokens (JWT) and their use case in PHP APIs. Explain JSON Web Tokens (JWT) and their use case in PHP APIs. Apr 05, 2025 am 12:04 AM

JWT is an open standard based on JSON, used to securely transmit information between parties, mainly for identity authentication and information exchange. 1. JWT consists of three parts: Header, Payload and Signature. 2. The working principle of JWT includes three steps: generating JWT, verifying JWT and parsing Payload. 3. When using JWT for authentication in PHP, JWT can be generated and verified, and user role and permission information can be included in advanced usage. 4. Common errors include signature verification failure, token expiration, and payload oversized. Debugging skills include using debugging tools and logging. 5. Performance optimization and best practices include using appropriate signature algorithms, setting validity periods reasonably,

Explain the concept of late static binding in PHP. Explain the concept of late static binding in PHP. Mar 21, 2025 pm 01:33 PM

Article discusses late static binding (LSB) in PHP, introduced in PHP 5.3, allowing runtime resolution of static method calls for more flexible inheritance.Main issue: LSB vs. traditional polymorphism; LSB's practical applications and potential perfo

Framework Security Features: Protecting against vulnerabilities. Framework Security Features: Protecting against vulnerabilities. Mar 28, 2025 pm 05:11 PM

Article discusses essential security features in frameworks to protect against vulnerabilities, including input validation, authentication, and regular updates.

Customizing/Extending Frameworks: How to add custom functionality. Customizing/Extending Frameworks: How to add custom functionality. Mar 28, 2025 pm 05:12 PM

The article discusses adding custom functionality to frameworks, focusing on understanding architecture, identifying extension points, and best practices for integration and debugging.

How to send a POST request containing JSON data using PHP's cURL library? How to send a POST request containing JSON data using PHP's cURL library? Apr 01, 2025 pm 03:12 PM

Sending JSON data using PHP's cURL library In PHP development, it is often necessary to interact with external APIs. One of the common ways is to use cURL library to send POST�...

What exactly is the non-blocking feature of ReactPHP? How to handle its blocking I/O operations? What exactly is the non-blocking feature of ReactPHP? How to handle its blocking I/O operations? Apr 01, 2025 pm 03:09 PM

An official introduction to the non-blocking feature of ReactPHP in-depth interpretation of ReactPHP's non-blocking feature has aroused many developers' questions: "ReactPHPisnon-blockingbydefault...

See all articles