Detailed explanation of python's requests module with examples

This article brings you relevant knowledge about python, which mainly introduces related issues of the requests module. The Requests module is a module used for network requests, mainly used to simulate browsers. Send a request, hope it helps everyone.

Recommended learning: python learning tutorial

The Requests module is a module used for network requests, mainly used for Simulate the browser to send a request . In fact, there are many similar modules, such as urllib, urllib2, httplib, httplib2. They basically provide similar functions. However, these modules are complex and almost outdated. The requests module is simple, powerful and efficient, making it stand out among many network request modules.

requests use

Environment installation: pip install requests

Usage process:

• Specify url
• Send a request based on the requests module
• Get the data value in the response object
• Persistent storage (not necessary)

Case: Crawl Baidu homepage Data

#1. 导包
import requests
#2. 指定url
url = "https://www.baidu.com"
#3. 使用GET方法发送请求，该方法会返回一个响应对象
response = requests.get(url=url)
#4. 获取响应数据
print(response.status_code)  # 打印状态码
print(response.url)          # 打印请求url
print(response.headers)      # 打印响应头头信息
print(response.text)         #以文本形式打印网页源码

#保存数据
response.encoding = 'utf-8'  #指定编码格式，不然打开乱码
text = response.text
with open('./2.html','w',encoding='utf-8') as f:
    f.write(text)

Solution to the Chinese garbled problem of data requested by requests——》The problem of Chinese garbled content returned by requests

requests request method

In the above case, requests sent a GET request method, in addition to other request methods. The most commonly used methods are GET and POST.

• res = requests.get ()
• res = requests.post ()
• res = requests.put ()
• res = requests.delete ()
• res = requests.head ()
• res = requests.options ()

and in the specified method When sending a request, sometimes you need to specify some parameters in requests.get(url=url, xx = xx) in the request method brackets, as follows. First understand

##FilefilesCookiescookiesRedirect processingallow_ redirects = False/True##TimeoutCertificate VerificationWorkflow (delayed download)Event Hooks##AuthenticationProxiesrequests response object properties

method	parameter name
HTTP headers	headers
GET parameters	params
##POST parameters	data
timeout
verify = False/True
stream=False/ True
hooks=dict(response=)
auth=
proxies=

When crawling the Baidu homepage above, response = requests.get(url=url) returns a response object, and if When we want to obtain specific data such as response code or web page source code, we need to obtain it by specifying the properties of the response object. Such as response.status_code to get the response code

Get the request url                                                                                                                                   status code code

Response data (in string form) Res. Text

• Return to a native string, which is Bytes type Res. Content
## View server response head Res. Headers
• ## see Cookie Res.Cookies
• Recommended learning:
python tutorial

The above is the detailed content of Detailed explanation of python's requests module with examples. For more information, please follow other related articles on the PHP Chinese website!