How Do I Specify a User-Agent Header When Making Requests in Python?

Utilizing Requests Library to Specify "User-agent" in Python

To effectively send a value for the "User-agent" while requesting a webpage using the Python Requests library, it is crucial to ensure that it is included as part of the header. The following code snippet illustrates this approach:

debug = {'verbose': sys.stderr}
user_agent = {'User-agent': 'Mozilla/5.0'}
response  = requests.get(url, headers = user_agent, config=debug)

The "User-agent" is specified as a field in the header using the 'User-agent' key and the desired value. This ensures that the header includes the necessary information for the server to identify the client.

Additional Considerations for Requests Version:

Prior versions of requests library (v2.12.x and below) handled headers differently compared to the newer version (v2.13 and above). For older versions, it was necessary to preserve default headers and then add custom headers to them, as shown below:

import requests

url = 'SOME URL'

# Get a copy of the default headers
headers = requests.utils.default_headers()

# Update headers with custom settings
headers.update({
    'User-Agent': 'My User Agent 1.0',
})

response = requests.get(url, headers=headers)

However, in newer versions of Requests (v2.13 and above), you can directly specify the desired headers without the additional step of preserving default headers.

The above is the detailed content of How Do I Specify a User-Agent Header When Making Requests in Python?. For more information, please follow other related articles on the PHP Chinese website!