How to Fix \'403 Forbidden\' Errors in Python Requests?-Python Tutorial-php.cn

How to Fix \'403 Forbidden\' Errors in Python Requests?

DDD

Release： 2024-11-01 17:04:03

Original

477 people have browsed it

How to Fix

Resolving "403 Forbidden" Errors in API Calls Using Python Requests

When attempting to parse a website using Python's requests library, you may encounter a "403 Forbidden" error. This error typically indicates that the server has rejected your request due to lack of proper authorization or permission.

Error Example

Consider the following code:

<code class="python">url = 'http://worldagnetwork.com/'
result = requests.get(url)
print(result.content.decode())</code>

Copy after login

This code attempts to retrieve and decode the content of the specified URL. However, it produces the following output:

<code class="html"><html>
<head><title>403 Forbidden</title></head>
<body bgcolor="white">
<center><h1>403 Forbidden</h1></center>
<hr><center>nginx</center>
</body>
</html></code>

Copy after login

Root Cause

In this specific case, the problem arises because the server is rejecting GET requests without a User-Agent header. A User-Agent header identifies the browser or application sending the request, which helps the server determine how to handle the request.

Solution

To resolve this issue, explicitly specify a User-Agent header in your requests request. Here's an example:

<code class="python">import requests

url = 'http://worldagnetwork.com/'
headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36'}
result = requests.get(url, headers=headers)
print(result.content.decode())</code>

Copy after login

By setting the User-Agent header to an appropriate value, you can effectively mimic a browser and successfully retrieve the website's content, as demonstrated by the following output:

<code class="html"><!doctype html>
<!--[...]-->
<!--[...]--></code>

Copy after login

The above is the detailed content of How to Fix \'403 Forbidden\' Errors in Python Requests?. For more information, please follow other related articles on the PHP Chinese website!