This tutorial demonstrates how to retrieve data from the OpenWeather API using Python and store it in AWS S3. This straightforward method allows you to fetch and cloud-store API data for later use. Even if you're new to this, the steps are clearly outlined. For a different approach using React, see our article on fetching API data with React.
What You Will Learn:
This tutorial covers:
Prerequisites:
Before starting, ensure you have:
Step 1: Creating an AWS S3 Bucket
To store your data, create an S3 bucket:
my-weather-data
).Step 2: Fetching Data from the OpenWeather API
Create an OpenWeather account.
Obtaining Your API Key:
Install the requests
library:
pip install requests
Fetch weather data:
import requests import json api_key = 'YOUR_API_KEY' # Replace with your key city = 'London' def get_weather_data(): url = f'http://api.openweathermap.org/data/2.5/weather?q={city}&appid={api_key}' response = requests.get(url) return response.json() weather_data = get_weather_data() print(weather_data)
This script retrieves current weather data for the specified city.
Step 3: Setting Up the AWS SDK for Python (Boto3)
Install Boto3:
pip install boto3
Configure your AWS credentials following the configuration guide. You'll need your Access Key ID and Secret Access Key.
Step 4: Uploading Data to AWS S3
Set up the S3 client:
import boto3 aws_access_key_id = 'YOUR_ACCESS_KEY' # Replace aws_secret_access_key = 'YOUR_SECRET_KEY' # Replace region_name = 'eu-west-2' # Replace with your region s3 = boto3.client('s3', aws_access_key_id=aws_access_key_id, aws_secret_access_key=aws_secret_access_key, region_name=region_name)
Upload the data:
def upload_to_s3(data): bucket_name = 'my-weather-data' # Replace with your bucket name file_name = 'weather_data.json' s3.put_object(Bucket=bucket_name, Key=file_name, Body=json.dumps(data), ContentType='application/json') print('Upload successful!') upload_to_s3(weather_data)
How it Works:
The script uses requests
to fetch JSON data and boto3
to upload it to your S3 bucket as weather_data.json
.
Step 5: Verifying the Upload
Check your S3 Management Console to confirm the weather_data.json
file is in your bucket.
Conclusion:
This tutorial showed how to fetch and store weather data from OpenWeather API in AWS S3 using Python. This is a valuable technique for managing and accessing API data in the cloud.
The above is the detailed content of How To Get an API Data and Store in AWS S3. For more information, please follow other related articles on the PHP Chinese website!