How can I store data from web scraping in Python?

How can I store data from web scraping in Python?

You can store data from web scraping in Python using various methods like CSV files, databases, or JSON files. What format are you considering?

I think I want to use a CSV file. How do I do that?

To store data in a CSV file, you can use the csv module in Python. After scraping, you can write the data like this:

import csv

with open('data.csv', mode='w', newline='') as file:
    writer = csv.writer(file)
    writer.writerow(['Column1', 'Column2'])  # Write headers
    writer.writerow(['Data1', 'Data2'])  # Write data

Would you like to see a complete example?

Yes, please provide a complete example of web scraping and saving to CSV.

Sure! Here's a simple example using BeautifulSoup and requests:

import requests
from bs4 import BeautifulSoup
import csv

url = 'http://example.com'
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')

with open('data.csv', mode='w', newline='') as file:
    writer = csv.writer(file)
    writer.writerow(['Title', 'Link'])  # Write headers
    for item in soup.find_all('a'):
        title = item.get_text()
        link = item['href']
        writer.writerow([title, link])  # Write data

This will scrape all links from the page and save them to a CSV file. Let me know if you have any questions!