Skip to content

Latest commit

 

History

5 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

Quotes Web Scraper

A Python web scraper that extracts quotes, authors, and tags from quotes.toscrape.com and saves them to CSV.

Features

  • Scrapes all pages automatically using pagination logic
  • Extracts data - quote text, author name, and tags
  • Exports to CSV using Pandas for easy analysis
  • Error handling for failed requests and timeouts
  • Rate limiting friendly with delay between requests

Tech Stack

  • Python 3
  • Requests - HTTP requests to fetch pages
  • BeautifulSoup4 - HTML parsing
  • Pandas - Data structuring + CSV export

Installation

git clone https://github.com/Shivanshi9522/python-web-scraper.git
cd python-web-scraper
pip install requests beautifulsoup4 pandas

Usage

python scraper.py

Output saved to quotes.csv

Future Improvements

  1. Add CLI args for page limit or specific tag
  2. Scrape author bio pages
  3. Export to JSON or SQLite

About

Web scraper using Python, Requests & BeautifulSoup to extract quotes from quotes.toscrape.com. Handles pagination, exports to CSV with Pandas.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages