A Python web scraper that extracts quotes, authors, and tags from quotes.toscrape.com and saves them to CSV.
- Scrapes all pages automatically using pagination logic
- Extracts data - quote text, author name, and tags
- Exports to CSV using Pandas for easy analysis
- Error handling for failed requests and timeouts
- Rate limiting friendly with delay between requests
- Python 3
- Requests - HTTP requests to fetch pages
- BeautifulSoup4 - HTML parsing
- Pandas - Data structuring + CSV export
git clone https://github.com/Shivanshi9522/python-web-scraper.git
cd python-web-scraper
pip install requests beautifulsoup4 pandaspython scraper.pyOutput saved to quotes.csv
- Add CLI args for page limit or specific tag
- Scrape author bio pages
- Export to JSON or SQLite