web-scraping

@0xdewy

Scrape websites using Playwright for JavaScript-rendered content or requests+BeautifulSoup for static HTML. Provides reliable scraping patterns: handling pagination, login flows, infinite scroll, rate limiting, anti-bot evasion, and data extraction to structured formats (CSV, JSON). Use this skill whenever the user says "scrape", "crawl", "extract data from", "get data from website", "download all pages", "web scraper", "collect data from", "parse HTML", "get all links from", "harvest data", or wants to programmatically collect information from any website — including SPAs, paginated tables, search results, product catalogs, or API-backed sites. Also trigger when the user needs to monitor a page for changes, take screenshots of pages, automate browser interactions, or fill/submit forms programmatically.