How to Scrape Amazon.com: 19 Lessons I Learned While Crawling 1MM+ Product Listings In its simplest form, web scraping is about making requests and extracting data from the response. For a small web scraping project, your code can be simple. You just need to find a few patterns in the URLs and in the HTML response and you’re in business. But everything changes when you’re trying to pull over 1,000