Scrapy — open source web scraping framework for PythonNewAgent Skills for ScrapyCreated by Zyte Turn a URL into a production-ready spider — from Claude Code, GitHub Copilot, or any AI agent. How it works A project built to scaleScrapy scaffolds a full project, not a throwaway script — keeping your spiders, settings, items, and pipelines organized as your crawler grows. Run scrapy startproject to lay it out, then scrapy crawl to run.
