Repository Showcase
A curated collection of interesting GitHub repositories
scrapy/scrapy
Python framework for web crawling and scraping with customizable spiders
Related repos
- Python web scraping with built-in browser and proxy support
- Adaptive web scraping for evolving websites
- list of web crawler and spider projects in many languages
- web scraping and browser automation with Crawlee
- AI-powered Python tool for scraping websites and documents
- Build web scrapers with AI assistance
- Self-hosted web scraping solution, without writing code
- lightweight Python tool for website scraping with LLMs
- Distributed web crawler management platform
- simple Python agent framework for browser, research, automation
