Repository Showcase
A curated collection of interesting GitHub repositories
BruceDone/awesome-crawler
list of web crawler and spider projects in many languages
Related repos
- Python framework for web crawling and scraping with customizable spiders
- curated list of AI tools for web automation and agents
- list of tools for searching the web using AI
- Collection of web development and programming resource links from the community
- web scraping and browser automation with Crawlee
- Distributed web crawler management platform
- CLI tool for crawling sites and mapping endpoints
- List of search engines for finding cybersecurity, vulnerability, and hacking info
- cybersecurity resources, writeups, tools, and awesome links
- Collection of useful React resources and links
