mascanho/RustySEO
Crawls websites without limits and parses Apache and Nginx server logs
View on index · View in 3D Map
Related repos
- site crawler and analyzer for SEO, security, performance, accessibility
- web crawler for running big crawls or saving a single web page
- Scrapes websites and automates browsers
- Scans crawled URLs for secrets, tokens, and endpoints
- Mimics browsers for scraping and parses HTML to Markdown
- Nginx log analyzer and explorer
- site crawler with GUI for SEO, security, and performance checks
- Honeypot server to track attackers and crawlers
- PHP class for detecting thousands of bots and crawlers
- Mimics browser fingerprints to bypass bot detection
