TecharoHQ/anubis

Blocks bot scrapers by requiring proof-of-work on HTTP requests

web scraping and browser automation with Crawlee
apify/crawlee
Build web scrapers with AI assistance
ScrapeGraphAI/scrapecraft
Self-hosted web scraping solution, without writing code
jaypyles/Scraperr
tips for scraping the web without getting blocked
niespodd/browser-fingerprinting
AI-powered web scraper with export options, stealth, and Tor support
itsOwen/CyberScraper-2077
curl that mimics real browsers for web scraping
lwthiker/curl-impersonate
Swiss Army knife for web scraping and browser automation
omkarcloud/botasaurus
payloads and bypasses for web security and pentests
swisskyrepo/PayloadsAllTheThings
Burp Suite extension for bypassing TLS-based bot detection
PortSwigger/bypass-bot-detection
web scraping library with headless browsing, browser automation, and proxy rotation
daijro/hrequests