jxlil/scrapy-impersonate

Scrapy download handler to impersonate browser TLS signatures

View on index · View in 3D Map

Related repos

• curl that mimics real browsers for web scraping
• A curl fork that mimics Chrome, Edge, Safari, and Firefox for web requests
• Orchestrates proxies into one endpoint
• Blocks bot scrapers by requiring proof-of-work on HTTP requests
• Self-hosted web scraping solution, without writing code
• Scrapes websites into markdown using remote browsers
• Python framework for web crawling and scraping with customizable spiders
• browser extension to copy webpages as clean Markdown for LLMs
• Scrapes websites while bypassing bot protections
• Identifies anti-bot systems and browser fingerprinting techniques