watercrawl/WaterCrawl

turn web pages into LLM-ready data with WaterCrawl

API that crawls a website and gives you clean data or markdown for LLMs
mendableai/firecrawl
web scraping server for LLMs with JavaScript rendering and batch processing
mendableai/firecrawl-mcp-server
extract structured data from any webpage using LLMs
mishushakov/llm-scraper
turn websites into markdown for LLMs
supermemoryai/markdowner
browser extension to copy webpages as clean Markdown for LLMs
jatinkrmalik/LLMFeeder
llms-txt adds a /llms.txt file to sites for language model access
AnswerDotAI/llms-txt
multi-engine web crawler for fast, large-scale data extraction
any4ai/AnyCrawl
browser extension to capture, organize, and edit saved web pages
danny0838/webscrapbook
lightweight Python tool for website scraping with LLMs
raznem/parsera
turn any URL into LLM-friendly text with Jina Reader
jina-ai/reader