watercrawl/WaterCrawl

Crawls websites into data for LLMs

View on index · View in 3D Map

Related repos

• API that crawls a website and gives you clean data or markdown for LLMs
• Converts websites into markdown for LLMs
• Extracts website data for agents
• Self-hostable crawler that turns websites into LLM-ready markdown
• Automate web scraping spider creation with LLMs
• Converts websites into markdown for LLMs
• Scrapes websites with LLMs
• web scraping server for LLMs with JavaScript rendering and batch processing
• extract structured data from any webpage using LLMs