watercrawl/WaterCrawl

turn web pages into LLM-ready data with WaterCrawl

View on index · View in 3D Map

Related repos

• Converts websites into markdown for LLMs
• Self-hostable crawler that turns websites into LLM-ready markdown
• API that crawls a website and gives you clean data or markdown for LLMs
• Automate web scraping spider creation with LLMs
• Converts webpages to LLM-friendly text
• Extracts website data for agents
• Converts websites into markdown for LLMs
• web scraping server for LLMs with JavaScript rendering and batch processing
• extract structured data from any webpage using LLMs