any4ai/AnyCrawl

Extracts data from websites for LLM processing

View on index · View in 3D Map

Related repos

• API that crawls a website and gives you clean data or markdown for LLMs
• Crawls websites into data for LLMs
• Converts websites into markdown for LLMs
• Extracts website data for agents
• extract structured data from any webpage using LLMs
• Scrapes websites with LLMs
• web scraping server for LLMs with JavaScript rendering and batch processing
• Automate web scraping spider creation with LLMs
• Self-hostable crawler that turns websites into LLM-ready markdown