carlosplanchon/spidercreator
Automate web scraping spider creation with LLMs
View on index · View in 3D Map
Related repos
- extract structured data from any webpage using LLMs
- Scrapes websites with LLMs
- Converts websites into markdown for LLMs
- Python framework for web crawling and scraping with customizable spiders
- Crawls websites into data for LLMs
- Self-hostable crawler that turns websites into LLM-ready markdown
- list of web crawler and spider projects in many languages
- API that crawls a website and gives you clean data or markdown for LLMs
- Self-hosted web scraping solution, without writing code
- Adaptive web scraping for evolving websites
