Repository Showcase
A curated collection of interesting GitHub repositories
hhhuang/CAG
Cache-Augmented Generation for LLMs
Related repos
- speeds up LLMs with fast key-value caching
- semantic cache for LLM queries, speeds up GPT apps, cuts API costs
- a fast, simple key-value cache
- Cache-Control header management
- serialize repo files fast for LLMs
- framework for fast, resource-efficient LLM inference on local hardware
- Ensures LLMs follow instructions
- sandboxed LLM file operations with NESL syntax
- modern ls replacement with plugins and git integration
