microsoft/LLMLingua
Compress prompts up to 20x while keeping LLM performance intact
View on index · View in 3D Map
Related repos
- Compresses, deploys, and serves LLMs
- markup language for structuring LLM prompts
- automates prompt tuning for LLMs with feedback and example generation
- structured prompt templates for LLMs, like programming for prompts
- speeds up LLMs with fast key-value caching
- lightweight LLM framework for code and agents
- Prompts multiple LLMs at once
- lets you plug structured knowledge bases into LLMs for efficient, scalable augmentation
- test and compare LLM prompts and models locally
- Runs large language models on iOS and macOS
