InternLM/lmdeploy
Compresses, deploys, and serves LLMs
View on index · View in 3D Map
Related repos
- Compress prompts up to 20x while keeping LLM performance intact
- Resources for running LLMs on local hardware
- lightweight LLM framework for code and agents
- Curated list of tools for running LLMs locally
- LM Studio CLI tool to manage, automate, and script local LLM workflows from the terminal
- Runs LLMs offline on computers
- Build and train custom RL environments for LLM agents with modular tools and easy integration
- run local LLMs in JavaScript or TypeScript
- run local LLMs and tools with one command
