lemonade-sdk/lemonade
local LLM serving with GPU and NPU acceleration
View on index · View in 3D Map
Related repos
- Generates playable retro-style games with LLMs
- Runs LLMs on AMD NPUs
- List of open-source LLMs with commercial-friendly licenses
- GPU kernels written from scratch
- Resources for running LLMs on local hardware
- run local LLMs fast on consumer GPUs with flexible quantization
- Scales Unsloth to multiple GPUs with pure PyTorch DDP
- SDR based radio app with GPU acceleration
- Hardware-accelerated GPU terminal emulator
- PydanticAI: Build AI apps with Pydantic and LLMs
