FastFlowLM/FastFlowLM

Runs LLMs on AMD NPUs

View on index · View in 3D Map

Related repos

• Resources for running LLMs on local hardware
• Orchestrates parallel function calling for LLMs
• 1-bit LLM inference on CPUs and GPUs with BitNet
• Runs LLMs offline on computers
• GUI for interacting with local LLMs
• Fine-tunes LLMs on Apple silicon
• Containers for LLMs on AMD Radeon GPUs
• Python toolkit for building LLM and RAG apps with lots of small, specialized models
• run local LLMs fast on consumer GPUs with flexible quantization
• local LLM serving with GPU and NPU acceleration