ggml-org/LlamaBarn

Menu bar app to run local LLMs on a Mac

framework for connecting your data to LLM apps
run-llama/llama_index
generate apps from a single prompt with llama 3
Nutlope/llamacoder
Python toolkit for building LLM and RAG apps with lots of small, specialized models
llmware-ai/llmware
Run LLMs across multiple devices
b4rtaz/distributed-llama
run local LLMs and tools with one command
av/harbor
run open LLMs on your computer with a single file
Mozilla-Ocho/llamafile
LLM inference in C/C++ for running and serving models locally on various hardware
ggml-org/llama.cpp
open-source LLMOps platform for running models on your own servers
intentee/paddler
builds Python chat UIs for LLM apps with custom logic
Chainlit/chainlit
open source chat interface for LLMs
huggingface/chat-ui