b4rtaz/distributed-llama

turn home devices into a cluster for faster llama inference

View on index · View in 3D Map

Related repos

• framework for connecting your data to LLM apps
• LLM inference in C/C++ for running and serving models locally on various hardware
• auto-switches llama.cpp models for OpenAI API requests
• Open-source framework designed to streamline the development and deployment of generative AI applications built on top of Meta’sLlama models
• Integrate llama.cpp into Go applications
• run Llama 2 models in pure C with a single file
• React components and a workflow debugger for LlamaIndex
• Survey of data-centric methods for LLMs
• minimal deep learning library that runs LLaMA and Stable Diffusion