mostlygeek/llama-swap

auto-switches llama.cpp models for OpenAI API requests

Python bindings for running Llama.cpp models and serving OpenAI-like APIs
abetlen/llama-cpp-python
framework for connecting your data to LLM apps
run-llama/llama_index
Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format
BerriAI/litellm
unifies OpenAI, Claude, Gemini APIs for LLMs
supermemoryai/llm-bridge
OpenAI-compatible proxy that boosts LLM reasoning accuracy with 20+ optimization techniques, no retraining needed
codelion/optillm
turn home devices into a cluster for faster llama inference
b4rtaz/distributed-llama
OpenAI API proxy server with multi-key rotation and load balancing, built in Go
tbphp/gpt-load
Browser-LLM auto-scaling technology for serving web-browsing AI with an OpenAI-compatible API and streaming
stanford-mast/blast
API code, client, server, docs, config from OpenAPI spec
OpenAPITools/openapi-generator
run Llama 2 models in pure C with a single file
karpathy/llama2.c