mostlygeek/llama-swap
auto-switches llama.cpp models for OpenAI API requests
View on index · View in 3D Map
Related repos
- Python bindings for running Llama.cpp models and serving OpenAI-like APIs
- framework for connecting your data to LLM apps
- Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format
- unifies OpenAI, Claude, Gemini APIs for LLMs
- OpenAI-compatible proxy that boosts LLM reasoning accuracy with 20+ optimization techniques, no retraining needed
- turn home devices into a cluster for faster llama inference
- OpenAI API proxy server with multi-key rotation and load balancing, built in Go
- Community .NET library for OpenAI API
- Browser-LLM auto-scaling technology for serving web-browsing AI with an OpenAI-compatible API and streaming
- API code, client, server, docs, config from OpenAPI spec
