Repository Showcase
A curated collection of interesting GitHub repositories
abetlen/llama-cpp-python
Python bindings for running Llama.cpp models and serving OpenAI-like APIs
Related repos
- auto-switches llama.cpp models for OpenAI API requests
- Python library for using different language model APIs with one interface
- python library for running and managing local LLMs with simple chat and streaming support
- LLM inference in C/C++ for running and serving models locally on various hardware
- run Llama 2 models in pure C with a single file
- Python toolkit for building LLM and RAG apps with lots of small, specialized models
- framework for connecting your data to LLM apps
- Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format
- CLI for interacting with Model Context Protocol servers and LLMs
- Run open-source or custom language models as OpenAI-style APIs with one command
