abetlen/llama-cpp-python
Python bindings for running Llama.cpp models and serving OpenAI-like APIs
View on index · View in 3D Map
Related repos
- auto-switches llama.cpp models for OpenAI API requests
- Python library for using different language model APIs with one interface
- Async, event-driven orchestration for AI models and APIs
- python library for running and managing local LLMs with simple chat and streaming support
- LLM inference in C/C++ for running and serving models locally on various hardware
- Packs a code repository into a single file for LLMs
- run Llama 2 models in pure C with a single file
- Single HTML file interface for llama.cpp server
- Python toolkit for building LLM and RAG apps with lots of small, specialized models
- framework for connecting your data to LLM apps
