Repository Showcase
A curated collection of interesting GitHub repositories
microsoft/BitNet
Inference framework for 1-bit LLMs
Related repos
- Open-source toolkit for building scalable LLM inference infrastructure
- LLM inference in C/C++ for running and serving models locally on various hardware
- lets you plug structured knowledge bases into LLMs for efficient, scalable augmentation
- Fast LLM inference and serving library
- framework for fast, resource-efficient LLM inference on local hardware
- Open cookbook for building top-tier code LLMs with complete training data and reproducible pipeline
- Open-source framework for building stateful LLM applications
- Open-source tools for running and improving LLM applications—gateway, observability, data feedback, optimization
- open-source memory engine for LLMs and AI agents
