microsoft/BitNet

Inference framework for 1-bit LLMs

View on index · View in 3D Map

Related repos

• Open-source toolkit for building scalable LLM inference infrastructure
• Builds knowledge through conversations with LLMs
• Runs LLMs on AMD NPUs
• LLM inference in C/C++ for running and serving models locally on various hardware
• Benchmarks LLMs for end-to-end machine learning workflows
• lets you plug structured knowledge bases into LLMs for efficient, scalable augmentation
• Fast LLM inference and serving library
• Resources for running LLMs on local hardware
• Builds IoT applications with .NET