Repository Showcase
A curated collection of interesting GitHub repositories
xorbitsai/inference
Serve LLMs, speech, and multimodal models with one command
Related repos
- multimodal LLM inference engine in Rust and Python
- Toolkit for serving and running large language models through an inference server
- LLM inference in C/C++ for running and serving models locally on various hardware
- Open-source toolkit for building scalable LLM inference infrastructure
- Fast text embeddings inference server for popular open source models
- Code and tutorials for building large language models from scratch in PyTorch
- Skywork R1V: multimodal reasoning model extending R1-series LLMs to images and text, open-source, efficient transfer, 38B parameters
- curated list of large language model papers, tools, and resources
- Fast LLM inference and serving library
- framework for fast, resource-efficient LLM inference on local hardware
