huggingface/text-generation-inference
Toolkit for serving and running large language models through an inference server
View on index · View in 3D Map
Related repos
- Fast text embeddings inference server for popular open source models
- Serve LLMs, speech, and multimodal models with one command
- open-source DeepSeek-R1 reproduction project for reasoning models
- compact multilingual AI model with long context and dual reasoning modes
- parallel training for language models with dataset prep and programmatic access
- speech-to-speech pipeline using open models for voice detection, transcription, language modeling, and speech synthesis
- Structured text generation library for language models
- large language model tutorials and training basics from scratch
- Large language model using diffusion for text generation
- AIBrix manages and scales large language model inference in the cloud for enterprise and developer workloads
