BlinkDL/RWKV-LM

RNN meets transformer for efficient large language models

reinforcement learning library for training large language models, supports many RL algorithms, integrates with LLM tools, scales to models with up to 671B parameters
volcengine/verl
run large language models on any device
mlc-ai/mlc-llm
minimal repo for language model policy optimization with RL
kvfrans/lmpo
builds a transformer-based language model from scratch in Rust
tekaratzas/RustGPT
litgpt: tools to train, finetune, and run large language models from the command line
Lightning-AI/litgpt
Code and tutorials for building large language models from scratch in PyTorch
rasbt/LLM-workshop-2024
Code for large-scale depth-recurrent language model training
seal-rg/recurrent-pretraining
toolkit for compressing and deploying large language models
InternLM/lmdeploy
large language model tutorials and training basics from scratch
datawhalechina/happy-llm
Large language model using diffusion for text generation
ML-GSAI/LLaDA