BlinkDL/RWKV-LM

RNN meets transformer for efficient large language models

View on index · View in 3D Map

Related repos

• reinforcement learning library for training large language models, supports many RL algorithms, integrates with LLM tools, scales to models with up to 671B parameters
• run large language models on any device
• minimal repo for language model policy optimization with RL
• builds a transformer-based language model from scratch in Rust
• litgpt: tools to train, finetune, and run large language models from the command line
• Code and tutorials for building large language models from scratch in PyTorch
• Generates presentations from prompts using large language models
• Code for large-scale depth-recurrent language model training
• toolkit for compressing and deploying large language models
• large language model tutorials and training basics from scratch