Repository Showcase
A curated collection of interesting GitHub repositories
seal-rg/recurrent-pretraining
Code for large-scale depth-recurrent language model training
Related repos
- large language model tutorials and training basics from scratch
- open-source reinforcement learning for language models
- open notes and guides for training large language models
- reinforcement learning library for training large language models, supports many RL algorithms, integrates with LLM tools, scales to models with up to 671B parameters
- Code completion and generation model
- speech-to-speech pipeline using open models for voice detection, transcription, language modeling, and speech synthesis
- Code and tutorials for building large language models from scratch in PyTorch
- open-weight text-to-speech model for fast, natural voice synthesis
- RNN meets transformer for efficient large language models
- open-source language and vision models with huge context window and hybrid attention
