rasbt/LLMs-from-scratch

Code and tutorials for building GPT-style language models from the ground up in PyTorch

View on index

Related repos

• Code and tutorials for building large language models from scratch in PyTorch
• minimal PyTorch code for training your own small language model from scratch
• Step-by-step code for adding reasoning to a pre-trained LLM, with hands-on examples and explanations
• large language model tutorials and training basics from scratch
• Code for training and fine-tuning GPT language models
• 3D visualizer for GPT-style language models
• Open cookbook for building top-tier code LLMs with complete training data and reproducible pipeline
• Python toolkit for building LLM and RAG apps with lots of small, specialized models
• Course for learning about large language models using roadmaps and Colab notebooks
• run large language models on any device