kyuz0/amd-r9700-ai-toolboxes
Containers for LLMs on AMD Radeon GPUs
View on index · View in 3D Map
Related repos
- Container for serving LLMs on AMD Radeon R9700 GPUs
- Runs LLMs on AMD NPUs
- system container and virtual machine manager for Linux containers and VMs
- Armbian build scripts and tools for running on Amlogic S9xxx and similar ARMboxes
- Resources for running LLMs on local hardware
- containerized server for fetching web content for LLMs
- Python toolkit for building LLM and RAG apps with lots of small, specialized models
- Run 70B LLMs on a 4GB GPU with layer-wise inference and memory optimization, quantization optional
- Notebooks for building neural networks and LLM systems from scratch
- GPU kernels written from scratch
