AlexsJones/llmfit

Matches LLM models to hardware specifications

View on index · View in 3D Map

Related repos

• Resources for running LLMs on local hardware
• Tutorial for building LLMs on Apple Silicon
• Compact data format for LLMs
• run large language models on any device
• Fine-tunes LLMs on Apple silicon
• Runs large language models on iOS and macOS
• LLM training framework for Apple Silicon
• Runs LLMs on AMD NPUs
• Runs LLMs over a cluster of GPUs
• LLM inference in C/C++ for running and serving models locally on various hardware