jundot/omlx

LLM inference server for Apple Silicon

View on index · View in 3D Map

Related repos

• Tutorial for building LLMs on Apple Silicon
• LLM training framework for Apple Silicon
• local AI server for Apple Silicon, OpenAI and Anthropic API compatible
• Open-source toolkit for building scalable LLM inference infrastructure
• Fine-tunes LLMs on Apple Silicon
• Fine-tunes LLMs on Apple silicon
• Open-source LLM observability platform
• Resources for running LLMs on local hardware
• Matches LLM models to hardware specifications
• Benchmark for LLMs on software engineering tasks