Repository Showcase
A curated collection of interesting GitHub repositories
SqueezeAILab/LLMCompiler
Orchestrates parallel function calling for LLMs
Related repos
- Access multiple LLMs through a unified interface
- Orchestration framework for RAG and LLM agents
- Run LLMs across multiple devices
- Build and train custom RL environments for LLM agents with modular tools and easy integration
- minimal 4D-parallelism framework for distributed LLM training and experimentation
- LLM inference in C/C++ for running and serving models locally on various hardware
- plug and play memory layer for LLMs
- run local LLMs and tools with one command
- serialize repo files fast for LLMs
- Open-source toolkit for building scalable LLM inference infrastructure
