Repository Showcase
A curated collection of interesting GitHub repositories
efeslab/fiddler
Run unquantized Mixtral-8x7B on a single 24GB GPU
Related repos
- Self-hosted GPU video compressor targeting file sizes
- Run 70B LLMs on a 4GB GPU with layer-wise inference and memory optimization, quantization optional
- Chromium fork with performance tweaks, codec support, and builds for many platforms
- Run huge LLMs with 100k context on an 8GB GPU using SSD offload, no quantization
- DJ software for live mixing on Windows, macOS, and Linux
- run local LLMs fast on consumer GPUs with flexible quantization
- v86: x86 machine emulator running in the browser using JavaScript and WebAssembly
- Lightweight 2D graphics library for modern GPUs
- GPU-accelerated terminal emulator with fast performance and lots of config options
- Lightweight WebAssembly runtime with JIT compilation capabilities
