ggml-org/ggml
tensor library for machine learning with support for hardware acceleration and model inference
View on index · View in 3D Map
Related repos
- Open-source tools for running and improving LLM applications—gateway, observability, data feedback, optimization
- Neural network library in C from scratch
- open-source reimplementation of Google’s TensorProcessing Unit by UC Santa Barbara ArchLab
- DeepEP — communication library for Mixture-of-Experts and expert parallelism, with all-to-all GPU kernels and low-precision support
- NumPy-based machine learning algorithms built from scratch for learning and transparency
- TensorTrade: Python framework for building trading algorithms with reinforcement learning
- Python framework for fast GPU simulation and graphics
- C++ library for robotics and vision smoothing, mapping, and sensor fusion
- Benchmarks LLMs for end-to-end machine learning workflows
- LLM inference in C/C++ for running and serving models locally on various hardware
