RightNow-AI/picolm

Inference of language models on hardware with limited memory

View on index · View in 3D Map

Related repos

• run large language models on any device
• Gives language models memory during inference
• Toolkit for serving and running large language models through an inference server
• Platform for algorithm design with language models
• Persistent memory infrastructure for AI coding assistants
• open-source memory engine for LLMs and AI agents
• open-source large language model focused on complex reasoning
• Memory management system for AI agents
• Memory system for AI agents
• Executes reasoning paths in parallel with language models