Helicone/helicone

Helicone is an open-source platform to monitor, debug, and manage your LLM apps with features like agent tracing and prompt management

Open source platform for developing, monitoring, and debugging LLM apps
langfuse/langfuse
Open-source LLMOps platform for building and managing LLM apps
Agenta-AI/agenta
OpenLLMetry lets you add observability to your LLM apps using OpenTelemetry, so you can track and monitor model performance across popular platforms
traceloop/openllmetry
tools for building and testing LLM app workflows
microsoft/promptflow
Command-line tool for running prompts and managing outputs with OpenAI, Claude, Gemini, Llama, and more
simonw/llm
cloud-native open-source platform for managing and monitoring LLM operations
pezzolabs/pezzo
Python toolkit for building LLM and RAG apps with lots of small, specialized models
llmware-ai/llmware
AI app for chat with documents, AI agents, multi-user
Mintplex-Labs/anything-llm
monitor and debug AI agents, track LLM costs, integrate with frameworks
AgentOps-AI/agentops