comet-ml/opik

Open-source platform for evaluating and optimizing LLM apps

Opik MCP server for IDE integration and unified access to prompts, projects, traces, metrics
comet-ml/opik-mcp
Benchmark for LLMs on software engineering tasks
openai/SWELancer-Benchmark
toolkit for evaluating and optimizing LLM and RAG apps
explodinggradients/ragas
Open-source unified API for integrating data sources with LLMs
panoratech/Panora
Open source platform for developing, monitoring, and debugging LLM apps
langfuse/langfuse
minimal LLM chat app runs in your browser, supports Ollama and OpenAI, multi-server, text and vision models
fmaclen/hollama
OpenAI-compatible proxy that boosts LLM reasoning accuracy with 20+ optimization techniques, no retraining needed
codelion/optillm
Open-source tools for running and improving LLM applications—gateway, observability, data feedback, optimization
tensorzero/tensorzero
Open-source LLMOps platform for building and managing LLM apps
Agenta-AI/agenta