openai/evals

framework for testing and benchmarking large language models with custom or built-in evaluations

View on index · View in 3D Map

Related repos

• tools for finetuning language models with instruction datasets and preference optimization
• evaluating large language models across tasks and datasets
• framework for testing language models on benchmarks and tasks
• Run large language models locally, manage and interact with different model types
• Run open-source or custom language models as OpenAI-style APIs with one command
• Benchmark for LLMs on software engineering tasks
• Open-source platform for training, evaluating, and deploying AI models with end-to-end tools
• Toolkit for serving and running large language models through an inference server
• run language models in your browser with webgpu, openai api compatible
• Run AI models, agents, and tools locallywith an OpenAI-compatible API