> ## Documentation Index > Fetch the complete documentation index at: https://openbench.dev/llms.txt > Use this file to discover all available pages before exploring further. # openbench > Provider-agnostic, open-source evaluation infrastructure for language models ## Welcome to openbench! openbench is an open-source framework for standardized, reproducible benchmarking of large language models (LLMs). Our goal is to make evaluation both rigorous and accessible: * Run industry-standard benchmarks easily on any model, wherever it’s hosted. * Design and run evaluations tailored to your specific needs. * Choose from 30+ evaluation suites spanning knowledge, reasoning, coding, mathematics, and more. With openbench, you can build **trust** in model performance through transparent, reproducible, and domain-relevant evaluation. ARC-AGI (with ARC Prize), plugins for external benchmarks, OpenRouter routing, code agents + Exercism, LiveMCPBench tool-calling, MultiChallenge, JSON logs — see the release notes. ## Quick Start Install openbench and run your first benchmark in \< 60 seconds. ## Key Features

All your eval needs accessible from the command line.


*See more on CLI usage. →*

30+ reproducible evaluation suites, and growing.


*See available benchmarks. →*

Shared structure and utilities make it easy to add new evals.


*Learn about our eval structure.* →

 ## Works with Any Model Provider openbench supports 15+ model providers out of the box. Blazing fast inference ```bash theme={null} groq/llama-3.3-70b ``` GPT-4, o3, and more ```bash theme={null} openai/gpt-4o ``` Claude Sonnet & Opus ```bash theme={null} anthropic/claude-3-5-sonnet ``` Gemini models ```bash theme={null} google/gemini-2.5-pro ``` Unified LLM interface ```bash theme={null} openrouter/deepseek/deepseek-chat-v3.1 ``` AWS Bedrock, Azure, Cohere, Together, and more. *See a complete list of supported model providers.* ## Join the Community Star us on GitHub and contribute to the project! Found a bug or have a feature request? Let us know! ## Stay Updated We are rapidly iterating! Sign up below to recieve updates about latest openbench features.