Introduction
The openbench CLI provides a simple, powerful interface for running benchmark evaluations across 15+ model providers. All commands follow a consistent pattern and provide detailed feedback.Command Structure
All openbench commands follow this pattern:Available Commands
eval
Run a benchmark evaluation
eval-retry
Retry a failed evaluation
list
List all available benchmarks with descriptions
describe
Get detailed information about a specific benchmark
view
View previous evaluation results