bench cache command helps manage OpenBench’s caches, particularly for LiveMCPBench. It provides tools to inspect, list, and clear cached data stored under ~/.openbench.
Overview
Currently, LiveMCPBench is the primary evaluation that uses caching. It stores:- Embedding indexes for LiveMCPTool
- Annotated task data
- Other evaluation assets
Subcommands
info
Display cache information and storage sizes:ls
List cache contents with various viewing options:clear
Remove cached data with flexible targeting:Cache Location
All cache data is stored under~/.openbench/ in your home directory. This location is consistent across different evaluations and provides centralized cache management.