Local Model Evals
Runs inspect-ai or lighteval benchmarks against Hub models on your own GPU, with vLLM, Transformers or accelerate backends.
Install
- 1
Get Haarness
Free and open source. Skip this step if Haarness is already on your computer.
Free and open source. Skip this step if Haarness is already on your computer.
Free and open source. Skip this step if Haarness is already on your computer.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
- 2
Add Local Model Evals
Run this in a terminal. Add --global to install for every project, or --local for this project only.
haarness marketplace install skill haarness/huggingface-community-evals
Notes
From huggingface/skills (skills/huggingface-community-evals), by huggingface. Licence: Apache-2.0. Haarness keeps it in sync with the repository; installs update themselves.
Details
- Publisher
- Haarness
- Version
- v1
- License
- Apache-2.0
- Visibility
- public
- Updated
- Source
- github.com/huggingface/skillsskills/huggingface-community-evals · mainKept in sync · 25910b3
Versions
- v1