Local Models with llama.cpp
Finds GGUF builds on the Hub, picks a quantization for your hardware and runs them locally with llama.cpp as an OpenAI-style server.
Install
- 1
Get Haarness
Free and open source. Skip this step if Haarness is already on your computer.
Free and open source. Skip this step if Haarness is already on your computer.
Free and open source. Skip this step if Haarness is already on your computer.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
- 2
Add Local Models with llama.cpp
Run this in a terminal. Add --global to install for every project, or --local for this project only.
haarness marketplace install skill haarness/huggingface-local-models
Notes
From huggingface/skills (skills/huggingface-local-models), by huggingface. Licence: Apache-2.0. Haarness keeps it in sync with the repository; installs update themselves.
Details
- Publisher
- Haarness
- Version
- v1
- License
- Apache-2.0
- Visibility
- public
- Updated
- Source
- github.com/huggingface/skillsskills/huggingface-local-models · mainKept in sync · 25910b3
Versions
- v1