SageMaker Serving Images
Picks the right serving container (Hugging Face vLLM, TEI, DJL) and image URI for a SageMaker endpoint, with known pitfalls.
Install
- 1
Get Haarness
Free and open source. Skip this step if Haarness is already on your computer.
Free and open source. Skip this step if Haarness is already on your computer.
Free and open source. Skip this step if Haarness is already on your computer.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
Haarness installs on a computer. Open this page there to continue, or use it in the cloud below.
- 2
Add SageMaker Serving Images
Run this in a terminal. Add --global to install for every project, or --local for this project only.
haarness marketplace install skill haarness/hf-cloud-serving-image-selection
Notes
From huggingface/skills (skills/hf-cloud-serving-image-selection), by huggingface. Licence: Apache-2.0. Haarness keeps it in sync with the repository; installs update themselves.
Details
- Publisher
- Haarness
- Version
- v1
- License
- Apache-2.0
- Visibility
- public
- Updated
- Source
- github.com/huggingface/skillsskills/hf-cloud-serving-image-selection · mainKept in sync · 25910b3
Versions
- v1