From 637093ae26953f20aef328424e4307826820efe4 Mon Sep 17 00:00:00 2001 From: Nir Date: Thu, 14 Aug 2025 22:56:54 +0300 Subject: [PATCH] docs: update fastsafetensors usage instructions (#22891) Signed-off-by: Nir Levy --- docs/models/extensions/fastsafetensor.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/docs/models/extensions/fastsafetensor.md b/docs/models/extensions/fastsafetensor.md index 531d58690014..2a5a18102dc2 100644 --- a/docs/models/extensions/fastsafetensor.md +++ b/docs/models/extensions/fastsafetensor.md @@ -2,4 +2,5 @@ Loading Model weights with fastsafetensors =================================================================== Using fastsafetensors library enables loading model weights to GPU memory by leveraging GPU direct storage. See [their GitHub repository](https://github.com/foundation-model-stack/fastsafetensors) for more details. -For enabling this feature, set the environment variable ``USE_FASTSAFETENSOR`` to ``true`` + +To enable this feature, use the ``--load-format fastsafetensors`` command-line argument