xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 00:06:06 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/docs/models/extensions/fastsafetensor.md
Nir 637093ae26
docs: update fastsafetensors usage instructions (#22891) 
Signed-off-by: Nir Levy <bhr166@gmail.com>
2025-08-14 19:56:54 +00:00

416 B
Raw Blame History

Loading Model weights with fastsafetensors

Using fastsafetensors library enables loading model weights to GPU memory by leveraging GPU direct storage. See their GitHub repository for more details.

To enable this feature, use the --load-format fastsafetensors command-line argument