mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-10 04:05:01 +08:00
[doc] small fix (#19167)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
This commit is contained in:
parent
b2fac67130
commit
78dcf56cb3
@ -10,7 +10,7 @@ shorter Pod startup times and CPU memory usage. Tensor encryption is also suppor
|
|||||||
|
|
||||||
For more information on CoreWeave's Tensorizer, please refer to
|
For more information on CoreWeave's Tensorizer, please refer to
|
||||||
[CoreWeave's Tensorizer documentation](https://github.com/coreweave/tensorizer). For more information on serializing a vLLM model, as well a general usage guide to using Tensorizer with vLLM, see
|
[CoreWeave's Tensorizer documentation](https://github.com/coreweave/tensorizer). For more information on serializing a vLLM model, as well a general usage guide to using Tensorizer with vLLM, see
|
||||||
the [vLLM example script](https://docs.vllm.ai/en/latest/examples/tensorize_vllm_model.html).
|
the [vLLM example script](https://docs.vllm.ai/en/latest/examples/others/tensorize_vllm_model.html).
|
||||||
|
|
||||||
!!! note
|
!!! note
|
||||||
Note that to use this feature you will need to install `tensorizer` by running `pip install vllm[tensorizer]`.
|
Note that to use this feature you will need to install `tensorizer` by running `pip install vllm[tensorizer]`.
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user