xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-04-02 17:07:08 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Misc] VLLM_TARGET_DEVICE.lower() (#22101)

Browse Source 
Signed-off-by: NickLucche <nlucches@redhat.com>
This commit is contained in:
Nicolò Lucchesi 2025-08-02 04:41:40 +02:00 committed by GitHub
parent ee2eb6ecd8
commit 57393715e8
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/envs.py
View File

@ -213,7 +213,7 @@ environment_variables: dict[str, Callable[[], Any]] = {
# Target device of vLLM, supporting [cuda (by default),
# rocm, neuron, cpu]
"VLLM_TARGET_DEVICE":
lambda: os.getenv("VLLM_TARGET_DEVICE", "cuda"),
lambda: os.getenv("VLLM_TARGET_DEVICE", "cuda").lower(),
# Maximum number of compilation jobs to run in parallel.
# By default this is the number of CPUs