xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-09-09 14:57:06 +08:00
Code Issues Packages Projects Releases Wiki Activity

task

Browse Source 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
This commit is contained in:
Woosuk Kwon 2025-09-16 01:06:10 -07:00
parent c320a33c59
commit 91510260b2
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/v1/worker/gpu_worker.py
View File

@ -421,6 +421,7 @@ class Worker(WorkerBase):
return self.model_runner.get_model() return self.model_runner.get_model()
def get_supported_tasks(self) -> tuple[SupportedTask, ...]: def get_supported_tasks(self) -> tuple[SupportedTask, ...]:
return "generate"
return self.model_runner.get_supported_tasks() return self.model_runner.get_supported_tasks()
@torch.inference_mode() @torch.inference_mode()