xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-25 00:04:41 +08:00
Code Issues Packages Projects Releases Wiki Activity

feat(benchmarks): support HF model names in multi-turn benchmark (#27850)

Browse Source
This commit is contained in:
ai-jz 2025-11-01 01:04:52 -07:00 committed by GitHub
parent e675118849
commit 2c0c7c39bd
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
benchmarks/multi_turn/benchmark_serving_multi_turn.py
View File

@ -1429,8 +1429,6 @@ async def main() -> None:
random.seed(args.seed)
np.random.seed(args.seed)
if not os.path.exists(args.model):
raise OSError(f"Path does not exist: {args.model}")
logger.info("Loading tokenizer")
tokenizer = AutoTokenizer.from_pretrained(args.model)