xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 03:15:20 +08:00
Code Issues Packages Projects Releases Wiki Activity

[CI/Build] fix doc build warning: Failed to get 'name: description' pair (#25733)

Browse Source 
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
This commit is contained in:
yitingdc 2025-09-26 16:18:02 +08:00 committed by GitHub
parent 392edee34a
commit 3edf87d25f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
vllm/v1/spec_decode/ngram_proposer.py
View File

@ -71,8 +71,8 @@ class NgramProposer:
Args:
valid_ngram_requests:
Set of indices of requests that need ngram proposals.
num_tokens_no_spec:
Numpy array of shape (batch_size,) representing the number
num_tokens_no_spec:
Numpy array of shape (batch_size,) representing the number
of tokens without speculative tokens for each request.
token_ids_cpu:
Numpy array of shape (batch_size, max_model_len)