mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-21 07:35:01 +08:00
[CI/Build] fix doc build warning: Failed to get 'name: description' pair (#25733)
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io> Signed-off-by: yewentao256 <zhyanwentao@126.com>
This commit is contained in:
parent
9e6628ccfc
commit
e82e3b55f6
@ -71,8 +71,8 @@ class NgramProposer:
|
|||||||
Args:
|
Args:
|
||||||
valid_ngram_requests:
|
valid_ngram_requests:
|
||||||
Set of indices of requests that need ngram proposals.
|
Set of indices of requests that need ngram proposals.
|
||||||
num_tokens_no_spec:
|
num_tokens_no_spec:
|
||||||
Numpy array of shape (batch_size,) representing the number
|
Numpy array of shape (batch_size,) representing the number
|
||||||
of tokens without speculative tokens for each request.
|
of tokens without speculative tokens for each request.
|
||||||
token_ids_cpu:
|
token_ids_cpu:
|
||||||
Numpy array of shape (batch_size, max_model_len)
|
Numpy array of shape (batch_size, max_model_len)
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user