mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2026-07-09 22:17:27 +08:00
[Misc] Correct an outdated comment. (#24765)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
This commit is contained in:
parent
59d7ffc17f
commit
4dad72f0d9
@ -260,10 +260,10 @@ class Processor:
|
|||||||
else:
|
else:
|
||||||
# NOTE: engine_level_backend must be "auto" here, because we have
|
# NOTE: engine_level_backend must be "auto" here, because we have
|
||||||
# checked supported_backends above.
|
# checked supported_backends above.
|
||||||
# "auto" is an opt-in to opinionated behavior where we try to
|
# In this mode, we set opinionated defaults based on what we think
|
||||||
# choose a backend based on request contents. This is not the
|
# will satisfy the most use cases without having to worry about
|
||||||
# default as it is less predictable and subject to change
|
# this setting. We include fallback behavior here, but not with any
|
||||||
# between releases as feature support changes.
|
# other setting where a specific backend was specified.
|
||||||
try:
|
try:
|
||||||
validate_xgrammar_grammar(params)
|
validate_xgrammar_grammar(params)
|
||||||
params.guided_decoding.backend = "xgrammar"
|
params.guided_decoding.backend = "xgrammar"
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user