xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-18 01:35:48 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Doc] Add xgrammar in doc (#11549)

Browse Source 
Signed-off-by: ccjincong <chenjincong11@gmail.com>
This commit is contained in:
Chen1022 2024-12-27 21:05:10 +08:00 committed by GitHub
parent 7af553ea30
commit 5ce4627a7e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/usage/structured_outputs.md
View File

@ -2,7 +2,7 @@
# Structured Outputs # Structured Outputs
vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines) or [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer) as backends for the guided decoding. vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines), [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer), or [xgrammar](https://github.com/mlc-ai/xgrammar) as backends for the guided decoding.
This document shows you some examples of the different options that are available to generate structured outputs. This document shows you some examples of the different options that are available to generate structured outputs.
## Online Inference (OpenAI API) ## Online Inference (OpenAI API)