xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-16 09:56:09 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Doc] Add xgrammar in doc (#11549)

Browse Source 
Signed-off-by: ccjincong <chenjincong11@gmail.com>
This commit is contained in:
Chen1022 2024-12-27 21:05:10 +08:00 committed by GitHub
parent 7af553ea30
commit 5ce4627a7e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/usage/structured_outputs.md
View File

@ -2,7 +2,7 @@
# Structured Outputs
vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines) or [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer) as backends for the guided decoding.
vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines), [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer), or [xgrammar](https://github.com/mlc-ai/xgrammar) as backends for the guided decoding.
This document shows you some examples of the different options that are available to generate structured outputs.
## Online Inference (OpenAI API)