mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2026-05-05 12:31:23 +08:00
[doc] update reasoning doc (#18306)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
This commit is contained in:
parent
9ab2c02ff8
commit
1a8f68bb90
@ -231,13 +231,12 @@ For more examples, please refer to <gh-file:examples/online_serving/openai_chat_
|
|||||||
|
|
||||||
## How to support a new reasoning model
|
## How to support a new reasoning model
|
||||||
|
|
||||||
You can add a new `ReasoningParser` similar to <gh-file:vllm/entrypoints/openai/reasoning_parsers/deepseek_r1_reasoning_parser.py>.
|
You can add a new `ReasoningParser` similar to <gh-file:vllm/reasoning/deepseek_r1_reasoning_parser.py>.
|
||||||
|
|
||||||
```python
|
```python
|
||||||
# import the required packages
|
# import the required packages
|
||||||
|
|
||||||
from vllm.entrypoints.openai.reasoning_parsers.abs_reasoning_parsers import (
|
from vllm.reasoning import ReasoningParser, ReasoningParserManager
|
||||||
ReasoningParser, ReasoningParserManager)
|
|
||||||
from vllm.entrypoints.openai.protocol import (ChatCompletionRequest,
|
from vllm.entrypoints.openai.protocol import (ChatCompletionRequest,
|
||||||
DeltaMessage)
|
DeltaMessage)
|
||||||
|
|
||||||
@ -288,7 +287,7 @@ class ExampleParser(ReasoningParser):
|
|||||||
"""
|
"""
|
||||||
```
|
```
|
||||||
|
|
||||||
Additionally, to enable structured output, you'll need to create a new `Reasoner` similar to the one in <gh-file:vllm/model_executor/guided_decoding/reasoner/deepseek_reasoner.py>.
|
Additionally, to enable structured output, you'll need to create a new `Reasoner` similar to the one in <gh-file:vllm/reasoning/deepseek_r1_reasoning_parser.py>.
|
||||||
|
|
||||||
```python
|
```python
|
||||||
@dataclass
|
@dataclass
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user