mirror of
https://git.datalinker.icu/deepseek-ai/DeepSeek-R1.git
synced 2025-12-09 13:04:23 +08:00
Merge 853ad9cbf5c838b30bc221b5851276cfdcf77625 into 0cf78561f1d51c84a21b2190626b21116d5c68bb
This commit is contained in:
commit
6840d35ddc
@ -176,6 +176,8 @@ For instance, you can easily start a service using [vLLM](https://github.com/vll
|
||||
```shell
|
||||
vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --max-model-len 32768 --enforce-eager
|
||||
```
|
||||
With `vllm` >= v0.7.1, you can additionally append `--enable-reasoning --reasoning-parser deepseek_r1` to above shell command, for reasoning output parsing.
|
||||
|
||||
|
||||
You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)
|
||||
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user