xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-08-15 21:21:20 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Docs] Update EAGLE example (#20375)

Browse Source 
Signed-off-by: NickLucche <nlucches@redhat.com>
This commit is contained in:
Nicolò Lucchesi 2025-07-03 02:13:51 +02:00 committed by GitHub
parent 657f2f301a
commit 3dd359147d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
docs/features/spec_decode.md
View File

@ -201,6 +201,7 @@ an [EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency)](https
speculative_config={ speculative_config={
"model": "yuhuili/EAGLE-LLaMA3-Instruct-8B", "model": "yuhuili/EAGLE-LLaMA3-Instruct-8B",
"draft_tensor_parallel_size": 1, "draft_tensor_parallel_size": 1,
"num_speculative_tokens": 2,
}, },
) )