xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-02 13:27:33 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix][Model] Attempt to fix eagle in V0. (#18978)

Browse Source 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
This commit is contained in:
Gregory Shtrasberg 2025-06-02 11:15:53 -04:00 committed by GitHub
parent 20133cfee2
commit ca2f6b9c30
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/config.py
View File

@ -2595,7 +2595,8 @@ class SpeculativeConfig:
else:
eagle_config = EAGLEConfig(
self.draft_model_config.hf_config,
method=self.method)
method=self.method,
model_type="eagle")
self.draft_model_config.hf_config = eagle_config
if (self.num_speculative_tokens is not None