xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-17 11:55:49 +08:00
Code Issues Packages Projects Releases Wiki Activity

[FIX] Fix prefix test error on main (#3286)

Browse Source
This commit is contained in:
Zhuohan Li 2024-03-08 17:16:14 -08:00 committed by GitHub
parent c2c5e0909a
commit f48c6791b7
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/layers/attention/backends/flash_attn.py
View File

@ -103,8 +103,6 @@ class FlashAttentionBackend:
key_cache, key_cache,
value_cache, value_cache,
input_metadata, input_metadata,
self.num_heads,
self.num_kv_heads,
self.alibi_slopes, self.alibi_slopes,
) )
else: else: