xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 08:04:58 +08:00
Code Issues Packages Projects Releases Wiki Activity

[FIX] Fix prefix test error on main (#3286)

Browse Source
This commit is contained in:
Zhuohan Li 2024-03-08 17:16:14 -08:00 committed by GitHub
parent c2c5e0909a
commit f48c6791b7
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/layers/attention/backends/flash_attn.py
View File

@ -103,8 +103,6 @@ class FlashAttentionBackend:
key_cache,
value_cache,
input_metadata,
self.num_heads,
self.num_kv_heads,
self.alibi_slopes,
)
else: