This website requires JavaScript.
Explore
Help
Sign In
xinyun
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced
2026-05-17 04:02:17 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
vllm
/
vllm
/
attention
History
Noam Gat
c8a7d51c49
[Bugfix] Update flashinfer.py with PagedAttention forwards - Fixes Gemma2 OpenAI Server Crash (
#6501
)
2024-07-18 07:47:13 +00:00
..
backends
[Bugfix] Update flashinfer.py with PagedAttention forwards - Fixes Gemma2 OpenAI Server Crash (
#6501
)
2024-07-18 07:47:13 +00:00
ops
[Kernel][Attention] Separate
Attention.kv_scale
into
k_scale
and
v_scale
(
#6081
)
2024-07-16 15:31:32 -07:00
__init__.py
[Core] Refactor _prepare_model_input_tensors - take 2 (
#6164
)
2024-07-17 09:37:16 -07:00
layer.py
[Kernel][Attention] Separate
Attention.kv_scale
into
k_scale
and
v_scale
(
#6081
)
2024-07-16 15:31:32 -07:00
selector.py
[Core] Refactor _prepare_model_input_tensors - take 2 (
#6164
)
2024-07-17 09:37:16 -07:00