This website requires JavaScript.
Explore
Help
Sign In
xinyun
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced
2025-12-10 04:44:57 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
vllm
/
benchmark
History
Siyuan (Ryans) Zhuang
e3cec88aa5
Memcpy kernel for flash attention (
#29
)
...
* optimize * add benchmark * add assert * add test
2023-04-10 18:22:49 -07:00
..
benchmark_attention.py
Add query stride to multi_query_cached_kv_attention & Add kernel benchmark script (
#27
)
2023-04-08 13:36:09 -07:00
benchmark_cache.py
Memcpy kernel for flash attention (
#29
)
2023-04-10 18:22:49 -07:00
benchmark_latency.py
Add an option to use dummy model weights (
#33
)
2023-04-08 23:36:12 -07:00
