xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 05:04:58 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/tests/kernels
History
Woosuk Kwon c267b1a02c
Add query stride to multi_query_cached_kv_attention & Add kernel benchmark script (#27) 
* Add query stride to multi_query_cached_kv_attention

* Add kernel benchmark script
2023-04-08 13:36:09 -07:00
..
activation.py
Optimize data movement (#20)
2023-04-02 00:30:17 -07:00
attention.py
Add query stride to multi_query_cached_kv_attention & Add kernel benchmark script (#27)
2023-04-08 13:36:09 -07:00
cache.py
Implement block copy kernel to optimize beam search (#32)
2023-04-07 17:45:07 -07:00
layernorm.py
Add custom kernel for RMS normalization (#16)
2023-04-01 00:51:22 +08:00
pos_encoding.py
Optimize data movement (#20)
2023-04-02 00:30:17 -07:00