xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 21:55:50 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/tests/kernels
History
Siyuan (Ryans) Zhuang e3cec88aa5
Memcpy kernel for flash attention (#29) 
* optimize

* add benchmark

* add assert

* add test
2023-04-10 18:22:49 -07:00
..
activation.py
Optimize data movement (#20)
2023-04-02 00:30:17 -07:00
attention.py
Support block size 32 (#35)
2023-04-09 23:07:18 -07:00
cache.py
Memcpy kernel for flash attention (#29)
2023-04-10 18:22:49 -07:00
layernorm.py
Add custom kernel for RMS normalization (#16)
2023-04-01 00:51:22 +08:00
pos_encoding.py
Optimize data movement (#20)
2023-04-02 00:30:17 -07:00