xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-03-21 12:55:48 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,449 Commits 155 Branches 89 Tags
Commit Graph

3 Commits

Author SHA1 Message Date
Tyler Michael Smith
260d119e86
[Kernel] Refactor CUTLASS kernels to always take scales that reside on the GPU (#5137) 2024-06-01 06:45:32 +00:00
Tyler Michael Smith
8674f9880e
[Kernel] Fixup for CUTLASS kernels in CUDA graphs (#4954) 
Pass the CUDA stream into the CUTLASS GEMMs, to avoid future issues with CUDA graphs
 2024-05-22 14:10:43 +00:00
Tyler Michael Smith
2060e93659
[Kernel] Add w8a8 CUTLASS kernels (#4749) 2024-05-16 18:32:50 -04:00