vllm/quantization at 55712941e57bcfd662db2905811d6e2807b9153f - vllm - 丝路新云-代码仓

xinyun/vllm

mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 11:26:15 +08:00

History

Lucas Wilkinson 55712941e5

[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (#6852 )

2024-07-27 02:27:44 +00:00

..

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

compressed_tensors

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (#6852 )

2024-07-27 02:27:44 +00:00

[Bugfix][Kernel] Promote another index to int64_t (#6838 )

2024-07-26 18:41:04 +00:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612 )

2024-07-21 19:41:42 -04:00

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612 )

2024-07-21 19:41:42 -04:00

[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047 )

2024-06-09 16:23:30 -04:00