This website requires JavaScript.
Explore
Help
Sign In
xinyun
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced
2025-12-10 23:05:21 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
vllm
/
docs
/
source
/
quantization
History
jon-chuang
a046f86397
[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (
#7208
)
...
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
2024-08-12 22:47:41 +00:00
..
auto_awq.rst
[Docs] Update the AWQ documentation to highlight performance issue (
#1883
)
2023-12-02 15:52:47 -08:00
bnb.rst
[bitsandbytes]: support read bnb pre-quantized model (
#5753
)
2024-07-23 23:45:09 +00:00
fp8_e4m3_kvcache.rst
[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (
#7208
)
2024-08-12 22:47:41 +00:00
fp8_e5m2_kvcache.rst
[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (
#7208
)
2024-08-12 22:47:41 +00:00
fp8.rst
[Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (
#5975
)
2024-07-03 17:38:00 +00:00
supported_hardware.rst
[Doc] Update supported_hardware.rst (
#7276
)
2024-08-07 14:21:50 -07:00
