xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-12 19:25:31 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/docs/features/quantization/README.md
Harry Mellor b942c094e3
Stop using title frontmatter and fix doc that can only be reached by search (#20623) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2025-07-08 03:27:40 -07:00

535 B
Raw Blame History

Quantization

Quantization trades off model precision for smaller memory footprint, allowing large models to be run on a wider range of devices.

Contents: