xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-05-25 06:44:25 +08:00
Code Issues Packages Projects Releases Wiki Activity

Fix: Spelling of inference (#17387)

Browse Source
This commit is contained in:
a2q1p 2025-04-30 00:23:39 +08:00 committed by GitHub
parent 900edfa8d4
commit 0ed27ef66c
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/layers/quantization/compressed_tensors/compressed_tensors.py
View File

@ -384,7 +384,7 @@ class CompressedTensorsConfig(QuantizationConfig):
Detect whether a layer_name is found in any target and Detect whether a layer_name is found in any target and
use the quantization scheme corresponding to the matched target use the quantization scheme corresponding to the matched target
to select the CompressedTensorsScheme used for infernece. to select the CompressedTensorsScheme used for inference.
""" """
# Find the "target" in the compressed-tensors config # Find the "target" in the compressed-tensors config