xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-25 18:04:30 +08:00
Code Issues Packages Projects Releases Wiki Activity

Use narrow over indexing in hadacore_transform to prep for ABI stable (#28756)

Browse Source 
Signed-off-by: Jane Xu <janeyx@meta.com>
This commit is contained in:
Jane (Yuan) Xu 2025-11-15 04:10:15 -05:00 committed by GitHub
parent dd6ac1c2bb
commit 74b5267d3a
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
csrc/quantization/hadamard/hadacore/hadamard_transform_cuda.cu
View File

@ -802,7 +802,7 @@ torch::Tensor hadacore_transform(torch::Tensor& x, bool inplace) {
});
if (numel % 256 != 0) {
out = out.index({torch::indexing::Slice(0, numel / had_size)});
out = out.narrow(0, 0, numel / had_size);
}
if (inplace && out.data_ptr() != x.data_ptr()) {