xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-16 09:56:09 +08:00
Code Issues Packages Projects Releases Wiki Activity
9,188 Commits 155 Branches 89 Tags
Commit Graph

9188 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xin Yang
8fb85b7bb6
Add routed_scaling_factor to MoE grouped topk (#23123) 
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-08-29 21:36:48 -07:00
dubejf
5b31cb1781
[Bugfix] Fix --config arg expansion called from api_server.py (#23944) 
Signed-off-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-08-29 21:36:39 -07:00
Roger Wang
d660c98c1b
[CI] Fix unavailable image remote URL (#23966) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2025-08-29 15:40:04 -07:00
Harry Mellor
5674a40366
[Misc] Make download_weights_from_hf more reliable (#23863) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-29 12:37:24 -07:00
Yong Hoon Shin
8c3e199998
Revert gemma3n fast prefill changes (#23897) 
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
 2025-08-29 12:16:57 -07:00
Thomas Parnell
1c26b42296
[Docs] [V1] [Hybrid] Add new documentation re: contributing mamba-based models (#23824) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-08-29 18:47:58 +00:00
Michael Goin
b7adf94c4a
Tuned H100/H200 triton fp8 block configs for fused_qkv_a_proj (#23939) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-08-29 10:28:35 -07:00
22quinn
4d7fe40fc0
[RL][BugFix] Fix missing tokenizer error for token-in-token-out (#23904) 
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-08-30 01:09:55 +08:00
yzds
0dc9532065
[BUGFIX ] fix undefined silu_and_mul_nvfp4_quant (#23929) 
Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: Richard Zou <zou3519@users.noreply.github.com>
 2025-08-29 09:36:39 -07:00
vllmellm
72a69132dc
[CI] Add aiter to matching list of issue auto labeller for rocm tag (#23942) 
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
 2025-08-29 15:29:21 +00:00
Nick Hill
d90d8eb674
[BugFix] Async scheduling and PP compatibility with DP (#23770) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-08-29 08:17:27 -07:00
Lukas Geiger
0a2f4c0793
[Models] Use in-place adds in Idefics2Vision (#23932) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-08-29 07:42:57 -07:00
EduardDurech
1cf3753b90
[MODEL] Apertus and XIELU (#23068) 
Signed-off-by: EduardDurech <39579228+EduardDurech@users.noreply.github.com>
Co-authored-by: AllenHaoHuang <allenhuangdd@gmail.com>
 2025-08-29 20:29:18 +08:00
Adit Chawdhary
4f7cde7272
Adds json_count_leaves utility function (#23899) 
Signed-off-by: aditchawdhary <aditxy@hotmail.com>
 2025-08-29 05:28:13 -07:00
Huy Do
67c14906aa
Update PyTorch to 2.8.0 (#20358) 
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-08-29 18:57:35 +08:00
Flora Feng
69f46359dd
[Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2025-08-29 18:36:57 +08:00
wang.yuqi
d9e00dbd1f
[Performance] V1 Classify Models E2E Performance Optimization (#23541) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-08-29 03:12:32 -07:00
Li, Jiang
ad39106b16
[CPU] Enable data parallel for CPU backend (#23903) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-08-29 02:19:58 -07:00
Maximilien de Bayser
2554b27baa
[V0 Deprecation] Remove pooling model support in V0 (#23434) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-29 00:04:02 -07:00
Harry Mellor
934bebf192
Better errors for Transformers backend missing features (#23759) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-29 07:01:40 +00:00
Jiangyun Zhu
885ca6d31d
[Misc] Fix warnings for mistral model (#23552) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2025-08-29 06:58:48 +00:00
Chenheli Hua
2d0afcc9dc
[mrope][Qwen2-VL] Fix edge case where getting index of image/video token can potentially throw in default vl mrope implementation. (#23895) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
 2025-08-28 23:29:13 -07:00
Jee Jee Li
b4f9e9631c
[CI/Build] Clean up LoRA test (#23890) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-08-28 23:28:35 -07:00
Raghavan
05d839c19e
Fix(async): Add support for truncate_prompt_tokens in AsyncLLM (#23800) 2025-08-28 22:55:06 -07:00
wangxiyuan
6597d7a456
[Platform] import activation_quant_fusion for CUDA only (#23882) 
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
 2025-08-28 22:54:16 -07:00
Jinghui Zhang
5264015d74
[BugFix][AMD][Deepseek] fix a dtype mismatch error for deepseek running on AMD (#23864) 
Signed-off-by: Jinghui Zhang <jinghuizhang0804@gmail.com>
 2025-08-28 22:54:12 -07:00
Isotr0py
98ac0cb32d
[Bugfix] Use ReplicatedLinear for SequenceClassification head (#23836) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-08-29 04:41:20 +00:00
Russell Bryant
c8b3b299c9
[tests] Improve speed and reliability of test_transcription_api_correctness (#23854) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-08-29 04:25:33 +00:00
Charlie Fu
006477e60b
[ROCm][Fix] Fix rocm build caused by #23791 (#23847) 
Signed-off-by: charlifu <charlifu@amd.com>
 2025-08-28 19:52:27 -07:00
Lukas Geiger
de533ab2a1
[Models] Improve iteration over layers (#19497) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-08-29 09:26:34 +08:00
Chaojun Zhang
235c9db8a7
[XPU] support data parallel for MoE models on XPU (#22887) 
Signed-off-by: chzhang <chaojun.zhang@intel.com>
 2025-08-29 09:23:04 +08:00
Woosuk Kwon
b668055a11
[V0 Deprecation] Remove V0 Samplers test (#23862) 2025-08-28 18:05:52 -07:00
Wentao Ye
d3d2aad5a2
[Log] Use Debug Once for DeepGEMM E8M0 When not Enabled (#23858) 2025-08-28 22:18:10 +00:00
Yong Hoon Shin
cb293f6a79
[V1] Enable prefill optimization for Gemma3n (#22628) 
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
 2025-08-28 14:54:30 -07:00
Woosuk Kwon
7ffbf27239
[BugFix][FlashInfer] Fix potential race condition for paged_kv_indptr_cpu (#23737) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-28 14:22:46 -07:00
Simon Mo
27e88cee74
chore: build release image by default (#23852) 
Signed-off-by: Codex <codex@openai.com>
 2025-08-28 13:17:15 -07:00
elvischenv
16a45b3a28
[NVIDIA] Support SiluMul + NVFP4 quant fusion (#23671) 
Signed-off-by: jindih <jindih@nvidia.com>
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: jindih <jindih@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedic <lgovedic@redhat.com>
 2025-08-28 19:36:50 +00:00
Jingkai He
57d4ede520
[bugfix] [spec-decoding] fix data race in sample_recovered_tokens_kernel (vLLM v1) (#23829) 
Signed-off-by: He-Jingkai <he-jingkai@outlook.com>
 2025-08-28 19:05:20 +00:00
Divakar Verma
04d1dd7f4a
[ROCm][Aiter] Add triton fp8 bmm kernel for mla (#23264) 
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: ShaoChunLee <Shao-Chun.Lee@amd.com>
 2025-08-28 18:18:08 +00:00
Benji Beck
f32a5bc505
Migrate Llama4ImagePatchInputs to TensorSchema (#22021) 
Signed-off-by: Benji Beck <benjibeck@meta.com>
 2025-08-28 17:29:37 +00:00
Jean Schmidt
8805ad9fa9
Add scale_config.yml file for Meta autoscalers for GH Actions (#23840) 
Signed-off-by: Jean Schmidt <contato@jschmidt.me>
 2025-08-28 09:31:20 -07:00
Jean Schmidt
0583578f42
[ci] breaks down V1 Test into 3 groups of approx 30 minutes runtime (#23757) 
Signed-off-by: Jean Schmidt <contato@jschmidt.me>
 2025-08-28 08:59:19 -07:00
Angela Yi
db74d60490
[Bugfix] Add fake mode around passes (#23349) 
Signed-off-by: angelayi <yiangela7@gmail.com>
 2025-08-28 11:25:56 -04:00
Po-Han Huang (NVIDIA)
95089607fa
[Model][gpt-oss] Support DP+EP for GPT-OSS with FlashInfer trtllm-gen MoE (#23819) 
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
 2025-08-28 06:56:20 -07:00
Thomas Parnell
1f096f9b95
[CI] Fix linting error on main (#23835) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-08-28 06:52:01 -07:00
YUQI.CHENG
66548f6603
[Bugfix] Fix benchmark_moe.py for blockwise fp8. (#23823) 
Signed-off-by: crischeng <420985011@qq.com>
Co-authored-by: cris <grace@guisenbindeMacBook-Pro.local>
 2025-08-28 21:44:09 +08:00
Didier Durand
d3da2eea54
[Doc]: fix typos in Python scripts (#23828) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-08-28 05:37:38 -07:00
Jiangyun Zhu
bfab219648
[Model] [gpt-oss] fix gpt-oss pp support (#23815) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2025-08-28 05:36:55 -07:00
Woosuk Kwon
a3432f18fd
[BugFix][Spec Decode] Use float64 for uniform_probs (#23803) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-28 12:26:45 +00:00
Li, Jiang
67cee40da0
[CI/Build][Bugfix] Fix Qwen VL tests on CPU (#23818) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-08-28 11:57:05 +00:00