xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-22 10:45:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
12,177 Commits 155 Branches 89 Tags
Commit Graph

12177 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andreas Karatzas
b5945d49c0
[ROCm][CI] Use mi325_4 agent pool for V1 e2e tests (#30526) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2025-12-12 01:37:24 +00:00
rasmith
ba80926681
[CI/Build][AMD] Skip test_cutlass_w4a8_moe tests on ROCm sine they require cutlass_pack_scale_fp8 (#30508) 
Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-12 01:02:19 +00:00
jiahanc
0ab23c2b2b
[fix] fix SM check for Flashinfer TRTLLM MOE (#30314) 
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
 2025-12-12 01:00:58 +00:00
rasmith
48661d275f
[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm (#30417) 
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
 2025-12-12 00:24:20 +00:00
Ev Lacey
d527cf0b3d
[FIX]Patch run-cluster.sh (fix for #28328) (#30002) 
Signed-off-by: elacey <elacey@nvidia.com>
Signed-off-by: Ev Lacey <github@everettlacey.com>
 2025-12-11 23:36:31 +00:00
Concurrensee
2cc5affc38
[ROCM][CI] Fix AMD Examples Test Group (#30276) 
Signed-off-by: Yida Wu <yida.wu@amd.com>
Signed-off-by: Yida <yida.wu@amd.com>
 2025-12-11 18:03:54 -05:00
Andrew Briand
a00d88973d
[EPLB] Support EPLB w/ NVFP4 (#29804) 
Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>
 2025-12-11 22:59:40 +00:00
Wentao Ye
61249b177d
[Refactor] Remove useless syncwarp (#30510) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2025-12-11 17:43:41 -05:00
Wentao Ye
c817b14151
[Perf] Optimize deepgemm experts initialization, 3.9% TTFT improvement (#30494) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: li-jinpeng <3332126450@qq.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
 2025-12-11 17:28:34 -05:00
ioana ghiban
3efdc3feae
[Docs][CPU backend] Add pre-built Arm CPU Docker images (#30491) 
Signed-off-by: Ioana Ghiban <ioana.ghiban@arm.com>
 2025-12-11 22:03:29 +00:00
Nicolò Lucchesi
0efd9f867c
[Core] Whisper Enable Encoder Batching (#29421) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-12-11 21:06:51 +00:00
Xingyu Liu
90d6cf921f
[BugFix][MM]support VLLM_RANDOMIZE_DP_DUMMY_INPUTS (#30472) 
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-12-11 21:00:15 +00:00
Harry Mellor
cf3eacfe58
Standardise get_rope to use rope_parameters["partial_rotary_factor"], not rotary_dim (#30389) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-12-11 20:45:23 +00:00
Zhengxu Chen
92fea56fd1
[compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503) 
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
 2025-12-11 20:28:03 +00:00
Ye (Charlotte) Qi
e458270a95
[Misc] Add mcp to requirements (#30474) 
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-12-11 20:06:09 +00:00
Andreas Karatzas
72aaac5b66
[ROCm][Bugfix] Add MLACommonMetadata to allowed attention types for speculative decoding (#30430) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2025-12-11 19:25:01 +00:00
汪志鹏
0e71eaa644
[Feature] AWQ marlin quantization support for fused moe with lora (#30442) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2025-12-11 18:03:32 +00:00
Harry Mellor
8781cd6b88
Add Eagle and Eagle3 support to Transformers modeling backend (#30340) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-12-11 17:02:10 +00:00
Julien Denize
aa3c250c48
[IMPROVEMENT] Change MistralReasoningParser behavior (#30391) 
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2025-12-11 17:53:26 +01:00
Shengqi Chen
305b168a9f
[CI] refine more logic when generating and using nightly wheels & indices, add cuda130 build for aarch64, specify correct manylinux version (#30341) 
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2025-12-12 00:42:30 +08:00
Harry Mellor
93db3256a4
Give pooling examples better names (#30488) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-12-11 16:22:58 +00:00
ioana ghiban
17cb540248
[Docs][CPU Backend] Add nightly and per revision pre-built Arm CPU wheels (#30402) 
Signed-off-by: Ioana Ghiban <ioana.ghiban@arm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-12-11 15:57:10 +00:00
Harry Mellor
97a042f3bc
Make the httpx logger less annoying when Transformers v5 is installed (#30480) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-12-11 15:44:56 +00:00
Cyrus Leung
3a3b06ee70
[Misc] Improve error message for is_multimodal (#30483) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-12-11 06:39:51 -08:00
Martin Hickey
f4417f8449
[KVConnector] Add KV events to KV Connectors (#28309) 
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
 2025-12-11 15:30:29 +01:00
Qiu
a11f4a81e0
[Misc][PCP&DCP] relocate PCP feature check (#30050) 
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-12-11 03:36:18 -08:00
Kenichi Maehashi
853611bb18
Fix typo of endpoint name in CLI args docs (#30473) 
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
 2025-12-11 11:07:56 +00:00
Cyrus Leung
d917747c95
[Bugfix] Fix task still being passed in tests/benchmarks (#30476) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-12-11 10:33:55 +00:00
wang.yuqi
a5f9fb5960
[Deprecation] Deprecation --convert reward, use --convert embed instead. (#30463) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2025-12-11 10:18:25 +00:00
jeremyteboul
4515eb1a0b
[Fix] Update lazing loading of video loader backend (#30444) 
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
 2025-12-11 10:14:57 +00:00
Cyrus Leung
13d63b65e0
[Deprecation] Remove missed fallback for embed_input_ids (#30469) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-12-11 10:06:36 +00:00
wz1qqx
b4e8b91278
[Fix]fix import error from lmcache (#30376) 
Signed-off-by: wz1qqx <ziqi.wang@novita.ai>
Co-authored-by: wz1qqx <ziqi.wang@novita.ai>
 2025-12-11 09:23:52 +00:00
Rei.
6299628d32
[bugfix] fix MiniMaxM2ReasoningParser streaming output not separating reasoning_content. (#29882) 
Signed-off-by: Rei <1477174254@qq.com>
 2025-12-11 09:05:08 +00:00
Ming Yang
fba8906930
[perf] Use direct copy (broadcast) instead of cat for k_nope/k_pe in MLA prefill (#29710) 
Signed-off-by: Ming Yang <minos.future@gmail.com>
 2025-12-11 08:20:45 +00:00
Ning Xie
d02d1043de
fix: enhance human_readable_int function (#30337) 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
 2025-12-10 23:30:33 -08:00
Cyrus Leung
979f50efd0
[Deprecation] Remove fallbacks for embed_input_ids and embed_multimodal (#30458) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-12-11 06:58:23 +00:00
gh-wf
36c9ce2554
Ensure minimum frames for GLM 4.6V compatibility (#30285) 
Signed-off-by: Wayne Ferguson <wayneferguson@gmail.com>
 2025-12-11 05:26:49 +00:00
xyDong0223
1a516557e1
[Doc] Add Baidu Kunlun XPU support (#30455) 
Signed-off-by: xyDong0223 <dongxinyu23@gmail.com>
 2025-12-11 04:52:17 +00:00
Wentao Ye
d6464f2679
[Chore] Fix torch precision warning (#30428) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2025-12-11 04:05:56 +00:00
Cyrus Leung
7e24e5d4d6
[Deprecation] Remove deprecated task, seed and MM settings (#30397) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-12-10 19:59:39 -08:00
Cyrus Leung
5a87d8b9b1
[Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-12-10 19:59:35 -08:00
Divakar Verma
d1e1fb4363
[Bugfix] Fix grouped_topk pytorch impl when num_experts can't be grouped properly (#29439) 
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
 2025-12-10 19:47:18 -08:00
Andreas Karatzas
b51255f369
[ROCm] Fix broken import in platform attention backend dispatching (#30432) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2025-12-11 01:12:58 +00:00
Sage Moore
b4054c8ab4
Revert "[CI] Add Async Eplb nightly CI tests (#29385)" (#30431) 2025-12-11 00:48:35 +00:00
Xu Song
25221b44bb
Add more docs for regex (#30106) 
Signed-off-by: Xu Song <xusong.vip@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-11 00:12:21 +00:00
shivampr
8580919ac3
[Bugfix] fix confusing OOM errors during v1 init (#28051) 
Signed-off-by: Shivam <shivamprasad91@gmail.com>
Signed-off-by: shivampr <shivampr.dev@gmail.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
 2025-12-10 23:17:41 +00:00
Christina Norman
166ac3c94d
fix(shm): Add memory barriers for cross-process shared memory visibility (#30407) 
Signed-off-by: Christina Holland <hey@christinaholland.com>
Signed-off-by: Christina <truffle@gmail.com>
 2025-12-10 23:01:19 +00:00
Seiji Eicher
b9e0951f96
[docs] Improve wide-EP performance + benchmarking documentation (#27933) 
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
 2025-12-10 22:15:54 +00:00
Michael Goin
fcb894222f
[Docs] Update EPLB docs (#30426) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-12-10 11:56:51 -09:00
Nick Hill
6ccb7baeb1
[LMCache] Fix breakage due to new LMCache version (#30216) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-12-10 11:52:01 -08:00