xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 01:35:01 +08:00
Code Issues Packages Projects Releases Wiki Activity
10,486 Commits 155 Branches 89 Tags
Commit Graph

10486 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tyler Michael Smith
2797adb329 cleanup 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2025-10-15 18:07:49 +00:00
Tyler Michael Smith
7477823407 [Bugfix] Fix race condition when KV transfer times out before request finishes 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2025-10-15 18:01:02 +00:00
XiaobingZhang
d796375258
[ModelOpt] Remove NVFP4 MoE K%16==0 constraint (#26891) 
Signed-off-by: XiaobingSuper <xiaobingzhangupc@gmail.com>
 2025-10-15 13:06:17 -04:00
Sam/Samuel
14f8456344
[Feature]: Use pydantic validation in observability.py config (#26637) 
Signed-off-by: Samuel Wu <cernunnos1710@gmail.com>
Signed-off-by: Sam/Samuel <57896620+cern1710@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-15 16:44:03 +00:00
Pradeep Dasigi
4794c2bd92
Olmo 3 tool parser and tests (#26143) 
Signed-off-by: Pradeep Dasigi <pradeepd@allenai.org>
 2025-10-15 16:36:12 +00:00
Harry Mellor
d3cbaa08dc
Lower sevarity of log when model info cache misses due to exception (#26917) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-15 09:01:09 -07:00
Cyrus Leung
828523ad8e
[Chore] Separate out vllm.utils.async_utils (#26913) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-15 15:33:00 +00:00
Cyrus Leung
136a17fe6e
[Chore] Separate out vllm.utils.func (#26904) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-15 13:03:58 +00:00
Boyuan Feng
f57438338d
[BugFix] Patch inductor memory plan logic (#26878) 
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-15 12:51:45 +00:00
Max Wittig
5d598680e3
chore: remove unused marker (#26890) 
Signed-off-by: Max Wittig <max.wittig@siemens.com>
 2025-10-15 05:40:33 -07:00
wangxiyuan
8f4b313c37
[Misc] rename torch_dtype to dtype (#26695) 
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
 2025-10-15 12:11:48 +00:00
Cyrus Leung
f93e348010
[Misc] Remove isort and yapf ignores (#26888) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-15 12:09:03 +00:00
wang.yuqi
f54f85129e
[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-10-15 11:14:41 +00:00
li2haipeng
d4d1a6024f
[Lora]Load tuned multi-lora kernel configs from json files (#26319) 
Signed-off-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>
Signed-off-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-10-15 09:45:14 +00:00
wangxiyuan
db1764e4e0
[Platform] allow platform to init dp group (#22243) 
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
 2025-10-15 02:32:17 -07:00
Jialin Ouyang
7f83b4ee8e
[Easy] Get rid of unnecessary paraenthesis in kv_cache_manager (#26842) 
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
 2025-10-15 09:17:43 +00:00
ant-yy
5c3bae1a6a
[Fix] Remove divisibility requirement between num_kv_heads and tp_size in bailing_moe (#26876) 
Signed-off-by: vito.yy <vito.yy@antgroup.com>
 2025-10-15 16:44:04 +08:00
Xudong Ma
5210dc3940
[Misc] Update TritonLanguagePlaceholder to have attributes that are used by Flash Linear Attention ops. (#26853) 
Co-authored-by: Xudong Ma <mxd@meta.com>
 2025-10-15 08:37:49 +00:00
youkaichao
650b51f9f9
[doc] add Context Parallel Deployment doc (#26877) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-10-15 16:33:52 +08:00
Cyrus Leung
6256697997
[Doc] ruff format remaining Python examples (#26795) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-15 01:25:49 -07:00
Wentao Ye
71557a5f7c
[CI] Fix mypy for vllm/executor (#26845) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2025-10-15 01:23:33 -07:00
Zhewen Li
f3c378ffa7
[CI/Build] Add Qwen2.5-VL-7B-Instruct ChartQA Accuracy Tests in CI (#21810) 
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: zhewenli <zhewenli@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Ye (Charlotte) Qi <ye.charlotte.qi@gmail.com>
 2025-10-15 08:09:56 +00:00
Yongye Zhu
f5ed68ef63
[Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (#26456) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2025-10-15 16:05:01 +08:00
Angela Yi
efdef57b1f
[bugfix] Lazy import cv2 (#26869) 
Signed-off-by: angelayi <yiangela7@gmail.com>
 2025-10-15 07:47:50 +00:00
Cyrus Leung
b8a4572157
[Misc] Use helper function to generate dummy messages in OpenAI MM tests (#26875) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-15 07:17:37 +00:00
Mengqing Cao
302ef403a2
[DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656) 
Signed-off-by: MengqingCao <cmq0113@163.com>
 2025-10-15 00:16:44 -07:00
sangho.lee
8865da157b
[Bugfix][Multi Modal] Fix incorrect Molmo token processing (#26873) 
Signed-off-by: sanghol <sanghol@allenai.org>
 2025-10-15 07:13:59 +00:00
Boyuan Feng
f0862eae43
[Graph Partition] pass tests for decorator (#26831) 
Signed-off-by: Boyuan Feng <boyuan@meta.com>
 2025-10-15 06:39:48 +00:00
Isotr0py
8c851f6d04
[Bugfix] Fix qwen3-omni audio truncation issue (#26815) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-10-15 05:38:36 +00:00
Angela Yi
7cfa420f49
[BugFix] Patch inductor partitioning logic (#26735) 
Signed-off-by: angelayi <yiangela7@gmail.com>
 2025-10-15 05:04:32 +00:00
rongfu.leng
a27b288e4a
[Feature] default --extra-body param to disable thinking in vllm bench serve (#26784) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-10-15 04:23:44 +00:00
zhrrr
e471d7ca7e
[CI/Build][Bugfix] fix qutlass cmake error when set QUTLASS_SRC_DIR (#26773) 
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-10-15 04:09:44 +00:00
Michael Yao
c43ca8259e
[Docs] Move build.inc into arm.inc (#26862) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-10-14 20:35:08 -07:00
Tao Hui
85a65e7f51
[Model] Add DeepSeek-V3.1 reasoning parser (split from PR #24972) (#25589) 
Signed-off-by: taohui <taohui3@gmail.com>
Signed-off-by: Tao Hui <taohui3@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2025-10-15 11:09:52 +08:00
kourosh hakhamaneshi
a2986b3e33
[Bugfix] Fixes prefix-repetition benchmark script (#26828) 
Signed-off-by: Kourosh Hakhamaneshi <Kourosh@anyscale.com>
 2025-10-15 02:54:43 +00:00
Morrison Turnansky
96b9aa5aa0
[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355) 
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2025-10-15 02:51:16 +00:00
Michael Goin
e66d787bce
Disable FlashInfer sampler by default (#26859) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-10-15 02:35:18 +00:00
Chendi.Xue
bfad142e25
[BUGFIX][NIXL] quick fix for 'assert self.connector_worker is not None' in get_kv_connector_stats (#26851) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-10-15 02:33:25 +00:00
Zhikaiiii
9354660036
[Bugfix]fix Qwen3 xml tool parser (#26345) 
Signed-off-by: Zhikaiiii <1658973216@qq.com>
 2025-10-15 09:50:30 +08:00
Jialin Ouyang
07ca70af8d
[Core][Easy] Use envs.__getattr__ for all Unify to environment variable access (#26810) 
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
 2025-10-15 01:41:18 +00:00
Luka Govedič
2dcd12d357
[torch.compile] Fix tests for torch==2.9 inductor partition (#26116) 
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
 2025-10-14 19:55:02 -04:00
Tyler Michael Smith
579d2e5458
[WideEP][P/D] Add usage stats for DP+EP and KV Connector (#26836) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2025-10-14 23:51:54 +00:00
Ye Hu
0512c04aee
[frontend][gptoss] Add per turn stats into Harmony Context (#25061) 
Signed-off-by: lacora <hyelacora@gmail.com>
Co-authored-by: Ye Hu <yehu@fb.com>
 2025-10-14 16:48:13 -07:00
Michael Goin
7e0ef4084a
[CI Failure] Fix torchao dep failure for Quantization Test (#26824) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-10-14 16:41:43 -07:00
Nick Hill
4aed506b65
[Core] Streamline some structured output related code (#26737) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-10-14 23:27:44 +00:00
Boyuan Feng
a86b4c58e8
remove attn output view kernel (#26680) 
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-10-14 22:53:10 +00:00
Nick Hill
ff4810ba73
[Minor] Group async_scheduling related fields in model runner init (#26736) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-10-14 14:46:37 -07:00
Nan Qin
9d6964926e
fix: response_format for completion (#23212) 
Signed-off-by: Nan2018 <qinnanjoshua@gmail.com>
 2025-10-14 21:23:22 +00:00
Dhruvil Bhatt
0e65818910
Added MoE configs for llama 4, H200 device with tp=4/8 tuning (#26837) 
Signed-off-by: Dhruvil Bhatt <bhattdbh@amazon.com>
 2025-10-14 14:21:03 -07:00
Jialin Ouyang
380f17527c
[Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146) 
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
 2025-10-14 17:03:21 -04:00