xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 03:44:58 +08:00
Code Issues Packages Projects Releases Wiki Activity
9,852 Commits 155 Branches 89 Tags
Commit Graph

9852 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Matthew Bonanni
ac0048c0ae
[BugFix] [DP/EP] Fix slow execution when BS <= DP (#25407) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Chris Bamford <chrisbam4d@gmail.com>
 2025-09-22 17:26:17 -07:00
Nicolò Lucchesi
090197034f
[Bugfix] Fix missing clear_connector_metadata (#25397) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-09-23 08:10:59 +08:00
Russell Bryant
f31ff87460
[Core] Drop overly aggressive whisper assertion (#25408) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-09-22 17:09:52 -07:00
Luka Govedič
d588cd2406
[Bugfix] fix custom op test (#25429) 
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
 2025-09-23 00:07:43 +00:00
Alec S
45d7d852d3
[Frontend] Responses API MCP tools for built in tools and to pass through headers (#24628) 
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec S <10566873+alecsolder@users.noreply.github.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-09-22 23:38:19 +00:00
Johnny Yang
8bed179109
[TPU] update torch_xla dependency for PyPI compatibility (#25278) 
Signed-off-by: Johnny Yang <johnnyyang@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
 2025-09-22 16:14:44 -07:00
Cyrus Leung
f552d5e578
[CI/Build] Skip Qwen3-VL initialization tests until models are actually released (#25394) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-22 13:18:24 -07:00
Or Ozeri
8db2939289
[KV offload][5/N] Add CPUOffloadingSpec (#24251) 
Signed-off-by: Or Ozeri <oro@il.ibm.com>
 2025-09-22 12:30:36 -07:00
Luka Govedič
d5e0fca264
[torch.compile] Cleanup compilation tests and custom passes, add debug utils, fix DCE bug (#23091), fix test (#24376), and prep for custom op matching (#24604) (#24542) 
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2025-09-22 12:30:05 -07:00
Simon Mo
8d0ee5a564
[misc] Remove RFC review hours reference (#25416) 2025-09-22 12:16:59 -07:00
Lucia Fang
922979bfcc
[DP] support torchrun external launcher with Data Parallelism (#24899) 
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2025-09-22 12:06:05 -07:00
Michael Goin
239ef0c1ac
[CI Failure] Fix fp8 kv cache on <SM90 (#25396) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-09-22 18:27:51 +00:00
ElizaWszola
1d7f95b85c
[Compiler] Disable Inductor standalone compile by default (#25391) 
Signed-off-by: ElizaWszola <ewszola@redhat.com>
 2025-09-22 17:37:46 +00:00
Daisy-Ma-coder
cfbee3d0e7
[CLI env var] Add VLLM_FLASH_ATTN_MAX_NUM_SPLITS_FOR_CUDA_GRAPH in env variables (#25274) 
Signed-off-by: qqma <qqma@amazon.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: qqma <qqma@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-09-22 10:37:43 -07:00
Bowen Wang
06a41334c7
[EPLB] Reduce EPLB Inference Overhead (#24573) 
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-09-22 16:31:05 +00:00
Burkhard Ringlein
175811e3b5
[V1][Attention] Split triton_attn in triton-only and rocm specific backends (#24648) 
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
 2025-09-22 15:20:28 +00:00
Csrayz
c10101a3eb
[Bugfix] Fix several issues with p2p xPyD in GET type (#23993) 
Signed-off-by: Csrayz <jover@cmbchina.com>
Signed-off-by: ivyilike <pww123@cmbchina.com>
Co-authored-by: ivyilike <pww123@cmbchina.com>
 2025-09-22 14:53:13 +00:00
Sara-KS
ac243886b0
[Kernel] MI-300X triton moe configs (#23445) 
Signed-off-by: Sara Kokkila Schumacher <saraks@ibm.com>
 2025-09-22 14:29:54 +00:00
Harry Mellor
3d2c56b7a9
Make mypy behave like a proper pre-commit hook (#25313) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-22 12:23:45 +00:00
Harry Mellor
64c824cd78
Make pickle import check fast (#25379) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-22 04:08:25 -07:00
Cyrus Leung
417a164af6
[Misc] Remove unused encoder-decoder error strings (#25374) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-22 11:04:32 +00:00
Yizhou
b6f01bd9a7
refactor: abstract graph mode support into platform interface (#25161) 
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
 2025-09-22 10:22:29 +00:00
Nicolò Lucchesi
4cf71cc88a
[TPU] Deprecate xm.mark_step in favor of `torch_xla.sync (#25254) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-09-22 10:12:57 +00:00
Nicolò Lucchesi
a66d131381
[TPU][Bugfix][CI] Fix broken tests/build dependency (#25255) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-09-22 09:55:04 +00:00
Eldar Kurtić
21467f9a1c
Enable Eagle3 speculative decoding for GPT-OSS model (#25246) 
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
 2025-09-22 08:50:39 +00:00
Cyrus Leung
f92d952632
[V0 Deprecation] Remove MultiModalPlaceholderMap (#25366) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-22 08:49:19 +00:00
Cyrus Leung
6d0b827cbd
[V0 Deprecation] Remove V0-only methods in multi-modal registry (#25362) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-22 13:58:26 +08:00
WeiQing Chen
0eecb31663
[Bugfix] Fix hermes tool parser handling of non-string argument types (#22002) 
Signed-off-by: wangzi <3220100013@zju.edu.cn>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2025-09-22 11:35:39 +08:00
WeiQing Chen
793be8d057
[Docs] GSM8K Accuracy Evaluation doc update (#25360) 
Signed-off-by: David Chen <530634352@qq.com>
 2025-09-22 02:49:13 +00:00
Roger Wang
7b57a433da
[Model] Support Dots OCR (#24645) 
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: yinz-aizip <yinz@aizip.ai>
 2025-09-22 02:24:40 +00:00
Deboleina
5aeb925452
Multimodal - audio tests (#25285) 
Signed-off-by: Debolina Roy <debroy@redhat.com>
 2025-09-22 07:07:11 +08:00
Yang Liu
04d3752329
[Bugfix][V0 Deprecation][CI] use async mock and await for async method (#25325) 
Signed-off-by: Yang <lymailforjob@gmail.com>
 2025-09-22 07:06:16 +08:00
Woosuk Kwon
bc6e542d9f
Remove V0 attention backends (#25351) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-09-21 16:03:28 -07:00
Isotr0py
af7dfb0d1a
[Perf] Further optimization for Qwen3-VL fast_pos_embed_interpolate (#25347) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-09-21 20:12:45 +00:00
Woosuk Kwon
1c3ffdbecc
[V0 Deprecation] Remove V0 sampling metadata (#25345) 
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
 2025-09-21 10:37:11 -07:00
Rahul Tuli
c438b2951c
feat: Enable engine-level arguments with speculators models (#25250) 
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2025-09-21 11:04:45 -06:00
Woosuk Kwon
0ff8ebb2d7
[V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-09-21 08:52:32 -07:00
Woosuk Kwon
26e673fe93
[V0 Deprecation] Remove V0 Sequence class & Sampler (#25332) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
 2025-09-21 08:52:15 -07:00
Cyrus Leung
65a5910ce3
[Optimization] Cache chat template result when processor fails to be loaded (#25341) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-21 19:41:02 +08:00
Simon Danielsson
9aea7373ff
[Bugfix] Typos in error message for missing model config file (#25339) 
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
 2025-09-21 04:36:47 -07:00
Roger Wang
30d08911f7
[MM][Perf] Minor Optimization on Qwen3-VL fast_pos_embed_interpolate (#25337) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2025-09-21 11:05:20 +00:00
Isotr0py
cf56cf78b4
[V1] Add sliding window support to Flex Attention backend (#24089) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-09-21 05:08:07 +00:00
Woosuk Kwon
7ed82d1974
[V0 Deprecation] Remove V0 MP executor (#25329) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-09-20 21:26:35 -07:00
Woosuk Kwon
12dbd834cf
[V0 Deprecation] Remove from_seq_group methods (#25330) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-09-20 21:10:48 -07:00
Wenlong Wang
035fd2bd2c
[Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005) 
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2025-09-21 03:55:10 +00:00
Woosuk Kwon
1cd885bd54
[V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-09-20 20:49:09 -07:00
Huamin Li
62b38dc832
[Doc] improve test-pipeline.yaml documentation (#25305) 
Signed-off-by: Huamin Li <3ericli@gmail.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
 2025-09-20 20:29:12 -07:00
Woosuk Kwon
c99db8c8dd
[V0 Deprecation] Remove V0 core (#25321) 
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-09-20 19:58:26 -07:00
Woosuk Kwon
72dd1595b4
[CI] Skip tests failing on main (#25326) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-09-20 19:57:46 -07:00
Woosuk Kwon
572ddf83ce
[Chore] Remove unused sampler in models (#25324) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-09-20 19:53:20 -07:00