xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-04-06 20:17:15 +08:00
Code Issues Packages Projects Releases Wiki Activity
7,469 Commits 155 Branches 89 Tags
Commit Graph

504 Commits

Author SHA1 Message Date
Sage Moore
9b7edc0343 cleanup data_parallel.py 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-07-03 13:02:12 +00:00
Sage Moore
be2e1632fd delete basic-ub.py 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-07-03 13:01:01 +00:00
Sage Moore
0e499c4f4d first round of cleanups 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-07-02 21:11:28 +00:00
Sage Moore
0767d9863f fix data_parallel.py 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-07-02 19:25:59 +00:00
Sage Moore
c0efbbb5de misc changes 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-07-02 16:56:30 +00:00
Lucas Wilkinson
f7a3ee0ea1 Merge remote-tracking branch 'origin/main' into lwilkinson/attn-slicing 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2025-07-02 16:52:19 +00:00
Sage Moore
d833982e48 random push 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-06-30 17:08:51 +00:00
Woosuk Kwon
2965c99c86
[Spec Decode] Clean up spec decode example (#20240) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-06-30 08:28:13 -07:00
Sage Moore
4672c72f44 capture works replay does not 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-06-28 19:14:48 +00:00
Wentao Ye
d45417b804
fix ci issue distributed 4 gpu test (#20204) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2025-06-27 22:50:00 -07:00
Ekagra Ranjan
9502c38138
[Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) 2025-06-25 22:06:27 -07:00
Nicolò Lucchesi
e795d723ed
[Frontend] Add /v1/audio/translations OpenAI API endpoint (#19615) 
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
 2025-06-25 17:54:14 +00:00
Reid
26d34eb67e
refactor example - qwen3_reranker (#19847) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-24 14:03:20 +00:00
Lukas Geiger
c3649e4fee
[Docs] Fix syntax highlighting of shell commands (#19870) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-06-23 17:59:09 +00:00
Reid
b82e0f82cb
[doc] use MkDocs collapsible blocks - supplement (#19973) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-23 10:54:16 +00:00
汪志鹏
c3bf9bad11
[New model support]Support Tarsier2 (#19887) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-06-21 04:01:51 +00:00
Reid
e384f2f108
[Misc] refactor example - openai_transcription_client (#19851) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-20 08:02:21 +00:00
Reid
089a306f19
[Misc] update cuda version (#19526) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-20 07:25:15 +00:00
Zuxin
1d0ae26c85
Add xLAM tool parser support (#17148) 2025-06-19 14:26:41 +08:00
Maximilien de Bayser
799397ee4f
Support embedding models in V1 (#16188) 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
 2025-06-18 21:36:33 -07:00
Sage Moore
0889f66297 Merge branch 'main' of https://github.com/neuralmagic/vllm into lwilkinson/attn-slicing 2025-06-18 13:56:24 +00:00
Zhonghua Deng
eccdc8318c
[V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) 
Signed-off-by: Abatom <abzhonghua@gmail.com>
 2025-06-18 06:32:36 +00:00
Isotr0py
aed8468642
[Doc] Add missing llava family multi-image examples (#19698) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-06-17 07:05:21 +00:00
Navanit Dubey
3e7506975c
[DOC] Add reasoning capability to vLLM streamlit code (#19557) 2025-06-16 07:09:12 -04:00
Aaron Pham
7b3c9ff91d
[Doc] uses absolute links for structured outputs (#19582) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2025-06-13 03:35:17 +00:00
Aaron Pham
dba68f9159
[Doc] Unify structured outputs examples (#18196) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2025-06-12 22:50:31 +00:00
Ekagra Ranjan
017ef648e9
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847) 2025-06-12 10:30:56 -07:00
niu_he
dff680001d
Fix typo (#19525) 
Signed-off-by: 2niuhe <carlton2tang@gmail.com>
 2025-06-12 09:24:45 +00:00
runzhen
943ffa5703
[Bugfix] Update the example code, make it work with the latest lmcache (#19453) 
Signed-off-by: Runzhen Wang <wangrunzhen@gmail.com>
 2025-06-11 12:42:20 +00:00
wang.yuqi
3952731e8f
[New Model]: Support Qwen3 Embedding & Reranker (#19260) 2025-06-10 20:07:30 -07:00
Reid
6b1391ca7e
[Misc] refactor neuron_multimodal and profiling (#19397) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-10 06:12:42 +00:00
Sage Moore
642bf2dd8b Merge branch 'main' of https://github.com/neuralmagic/vllm into lwilkinson/attn-slicing 2025-06-08 18:02:06 +00:00
Reid
122cdca5f6
[Misc] refactor context extension (#19246) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-07 05:13:21 +00:00
Sage Moore
f8848bb201 misc fixes. lm_eval still gets a wrong answer but it no longer hangs 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-06-04 22:46:18 +00:00
jmswen
c8dcc15921
Allow AsyncLLMEngine.generate to target a specific DP rank (#19102) 
Signed-off-by: Jon Swenson <jmswen@gmail.com>
 2025-06-04 08:26:47 -07:00
Xu Wenqing
02658c2dfe
Add DeepSeek-R1-0528 function call chat template (#18874) 
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
 2025-06-04 13:24:18 +00:00
汪志鹏
3336c8cfbe
Fix #19130 (#19132) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-06-04 01:42:06 -07:00
Calvin Chen
8d646c2e53
[Cleanup][v1]:remote guided-decoding-backend for example (#19059) 
Signed-off-by: calvin chen <120380290@qq.com>
 2025-06-04 04:23:26 +00:00
Jiaxin Shan
abd7df2fca
[Misc] Fix path and python alias errors in disagg_prefill exmaples (#18919) 2025-06-03 17:15:18 -07:00
Sage Moore
2e3484c237 debugging 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-06-03 19:25:01 +00:00
Simon Mo
02f0c7b220
[Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
汪志鹏
1282bd812e
Add tarsier model support (#18985) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-06-03 13:13:13 +08:00
Sage Moore
18e7d6c7b8 Merge branch 'main' of https://github.com/neuralmagic/vllm into lwilkinson/attn-slicing 2025-06-03 00:52:39 +00:00
Siyuan Liu
9112b443a0
[Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) 
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
 2025-06-03 00:06:20 +00:00
Calvin Chen
c57d577e8d
add an absolute path for run.sh (#18258) 
Signed-off-by: calvin chen <120380290@qq.com>
 2025-06-02 19:38:23 +00:00
Sage Moore
8332924320 dp format 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-06-02 19:15:23 +00:00
Sage Moore
8ea80fca4a revert offline_inference/basic.py 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-06-02 18:05:48 +00:00
Sage Moore
21d9529a79 revert offline_inference/basic.py 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-06-02 18:05:26 +00:00
Nick Hill
9a1b9b99d7
[BugFix] Fix multi-node offline data-parallel (#18981) 
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Yizhou Liu <liu_yizhou@outlook.com>
 2025-05-31 08:34:52 -07:00
Satyajith Chilappagari
2a50ef5760
[Neuron] Add Multi-Modal model support for Neuron (#18921) 
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
Co-authored-by: Ashraf Mahgoub <ashymahg@amazon.com>
Co-authored-by: Rohith Nallamaddi <nalrohit@amazon.com>
Co-authored-by: FeliciaLuo <luof@amazon.com>
Co-authored-by: Elaine Zhao <elaineyz@amazon.com>
 2025-05-31 10:39:11 +00:00