xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 01:55:01 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,103 Commits 155 Branches 89 Tags
Commit Graph

91 Commits

Author SHA1 Message Date
Chauncey
63fe3a700f
[PD] let p2p nccl toy proxy handle /chat/completions (#21734) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-28 11:45:50 +00:00
Cyrus Leung
86ae693f20
[Deprecation][2/N] Replace --task with --runner and --convert (#21470) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-27 19:42:40 -07:00
Ye (Charlotte) Qi
01a395e9e7
[CI/Build][Doc] Clean up more docs that point to old bench scripts (#21667) 
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-07-27 04:02:12 +00:00
Ye (Charlotte) Qi
e7c4f9ee86
[CI/Build][Doc] Move existing benchmark scripts in CI/document/example to vllm bench CLI (#21355) 
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-07-26 07:10:14 -07:00
WeiQing Chen
f8c15c4efb
[Bugfix] Fix example disagg_example_p2p_nccl_xpyd.sh zombie process (#21437) 
Signed-off-by: David Chen <530634352@qq.com>
 2025-07-23 20:42:11 -07:00
Rui Qiao
217937221b
Elastic Expert Parallel Initial Support (#20775) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-07-18 17:46:09 -07:00
Zhonghua Deng
8a4e5c5f3c
[V1][P/D]Enhance Performance and code readability for P2pNcclConnector (#20906) 
Signed-off-by: Abatom <abzhonghua@gmail.com>
 2025-07-16 22:13:00 -07:00
Ricardo Decal
33d560001e
[Docs] Improve documentation for ray cluster launcher helper script (#20602) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-15 03:55:45 -07:00
shineran96
4bed167768
[Model][VLM] Support JinaVL Reranker (#20260) 
Signed-off-by: shineran96 <shinewang96@gmail.com>
 2025-07-10 10:43:43 -07:00
Ricardo Decal
977180c912
[Docs] Improve documentation for multi-node service helper script (#20600) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-08 19:44:26 -07:00
Ricardo Decal
b91cb3fa5c
[Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-08 02:09:06 -07:00
Woosuk Kwon
e202dd2736
[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2025-07-06 08:48:13 -07:00
Jee Jee Li
1caca5a589
[Misc] Add SPDX-FileCopyrightText (#20428) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-04 07:40:42 +00:00
Reid
a7bab0c9e5
[Misc] small update (#20462) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-03 20:33:44 -07:00
Nicolò Lucchesi
314af8617c
[Docs] Update transcriptions API to use openai client with stream=True (#20271) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-07-01 15:47:13 +00:00
Kuntai Du
92ee7baaf9
[Example] add one-click runnable example for P2P NCCL XpYd (#20246) 
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
 2025-06-30 21:03:55 -07:00
Nicolò Lucchesi
e795d723ed
[Frontend] Add /v1/audio/translations OpenAI API endpoint (#19615) 
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
 2025-06-25 17:54:14 +00:00
Lukas Geiger
c3649e4fee
[Docs] Fix syntax highlighting of shell commands (#19870) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-06-23 17:59:09 +00:00
Reid
e384f2f108
[Misc] refactor example - openai_transcription_client (#19851) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-20 08:02:21 +00:00
Zuxin
1d0ae26c85
Add xLAM tool parser support (#17148) 2025-06-19 14:26:41 +08:00
Zhonghua Deng
eccdc8318c
[V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) 
Signed-off-by: Abatom <abzhonghua@gmail.com>
 2025-06-18 06:32:36 +00:00
Navanit Dubey
3e7506975c
[DOC] Add reasoning capability to vLLM streamlit code (#19557) 2025-06-16 07:09:12 -04:00
Aaron Pham
7b3c9ff91d
[Doc] uses absolute links for structured outputs (#19582) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2025-06-13 03:35:17 +00:00
Aaron Pham
dba68f9159
[Doc] Unify structured outputs examples (#18196) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2025-06-12 22:50:31 +00:00
jmswen
c8dcc15921
Allow AsyncLLMEngine.generate to target a specific DP rank (#19102) 
Signed-off-by: Jon Swenson <jmswen@gmail.com>
 2025-06-04 08:26:47 -07:00
Calvin Chen
8d646c2e53
[Cleanup][v1]:remote guided-decoding-backend for example (#19059) 
Signed-off-by: calvin chen <120380290@qq.com>
 2025-06-04 04:23:26 +00:00
Simon Mo
02f0c7b220
[Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
Mark McLoughlin
0e98964e94
[V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2025-05-28 18:54:12 +00:00
Harry Mellor
27bebcd897
Convert examples to ruff-format (#18400) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-26 16:57:54 +00:00
Calvin Chen
3f505233fd
[Doc] Add stream flag for chat completion example (#18524) 
Signed-off-by: calvin chen <120380290@qq.com>
 2025-05-22 14:07:10 +00:00
CYJiang
71075029f2
[Doc] Support --stream arg in openai_completion_client.py script (#18388) 
Signed-off-by: googs1025 <googs1025@gmail.com>
 2025-05-22 13:20:17 +00:00
Reid
8f55962a7f
[Misc] refactor prompt embedding examples (#18405) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-20 15:26:12 +00:00
Reid
27d0952600
[Misc] extract parser.parse_args() (#18323) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-19 04:06:26 +00:00
David Xia
5c04bb8b86
[doc] fix multimodal example script (#18089) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-05-16 06:05:34 +00:00
Harry Mellor
51ff154639
Improve examples rendering in docs and GitHub (#18203) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-15 15:57:49 +00:00
Frieda Huang
9cea90eab4
[Frontend] Add /classify endpoint (#17032) 
Signed-off-by: Frieda (Jingying) Huang <jingyingfhuang@gmail.com>
 2025-05-11 07:57:07 +00:00
Reid
4c31218f80
[Misc] remove --model from vllm serve usage (#17944) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-10 13:23:31 +00:00
Rui Qiao
c44c384b1c
[Misc] Add references in ray_serve_deepseek example (#17907) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-05-09 16:59:36 +00:00
Aaron Pham
a8238bbdb0
[Chore][Doc] uses model id determined from OpenAI client (#17815) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2025-05-08 01:48:57 +00:00
Cyrus Leung
8a15c2603a
[Frontend] Add missing chat templates for various MLLMs (#17758) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-07 00:10:01 -07:00
Reid
7525d5f3d5
[doc] Add RAG Integration example (#17692) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-06 16:10:23 +00:00
Chauncey
98060b001d
[Feature][Frontend]: Deprecate --enable-reasoning (#17452) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-05-01 06:46:16 -07:00
Reid
7169f87ad0
[doc] add streamlit integration (#17522) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-01 13:34:02 +00:00
zh Wang
d586ddc691
[BugFix] Fix authorization of openai_transcription_client.py (#17321) 
Signed-off-by: zh Wang <rekind133@outlook.com>
 2025-04-30 09:51:05 -07:00
Alec
0be6d05b5e
[V1][Metrics] add support for kv event publishing (#16750) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
 2025-04-30 07:44:45 -07:00
Huy Do
2c4f59afc3
Update PyTorch to 2.7.0 (#16859) 2025-04-29 19:08:04 -07:00
Harry Mellor
a6977dbd15
Simplify (and fix) passing of guided decoding backend options (#17008) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-04-29 19:02:23 +00:00
Russell Bryant
f8acd01ff7
[V1] Add structural_tag support using xgrammar (#17085) 2025-04-26 14:06:37 +00:00
Rui Qiao
c53e0730cb
[Misc] Refine ray_serve_deepseek example (#17204) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-04-25 16:06:59 -07:00
Rui Qiao
583e900996
[Misc] Add example to run DeepSeek with Ray Serve LLM (#17134) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-04-24 22:25:21 +00:00