xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 02:55:40 +08:00
Code Issues Packages Projects Releases Wiki Activity
10,442 Commits 155 Branches 89 Tags
Commit Graph

104 Commits

Author SHA1 Message Date
HDCharles
b92ab3deda
Notice for deprecation of AutoAWQ (#26820) 
Signed-off-by: HDCharles <39544797+HDCharles@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-10-14 13:39:59 -07:00
Cyrus Leung
ef9676a1f1
[Doc] ruff format some Python examples (#26767) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-14 03:21:53 -07:00
Chendi.Xue
7e6edb1469
[NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-10-14 09:46:05 +00:00
CSWYF3634076
782505ed8e
[Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027) 
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
 2025-10-13 15:55:20 +08:00
Harry Mellor
8fcaaf6a16
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-12 09:51:31 -07:00
Julien Denize
c6187f55f7
Refactor MistralTokenizer (#26358) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
 2025-10-09 22:48:58 +00:00
Chendi.Xue
9fc983c707
[NIXL][non-cuda] Add install script for nixl with non-cuda ucx (#25959) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
 2025-10-08 14:19:53 +00:00
fxmarty-amd
41f1cf38f2
[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) 2025-10-07 09:35:26 -04:00
Maximilien de Bayser
e0986ea07b
Add documentation for granite 4 tool calling (#26175) 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
 2025-10-05 07:35:42 +00:00
Chenheli Hua
ad87ba927a
[Small] Prevent bypassing media domain restriction via HTTP redirects (#26035) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
 2025-10-02 10:27:10 -07:00
Cyrus Leung
d00d652998
[CI/Build] Replace vllm.entrypoints.openai.api_server entrypoint with vllm serve command (#25967) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-02 10:04:57 -07:00
Param
99028fda44
Fix INT8 quantization error on Blackwell GPUs (SM100+) (#25935) 
Signed-off-by: padg9912 <phone.and.desktop@gmail.com>
 2025-09-30 19:19:53 -07:00
Cyrus Leung
2f652e6cdf
[Doc] Improve MM Pooling model documentation (#25966) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-30 18:58:29 +00:00
Andrew Sansom
78a47f87ce
Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717) 
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
 2025-09-30 08:10:58 +08:00
Nicolò Lucchesi
2e4fe48c37
[NIXL] Increase default KV block eviction timeout on P (#25897) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-09-29 21:35:14 +00:00
Yuxuan Zhang
b1ded114b9
Update GLM-4.5 Doc transformers version (#25830) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
 2025-09-28 12:05:51 +00:00
Russell Bryant
3958b96bf5
Add option to restrict media domains (#25783) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
 2025-09-27 01:23:52 +00:00
Xu Wenqing
b03b1b97f6
Support LongCat-Flash-Chat tool call (#24083) 
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
 2025-09-26 09:25:39 +00:00
Harry Mellor
70fbdb26e9
Add backward compatibility for guided_... API (#25615) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-09-25 19:45:25 +08:00
Harry Mellor
8c853050e7
[Docs] Enable fail_on_warning for the docs build in CI (#25580) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-24 19:30:33 +00:00
Peter Pan
b1068903fd
[docs] fix nixl kv_connector_extra_config.backends key (#25565) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-24 11:00:27 +00:00
Peter Pan
da5e7e4329
[Docs] NixlConnector quickstart guide (#24249) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Signed-off-by: Nicolò Lucchesi<nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
 2025-09-23 14:23:22 +00:00
Zhikaiiii
9383cd6f10
[Frontend] Add a new xml-based tool parser for qwen3-coder (#25028) 
Signed-off-by: Zhikaiiii <1658973216@qq.com>
 2025-09-23 16:07:27 +08:00
Chendi.Xue
5774b0a1da
[NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
 2025-09-23 04:17:42 +00:00
Or Ozeri
8db2939289
[KV offload][5/N] Add CPUOffloadingSpec (#24251) 
Signed-off-by: Or Ozeri <oro@il.ibm.com>
 2025-09-22 12:30:36 -07:00
Andrew Sansom
b8a287a0a8
[docs] Prompt Embedding feature support (#25288) 
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
 2025-09-19 17:46:23 -07:00
Aaron Pham
29283e8976
[Chore] Cleanup guided namespace, move to structured outputs config (#22772) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-18 09:20:27 +00:00
afeldman-nm
7ae9887542
[V1] Logits processor docs (#22919) 
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Joseph Marinier <Joseph.Marinier@gmail.com>
 2025-09-17 11:53:12 -07:00
Harry Mellor
abc7989adc
[Docs] Remove Neuron install doc as backend no longer exists (#24396) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-13 00:15:03 -07:00
Chenheli Hua
7f2ea7074e
[Frontend][Multimodal] Allow skipping media data when UUIDs are provided. (#23950) 
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
 2025-09-13 02:16:06 +00:00
Robin
36cacd0958
[Doc] Add documentation for GLM-4.5 series models: tool-calling and reasoning parser (#24589) 
Signed-off-by: WangErXiao <863579016@qq.com>
 2025-09-10 07:50:55 -07:00
Didier Durand
46876dff32
[Doc]: fixing typos to improve docs (#24480) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-09-08 23:06:04 -07:00
Harry Mellor
717fc00e98
[Docs] Move feature compatibility tables to README (#24431) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-08 06:45:14 -07:00
Chenheli Hua
01dfb5e982
[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) 
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-09-08 06:42:20 -07:00
Roger Wang
749be00a98
[Core][Multimodal] Allow passing multi_modal_uuids as multimodal identifiers. (#23394) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2025-08-30 18:01:22 -07:00
Didier Durand
d99c3a4f7b
[Doc]: fix typos in .md files (including those of #23751) (#23825) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-08-28 04:38:19 -07:00
Harry Mellor
6421b66bf4
[Docs] Move quant supported hardware table to README (#23663) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-26 22:26:46 +00:00
Didier Durand
47455c424f
[Doc: ]fix various typos in multiple files (#23487) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-25 00:04:04 +00:00
Xu Wenqing
b8f17f5d98
Support DeepSeek-V3.1 tool call (#23454) 
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
 2025-08-23 05:50:16 +00:00
Cyrus Leung
8896eb72eb
[Deprecation] Remove prompt_token_ids arg fallback in LLM.generate and LLM.embed (#18800) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-08-22 10:56:57 +08:00
Kevinzz
16bff144be
[Misc] fix typo in the multimodal doc (#23051) 2025-08-17 01:56:20 -07:00
Michael Goin
4fc722eca4
[Kernel/Quant] Remove AQLM (#22943) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2025-08-16 19:38:21 +00:00
633WHU
3f52738dce
[Doc] Add max_lora_rank configuration guide (#22782) 
Signed-off-by: chiliu <cliu_whu@yeah.net>
 2025-08-13 04:10:07 -07:00
Hongsheng Liu
3a7e3bbdd2
[Doc] Added unmentioned required option "method" in the usage of EAGLE-3 based models (#21737) 
Signed-off-by: Dilute-l <dilu2333@163.com>
Co-authored-by: Dilute-l <dilu2333@163.com>
 2025-08-12 00:14:51 -07:00
Harry Mellor
7be7f3824a
[Docs] Improve API docs (+small tweaks) (#22459) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-08 03:02:51 -07:00
iAmir97
099c046463
[Doc] Sleep mode documentation (#22310) 
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Hong Hanh <hanh.usth@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
 2025-08-08 12:25:18 +08:00
WeiQing Chen
289b18e670
[Docs] Update features/disagg_prefill, add v1 examples and development (#22165) 
Signed-off-by: David Chen <530634352@qq.com>
 2025-08-07 00:59:23 -07:00
Yong Hoon Shin
5e8398805e
[Doc] Fix link to prefix caching design (#22384) 
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
 2025-08-07 00:28:15 -07:00
Gamhang
0a6d305e0f
feat(multimodal): Add customizable background color for RGBA to RGB conversion (#22052) 
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
Co-authored-by: Jinheng Li <ahengljh@gmail.com>
 2025-08-01 06:07:33 -07:00
WeiQing Chen
4931486988
[Doc] Added warning of speculating with draft model (#22047) 
Signed-off-by: Dilute-l <dilu2333@163.com>
Co-authored-by: Dilute-l <dilu2333@163.com>
 2025-08-01 02:11:56 -07:00