xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 02:25:01 +08:00
Code Issues Packages Projects Releases Wiki Activity
7,582 Commits 155 Branches 89 Tags
Commit Graph

1170 Commits

Author SHA1 Message Date
fxmarty-amd
332d4cb17b
[Feature][Quantization] MXFP4 support for MOE models (#17888) 
Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
 2025-07-09 13:19:02 -07:00
Harry Mellor
403b481573
Remove heading form installation inc.md file (#20697) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-09 10:42:51 -07:00
Li, Jiang
138709f8d1
[Doc] Update CPU doc (#20676) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-09 10:28:30 -07:00
Reid
efe73d0575
[doc] update doc format (#20673) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-09 08:08:19 -07:00
Cyrus Leung
70ca5484f5
[Doc] Update notes (#20668) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-09 03:46:36 -07:00
Thomas Parnell
5358cce5ff
[V1] [Doc] Update V1 docs for Mamba models (#20499) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-09 01:02:41 -07:00
qscqesze
f95570a52d
[Docs] fix minimax tool_calling docs error (#20667) 
Signed-off-by: qingjun <qingjun@minimaxi.com>
 2025-07-09 00:37:07 -07:00
Michael Goin
9e0ef888f0
Fix bullets in incremental_build.md (#20642) 2025-07-09 11:03:41 +08:00
Harry Mellor
b942c094e3
Stop using title frontmatter and fix doc that can only be reached by search (#20623) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-08 03:27:40 -07:00
Harry Mellor
b4bab81660
Remove unnecessary explicit title anchors and use relative links instead (#20620) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-08 02:49:13 -07:00
Ricardo Decal
3eb4ad53f3
[Docs] Add Anyscale to frameworks (#20590) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-07 20:09:13 -07:00
Ricardo Decal
90a2769f20
[Docs] Add Ray Serve LLM section to openai compatible server guide (#20595) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-07 20:08:05 -07:00
Ricardo Decal
0d914c81a2
[Docs] Rewrite offline inference guide (#20594) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-07 20:06:02 -07:00
Harry Mellor
6e428cdd7a
[Doc] Syntax highlight request responses as JSON instead of bash (#20582) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 20:02:45 -07:00
Harry Mellor
af107d5a0e
Make distinct code and console admonitions so readers are less likely to miss them (#20585) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 19:55:28 -07:00
Harry Mellor
042d131f39
Fix links in multi-modal model contributing page (#18615) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 21:13:52 +00:00
wang.yuqi
110df74332
[Model][Last/4] Automatic conversion of CrossEncoding model (#19675) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-07 14:46:04 +00:00
Harry Mellor
1ad69e8375
[Doc] Fix some MkDocs snippets used in the installation docs (#20572) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 07:44:34 -07:00
Harry Mellor
b8a498c9b2
[Doc] Add outline for content tabs (#20571) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 07:43:26 -07:00
Harry Mellor
923147b5e8
[Doc] Fix internal links so they don't always point to latest (#20563) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 04:15:50 -07:00
Harry Mellor
45877ef740
[Doc] Use gh-pr and gh-issue everywhere we can in the docs (#20564) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 03:54:22 -07:00
Harry Mellor
6e4bef1bea
[Doc] Remove extra whitespace from CI failures doc (#20565) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 03:35:47 -07:00
Michael Yao
eb0b2d2f08
[Docs] Clean up tables in supported_models.md (#20552) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-07 01:46:31 -07:00
Michael Yao
1fd471e957
Add docstrings to url_schemes.py to improve readability (#20545) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-07 08:31:49 +00:00
Yang Yang
6e2c19ce22
[Refactor]Abstract Platform Interface for Distributed Backend and Add xccl Support for Intel XPU (#19410) 
Signed-off-by: dbyoung18 <yang5.yang@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-07-07 04:32:32 +00:00
Cyrus Leung
9fb52e523a
[V1] Support any head size for FlexAttention backend (#20467) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-06 09:54:36 -07:00
Flora Feng
fe1e924811
[Frontend] Support image object in llm.chat (#19635) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
 2025-07-06 06:47:13 +00:00
Reid
ef9a2990ae
[doc] small fix (#20506) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-04 20:56:39 -07:00
Guy Stone
d3f05c9248
[Doc] fix mutltimodal_inputs.md gh examples link (#20497) 
Signed-off-by: Guy Stone <guys@spotify.com>
 2025-07-04 16:41:35 -07:00
Cyrus Leung
fbd62d8750
[Doc] Fix classification table in list of supported models (#20489) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-04 06:08:02 -07:00
wang.yuqi
2e26f9156a
[Model][3/N] Automatic conversion of CrossEncoding model (#20168) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-04 05:47:39 -07:00
wang.yuqi
6f1229f91d
[Model][2/N] Automatic conversion of CrossEncoding model (#19978) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-03 13:59:23 +00:00
Jee Jee Li
1819fbda63
[Quantization] Bump to use latest bitsandbytes (#20424) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-03 21:58:46 +08:00
Cyrus Leung
b024a42e93
[Core] Move multimodal placeholder from chat utils to model definition (#20355) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-03 08:18:30 +00:00
Michael Yao
cb97f2bfc5
[Docs] Replace two list with tables in intel_gaudi.md (#20414) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-03 00:48:25 -07:00
qscqesze
363528de27
[Feature] Support MiniMax-M1 function calls features (#20297) 
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
 2025-07-03 06:48:27 +00:00
Nicolò Lucchesi
3dd359147d
[Docs] Update EAGLE example (#20375) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-07-02 17:13:51 -07:00
cronoik-inceptionai
b95877509b
Documentation update tool_calling: mapping back to function from response (#20373) 2025-07-02 05:55:49 -07:00
CSWYF3634076
e303dcf523
[Model] Add Ernie4.5 and Ernie4.5MoE Model Support (#20220) 
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
 2025-07-02 03:37:01 -07:00
Michael Yao
ae9c4d416f
[Docs] Make TPU ref prettier in google_tpu.md (#20356) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-02 02:04:08 -07:00
Michael Yao
d853520b3e
[Docs] Fix indentations for 2-level items in deprecation_policy.md (#20352) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-01 23:50:31 -07:00
Kwai-Keye
8452946c06
[Model][VLM] Support Keye-VL-8B-Preview (#20126) 
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
 2025-07-01 23:35:04 -07:00
QiliangCui
b205e8467d
[Doc][TPU] Add models and features supporting matrix. (#20230) 
Signed-off-by: Qiliang Cui <cuiq@google.com>
 2025-07-02 06:33:20 +00:00
yyzxw
be0cfb2b68
fix[Docs]: link anchor is incorrect #20309 (#20315) 
Signed-off-by: zxw <1020938856@qq.com>
 2025-07-02 06:32:34 +00:00
Shintarou Okada
3d19d47d91
[Frontend] Expand tools even if tool_choice="none" (#17177) 
Signed-off-by: okada shintarou <okada@preferred.jp>
 2025-07-01 12:47:38 -04:00
aiyiwang2025
ecad851cbd
[Model]Add Tencent HunYuanMoEV1 Model Support (#20114) 
Signed-off-by: aiyiwang <aiyiwang@tencent.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: quinnrong <quinnrong@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-01 07:28:13 -07:00
Yuxuan Zhang
ed70f3c64f
Add GLM4.1V model (Draft) (#19331) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-07-01 12:48:26 +00:00
Reid
787b13389e
[doc] fix the incorrect logo in dark mode (#20289) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-01 08:18:09 +00:00
Li, Jiang
6cc1e7d96d
[CPU] Update custom ops for the CPU backend (#20255) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-01 07:25:03 +00:00
Ernest Wong
bd5038af07
[Doc] add config and troubleshooting guide for NCCL & GPUDirect RDMA (#15897) 
Signed-off-by: Ernest Wong <chwong719@gmail.com>
 2025-06-30 21:44:39 -07:00