xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 03:05:02 +08:00
Code Issues Packages Projects Releases Wiki Activity
7,808 Commits 155 Branches 89 Tags
Commit Graph

1204 Commits

Author SHA1 Message Date
Jee Jee Li
466e878f2a
[Quantization] Enable BNB support for more MoE models (#21100) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-18 17:52:02 -07:00
Cyrus Leung
55ad648715
[Doc] Fix typo in model name (#21178) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-18 03:55:10 -07:00
Lucia Fang
b9a21e9173
[Docs] Update supported models documentation with missing models (#20844) 
Signed-off-by: Lu Fang <fanglu@fb.com>
 2025-07-17 20:12:13 -07:00
Ricardo Decal
c4e3b12524
[Docs] Add minimal demo of Ray Data API usage (#21080) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-17 20:09:19 -07:00
Jee Jee Li
a3a6c695f4
[Misc] Qwen MoE model supports LoRA (#20932) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-17 18:32:52 +00:00
Harry Mellor
2d6a38209b
[Docs] Move code block out of admonition now that it's short (#21118) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-17 06:12:29 -07:00
kYLe
4ef00b5cac
[VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) 
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-17 03:07:55 -07:00
Asher
5a7fb3ab9e
[Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) 
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
 2025-07-17 09:10:09 +00:00
Zhonghua Deng
8a4e5c5f3c
[V1][P/D]Enhance Performance and code readability for P2pNcclConnector (#20906) 
Signed-off-by: Abatom <abzhonghua@gmail.com>
 2025-07-16 22:13:00 -07:00
XiongfeiWei
58760e12b1
[TPU] Start using python 3.12 (#21000) 
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
 2025-07-16 19:37:44 -07:00
Nir David
01513a334a
Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010) 
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>
 2025-07-16 15:33:41 -04:00
Michael Yao
260127ea54
[Docs] Add intro and fix 1-2-3 list in frameworks/open-webui.md (#19199) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-16 06:11:38 -07:00
Peter Pan
1eb2b9c102
[CI] update typos config for CI pre-commit and fix some spells (#20919) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
 2025-07-15 21:12:40 -07:00
Ricardo Decal
3ed94f9d0a
[Docs] Enhance Anyscale documentation, add quickstart links for vLLM (#21018) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-15 19:46:56 -07:00
Harry Mellor
b637e9dcb8
Add full serve CLI reference back to docs (#20978) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-15 17:42:30 +00:00
Harry Mellor
313ae8c16a
[Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-15 15:57:53 +00:00
Harry Mellor
56fe4bedd6
[Deprecation] Remove TokenizerPoolConfig (#20968) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-15 14:00:50 +00:00
Rui Qiao
d91278181d
[doc] Add more details for Ray-based DP (#20948) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-07-15 05:37:12 -07:00
Thomas Parnell
3534c39a20
[V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-07-15 04:04:35 -07:00
Reid
68d28e37b0
[frontend] Add --help=page option for paginated help output (#20961) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-15 00:42:00 -07:00
Isotr0py
fc017915f5
[Doc] Clearer mistral3 and pixtral model support description (#20926) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-14 21:56:53 -07:00
Ricardo Decal
054c8657e3
[Docs] Add Kuberay to deployment integrations (#20592) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-14 20:13:55 -07:00
ant-yy
38efa28278
[Model] Add Ling implementation (#20680) 
Signed-off-by: vito.yy <vito.yy@antgroup.com>
 2025-07-14 22:10:32 +08:00
Reid
a86754a12b
[docs] convert supported configs to table (#20858) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-12 06:54:50 -07:00
Congcong Chen
2c11a738b3
[Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) 
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
 2025-07-12 06:02:10 -07:00
Lucia Fang
fb25e95688
[Docs] Update basic.md (#20846) 2025-07-11 23:05:32 -07:00
bigmoyan
5f0af36af5
Update kimi-k2 tool calling docs, enable unit tests (#20821) 
Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
 2025-07-11 20:16:14 +00:00
Nick Hill
9907fc4494
[Docs] Data Parallel deployment documentation (#20768) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-07-11 09:42:10 -07:00
Reid
6fb162447b
[doc] fix ordered list issue (#20819) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-11 06:49:46 -07:00
Reid
6a9e6b2abf
[doc] fold long code block (#20795) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-10 23:16:41 -07:00
Alex Brooks
41060c6e08
[Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) 
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
 2025-07-10 21:09:37 +01:00
shineran96
4bed167768
[Model][VLM] Support JinaVL Reranker (#20260) 
Signed-off-by: shineran96 <shinewang96@gmail.com>
 2025-07-10 10:43:43 -07:00
Harry Mellor
3482fd7e4e
[Doc] Add engine args back in to the docs (#20674) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-10 08:02:40 -07:00
Reid
65393ee064
[doc] fix ordered list (#20749) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-10 03:13:52 -07:00
fxmarty-amd
332d4cb17b
[Feature][Quantization] MXFP4 support for MOE models (#17888) 
Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
 2025-07-09 13:19:02 -07:00
Harry Mellor
403b481573
Remove heading form installation inc.md file (#20697) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-09 10:42:51 -07:00
Li, Jiang
138709f8d1
[Doc] Update CPU doc (#20676) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-09 10:28:30 -07:00
Reid
efe73d0575
[doc] update doc format (#20673) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-09 08:08:19 -07:00
Cyrus Leung
70ca5484f5
[Doc] Update notes (#20668) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-09 03:46:36 -07:00
Thomas Parnell
5358cce5ff
[V1] [Doc] Update V1 docs for Mamba models (#20499) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-09 01:02:41 -07:00
qscqesze
f95570a52d
[Docs] fix minimax tool_calling docs error (#20667) 
Signed-off-by: qingjun <qingjun@minimaxi.com>
 2025-07-09 00:37:07 -07:00
Michael Goin
9e0ef888f0
Fix bullets in incremental_build.md (#20642) 2025-07-09 11:03:41 +08:00
Harry Mellor
b942c094e3
Stop using title frontmatter and fix doc that can only be reached by search (#20623) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-08 03:27:40 -07:00
Harry Mellor
b4bab81660
Remove unnecessary explicit title anchors and use relative links instead (#20620) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-08 02:49:13 -07:00
Ricardo Decal
3eb4ad53f3
[Docs] Add Anyscale to frameworks (#20590) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-07 20:09:13 -07:00
Ricardo Decal
90a2769f20
[Docs] Add Ray Serve LLM section to openai compatible server guide (#20595) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-07 20:08:05 -07:00
Ricardo Decal
0d914c81a2
[Docs] Rewrite offline inference guide (#20594) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-07 20:06:02 -07:00
Harry Mellor
6e428cdd7a
[Doc] Syntax highlight request responses as JSON instead of bash (#20582) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 20:02:45 -07:00
Harry Mellor
af107d5a0e
Make distinct code and console admonitions so readers are less likely to miss them (#20585) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 19:55:28 -07:00
Harry Mellor
042d131f39
Fix links in multi-modal model contributing page (#18615) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 21:13:52 +00:00