xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-11 04:34:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,320 Commits 155 Branches 89 Tags
Commit Graph

963 Commits

Author SHA1 Message Date
Cyrus Leung
8a15c2603a
[Frontend] Add missing chat templates for various MLLMs (#17758) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-07 00:10:01 -07:00
Harry Mellor
022afbeb4e
Fix doc build performance (#17748) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-07 00:36:41 +00:00
Harry Mellor
6115b11582
Make right sidebar more readable in "Supported Models" (#17723) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-06 16:48:26 +00:00
Reid
7525d5f3d5
[doc] Add RAG Integration example (#17692) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-06 16:10:23 +00:00
Michael Yao
0d115460a7
[Docs] Use gh-file to add links to tool_calling.md (#17709) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-05-06 15:27:19 +00:00
Harry Mellor
05e1f96419
Fix dockerfilegraph pre-commit hook (#17698) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-06 08:56:48 +00:00
Cyrus Leung
63ced7b43f
[Doc] Update notes for H2O-VL and Gemma3 (#17219) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-06 07:51:02 +00:00
Stan Wozniak
999328be0d
[Model] Add GraniteMoeHybrid 4.0 model (#17497) 
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
 2025-05-06 12:00:31 +08:00
Michael Goin
98834fefaa
Update nm to rht in doc links + refine fp8 doc (#17678) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-05-06 00:41:14 +00:00
Harry Mellor
d6484ef3c3
Add full API docs and improve the UX of navigating them (#17485) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-03 19:42:43 -07:00
Zhiyu
182f40ea8b
Add NVIDIA TensorRT Model Optimizer in vLLM documentation (#17561) 2025-05-02 11:36:46 -07:00
Reid
3a500cd0b6
[doc] miss result (#17589) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-02 07:04:49 -07:00
Reid
6d1479ca4b
[doc] add the print result (#17584) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-02 05:24:45 -07:00
David Xia
afb12e4294
[Doc] note that not all unit tests pass on CPU platforms (#17554) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-05-02 02:57:21 +00:00
Hongxia Yang
4acfa3354a
[ROCm] update installation guide to include build aiter from source instructions (#17542) 
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-01 11:01:28 -07:00
Chauncey
98060b001d
[Feature][Frontend]: Deprecate --enable-reasoning (#17452) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-05-01 06:46:16 -07:00
Reid
7169f87ad0
[doc] add streamlit integration (#17522) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-01 13:34:02 +00:00
NaLan ZeYu
1144a8efe7
[Bugfix] Temporarily disable gptq_bitblas on ROCm (#17411) 
Signed-off-by: Yan Cangang <nalanzeyu@gmail.com>
 2025-04-30 19:51:45 -07:00
Reid
2ac74d098e
[doc] add install tips (#17373) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-30 17:02:41 +00:00
Michael Goin
0b7e701dd4
[Docs] Update optimization.md doc (#17482) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-30 09:34:02 -07:00
Russell Bryant
39317cf42b
[Docs] Add command for running mypy tests from CI (#17475) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-04-30 08:06:09 -07:00
Marko Rosenmueller
77073c77bc
[Core] Prevent side-channel attacks via cache salting (#17045) 
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
 2025-04-30 20:27:21 +08:00
Marco
54072f315f
[MODEL ADDITION] Ovis2 Model Addition (#15826) 
Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-04-30 07:33:29 +00:00
Kunshang Ji
ed6cfb90c8
[Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
 2025-04-30 00:03:58 -07:00
Michael Goin
a44c4f1d2f
Support LoRA for Mistral3 (#17428) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-29 21:10:30 -07:00
Huy Do
2c4f59afc3
Update PyTorch to 2.7.0 (#16859) 2025-04-29 19:08:04 -07:00
Nicolò Lucchesi
792595b59d
[TPU][V1][CI] Replace python3 setup.py develop with standard pip install --e on TPU (#17374) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-04-29 10:36:48 -07:00
casinca
0c1c788312
[Doc][Typo] Fixing label in new model requests link in overview.md (#17400) 2025-04-29 10:29:48 -07:00
Russell Bryant
56d64fbe30
[Docs] Propose a deprecation policy for the project (#17063) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-04-29 10:29:44 -07:00
mofanke
a39203f99e
[Bugfix] add qwen3 reasoning-parser fix content is None when disable … (#17369) 
Signed-off-by: mofanke <mofanke@gmail.com>
 2025-04-29 16:32:40 +00:00
Cyrus Leung
00ee37efa2
[Bugfix] Clean up MiniMax-VL and fix processing (#17354) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-29 20:42:16 +08:00
Jee Jee Li
890f104cdf
[Doc] Fix QWen3MOE info (#17381) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-04-29 12:38:32 +00:00
Russell Bryant
a0304dc504
[Security] Don't bind tcp zmq socket to all interfaces (#17197) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-04-28 10:08:20 -07:00
Russell Bryant
72dfe4c74f
[Docs] Add a security guide (#17230) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-04-28 15:12:17 +00:00
Reid
3ad986c28b
[doc] update wrong model id (#17287) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-28 04:20:51 -07:00
Alex Brooks
fa93cd9f60
[Model] Add Granite Speech Support (#16246) 
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
 2025-04-28 10:05:00 +00:00
Reid
f211331c48
[Doc] small fix (#17277) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-28 03:53:35 +00:00
Reid
d92879baf6
[doc] Add feature status legend (#17257) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-27 08:17:02 -07:00
Russell Bryant
52b4f4a8d7
[Docs] Update structured output doc for V1 (#17135) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-04-26 15:12:18 +00:00
Cyrus Leung
909fdaf152
[Bugfix] Fix standard models tests (#17217) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-26 02:26:41 -07:00
yarongmu-google
7bd0c7745c
[Doc] Minor fix for the vLLM TPU setup page (#17206) 
Signed-off-by: Yarong Mu <ymu@google.com>
 2025-04-26 04:39:56 +00:00
Reid
537d5ee025
[doc] add Anything LLM integration (#17216) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-25 21:03:23 -07:00
Cyrus Leung
9d98ab5ec6
[Misc] Inline Molmo requirements (#17190) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-25 16:41:44 +00:00
Reid
df5c879527
[doc] update wrong hf model links (#17184) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-25 16:40:54 +00:00
Michael Yao
f851b84266
[Doc] Add two links to disagg_prefill.md (#17168) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-04-25 10:23:57 +00:00
Michael Yao
ef19e67d2c
[Doc] Add headings to improve gptqmodel.md (#17164) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-04-25 01:13:13 -07:00
Michael Goin
649818995f
[Docs] Fix True->true in supported_models.md (#17141) 2025-04-25 04:20:04 +00:00
Varun Sundar Rabindranath
7a0a9da72b
[Doc] V1 : Update LoRA status (#17133) 
Signed-off-by: varun sundar rabindranath <vsundarr@redhat.com>
Co-authored-by: varun sundar rabindranath <vsundarr@redhat.com>
 2025-04-24 20:17:22 -07:00
Maximilien de Bayser
05e1fbfc52
Add chat template for Llama 4 models (#16428) 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
 2025-04-24 20:19:36 +00:00
Russell Bryant
6d0df0ebeb
[Docs] Generate correct github links for decorated functions (#17125) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-04-24 10:39:43 -07:00