xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 15:45:34 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,400 Commits 155 Branches 89 Tags
Commit Graph

959 Commits

Author SHA1 Message Date
Reid
d1110f5b5a
[doc] update lora doc (#17936) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-11 15:56:21 +08:00
Reid
ec61ea20a8
[Misc] add dify integration (#17895) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-09 03:42:39 -07:00
Yan Ma
ff8c400502
[Doc] remove visible token in doc (#17884) 
Signed-off-by: yan <yanma1@habana.ai>
 2025-05-09 01:21:31 -07:00
Michael Yao
89a0315f4c
[Doc] Update several links in reasoning_outputs.md (#17846) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-05-09 01:20:55 -07:00
Simon Mo
3d1e387652
[Docs] Add Slides from NYC Meetup (#17879) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-05-08 21:46:54 -07:00
Reid
53d0cb7423
[Misc] add chatbox integration (#17828) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-08 10:05:26 +00:00
Cyrus Leung
96722aa81d
[Frontend] Chat template fallbacks for multimodal models (#17805) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-07 23:05:54 -07:00
Chanh Nguyen
7ea2adb802
[Core] Support full cuda graph in v1 (#16072) 
Signed-off-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
 2025-05-07 22:30:15 -07:00
Harry Mellor
66ab3b13c9
Don't call the venv vllm (#17810) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-08 04:06:39 +00:00
Reid
7377dd0307
[doc] update the issue link (#17782) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-07 20:29:05 +08:00
Cyrus Leung
8a15c2603a
[Frontend] Add missing chat templates for various MLLMs (#17758) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-07 00:10:01 -07:00
Harry Mellor
022afbeb4e
Fix doc build performance (#17748) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-07 00:36:41 +00:00
Harry Mellor
6115b11582
Make right sidebar more readable in "Supported Models" (#17723) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-06 16:48:26 +00:00
Reid
7525d5f3d5
[doc] Add RAG Integration example (#17692) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-06 16:10:23 +00:00
Michael Yao
0d115460a7
[Docs] Use gh-file to add links to tool_calling.md (#17709) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-05-06 15:27:19 +00:00
Harry Mellor
05e1f96419
Fix dockerfilegraph pre-commit hook (#17698) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-06 08:56:48 +00:00
Cyrus Leung
63ced7b43f
[Doc] Update notes for H2O-VL and Gemma3 (#17219) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-06 07:51:02 +00:00
Stan Wozniak
999328be0d
[Model] Add GraniteMoeHybrid 4.0 model (#17497) 
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
 2025-05-06 12:00:31 +08:00
Michael Goin
98834fefaa
Update nm to rht in doc links + refine fp8 doc (#17678) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-05-06 00:41:14 +00:00
Harry Mellor
d6484ef3c3
Add full API docs and improve the UX of navigating them (#17485) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-03 19:42:43 -07:00
Zhiyu
182f40ea8b
Add NVIDIA TensorRT Model Optimizer in vLLM documentation (#17561) 2025-05-02 11:36:46 -07:00
Reid
3a500cd0b6
[doc] miss result (#17589) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-02 07:04:49 -07:00
Reid
6d1479ca4b
[doc] add the print result (#17584) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-02 05:24:45 -07:00
David Xia
afb12e4294
[Doc] note that not all unit tests pass on CPU platforms (#17554) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-05-02 02:57:21 +00:00
Hongxia Yang
4acfa3354a
[ROCm] update installation guide to include build aiter from source instructions (#17542) 
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-01 11:01:28 -07:00
Chauncey
98060b001d
[Feature][Frontend]: Deprecate --enable-reasoning (#17452) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-05-01 06:46:16 -07:00
Reid
7169f87ad0
[doc] add streamlit integration (#17522) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-01 13:34:02 +00:00
NaLan ZeYu
1144a8efe7
[Bugfix] Temporarily disable gptq_bitblas on ROCm (#17411) 
Signed-off-by: Yan Cangang <nalanzeyu@gmail.com>
 2025-04-30 19:51:45 -07:00
Reid
2ac74d098e
[doc] add install tips (#17373) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-30 17:02:41 +00:00
Michael Goin
0b7e701dd4
[Docs] Update optimization.md doc (#17482) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-30 09:34:02 -07:00
Russell Bryant
39317cf42b
[Docs] Add command for running mypy tests from CI (#17475) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-04-30 08:06:09 -07:00
Marko Rosenmueller
77073c77bc
[Core] Prevent side-channel attacks via cache salting (#17045) 
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
 2025-04-30 20:27:21 +08:00
Marco
54072f315f
[MODEL ADDITION] Ovis2 Model Addition (#15826) 
Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-04-30 07:33:29 +00:00
Kunshang Ji
ed6cfb90c8
[Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
 2025-04-30 00:03:58 -07:00
Michael Goin
a44c4f1d2f
Support LoRA for Mistral3 (#17428) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-29 21:10:30 -07:00
Huy Do
2c4f59afc3
Update PyTorch to 2.7.0 (#16859) 2025-04-29 19:08:04 -07:00
Nicolò Lucchesi
792595b59d
[TPU][V1][CI] Replace python3 setup.py develop with standard pip install --e on TPU (#17374) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-04-29 10:36:48 -07:00
casinca
0c1c788312
[Doc][Typo] Fixing label in new model requests link in overview.md (#17400) 2025-04-29 10:29:48 -07:00
Russell Bryant
56d64fbe30
[Docs] Propose a deprecation policy for the project (#17063) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-04-29 10:29:44 -07:00
mofanke
a39203f99e
[Bugfix] add qwen3 reasoning-parser fix content is None when disable … (#17369) 
Signed-off-by: mofanke <mofanke@gmail.com>
 2025-04-29 16:32:40 +00:00
Cyrus Leung
00ee37efa2
[Bugfix] Clean up MiniMax-VL and fix processing (#17354) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-29 20:42:16 +08:00
Jee Jee Li
890f104cdf
[Doc] Fix QWen3MOE info (#17381) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-04-29 12:38:32 +00:00
Russell Bryant
a0304dc504
[Security] Don't bind tcp zmq socket to all interfaces (#17197) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-04-28 10:08:20 -07:00
Russell Bryant
72dfe4c74f
[Docs] Add a security guide (#17230) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-04-28 15:12:17 +00:00
Reid
3ad986c28b
[doc] update wrong model id (#17287) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-28 04:20:51 -07:00
Alex Brooks
fa93cd9f60
[Model] Add Granite Speech Support (#16246) 
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
 2025-04-28 10:05:00 +00:00
Reid
f211331c48
[Doc] small fix (#17277) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-28 03:53:35 +00:00
Reid
d92879baf6
[doc] Add feature status legend (#17257) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-27 08:17:02 -07:00
Russell Bryant
52b4f4a8d7
[Docs] Update structured output doc for V1 (#17135) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-04-26 15:12:18 +00:00
Cyrus Leung
909fdaf152
[Bugfix] Fix standard models tests (#17217) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-26 02:26:41 -07:00