xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 10:30:37 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,621 Commits 155 Branches 89 Tags
Commit Graph

1000 Commits

Author SHA1 Message Date
David Xia
f728ab8e35
[Doc] mention how to install in CPU editable mode (#16923) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-04-21 17:45:51 +00:00
David Xia
63e26fff78
[doc] install required python3-dev apt package (#16888) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-04-21 16:15:18 +00:00
Yan Ma
fe3462c774
[XPU][Bugfix] minor fix for XPU (#15591) 
Signed-off-by: yan ma <yan.ma@intel.com>
 2025-04-22 00:02:57 +08:00
Alex Brooks
b34f33438a
[Doc] Split dummy_processor_inputs() in Multimodal Docs (#16915) 
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
 2025-04-21 11:10:01 +00:00
Reid
d6195a748b
[doc] update hyperlink (#16877) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-19 16:40:38 +00:00
Roger Wang
5124f5bf51
[Model] Qwen2.5-Omni Cleanup (#16872) 2025-04-19 09:37:02 +00:00
Isotr0py
83f3c3bd91
[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477) 
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-19 02:26:11 -07:00
Nicolò Lucchesi
2ef0dc53b8
[Frontend] Add sampling params to v1/audio/transcriptions endpoint (#16591) 
Signed-off-by: Jannis Schönleber <joennlae@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Jannis Schönleber <joennlae@gmail.com>
 2025-04-19 07:03:54 +00:00
Yang Fan
2c1bd848a6
[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) 
Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>
 2025-04-18 23:14:36 -07:00
Justin Ho
490b1698a5
[Doc] Updated Llama section in tool calling docs to have llama 3.2 config info (#16857) 
Signed-off-by: jmho <jaylenho734@gmail.com>
 2025-04-18 23:28:53 +00:00
Michael Yao
26507f8973
[Docs] Fix a link and grammar issue in production-stack.md (#16809) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-04-18 06:42:58 +00:00
Nathan Weinberg
9c1d5b456d
[Doc] add podman setup instructions for official image (#16796) 
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
 2025-04-18 06:10:49 +00:00
Harry Mellor
e78587a64c
Improve-mm-and-pooler-and-decoding-configs (#16789) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-04-17 22:13:32 -07:00
Cyrus Leung
c16fb5dae8
[Doc] Improve help examples for --compilation-config (#16729) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-17 21:22:34 -07:00
Mark McLoughlin
e4755f7fac
[V1][Metrics] Fix http metrics middleware (#15894) 2025-04-17 19:52:18 +00:00
Insu Kim
7c02d6a137
[Doc] Changed explanation of generation_tokens_total and prompt_tokens_total counter type metrics to avoid confusion (#16784) 
Signed-off-by: insukim1994 <insu.kim@moreh.io>
 2025-04-17 14:10:08 +00:00
wang.yuqi
11c3b98491
[Doc] Document Matryoshka Representation Learning support (#16770) 2025-04-17 13:37:37 +00:00
Cyrus Leung
dbe7f07001
[Doc] Make sure to update vLLM when installing latest code (#16781) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-17 06:53:31 -06:00
Reid
c69bf4ee06
fix: hyperlink (#16778) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-17 11:34:20 +00:00
Michael Yao
207da28186
[Doc] Fix a 404 link in installation/cpu.md (#16773) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-04-17 10:46:21 +00:00
intervitens
5b1aca2ae3
[Bugfix] Fix GLM4 model (#16618) 
Signed-off-by: intervitens <intervitens@tutanota.com>
 2025-04-17 03:35:07 -07:00
Reid
d8e557b5e5
[doc] add open-webui example (#16747) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-17 18:27:32 +08:00
Cyrus Leung
61a44a0b22
[Doc] Add more tips to avoid OOM (#16765) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-17 09:54:34 +00:00
Harry Mellor
3cd91dc955
Help user create custom model for Transformers backend remote code models (#16719) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-04-17 01:05:59 +00:00
xsank
ee378f3d49
[Model] support modernbert (#16648) 
Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com>
Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com>
 2025-04-16 05:30:15 -07:00
Cyrus Leung
facbe2a114
[Doc] Improve OOM troubleshooting (#16704) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-16 18:29:48 +08:00
Shinichi Hemmi
3badb0213b
[Model] Add PLaMo2 (#14323) 
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Signed-off-by: shemmi <shemmi@preferred.jp>
Co-authored-by: Kento Nozawa <nzw0301@preferred.jp>
Co-authored-by: Hiroaki Mikami <mhiroaki@preferred.jp>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>
 2025-04-15 19:31:30 -07:00
Angky William
fdcb850f14
[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546) 
Signed-off-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
Co-authored-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
 2025-04-15 22:31:38 +00:00
courage17340
b1308b84a3
[Model][VLM] Add Kimi-VL model support (#16387) 
Signed-off-by: courage17340 <courage17340@163.com>
 2025-04-14 21:41:48 +00:00
Cyrus Leung
d9fc8cd9da
[V1] Enable multi-input by default (#15799) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-12 08:52:39 +00:00
Ye (Charlotte) Qi
802329dee9
[Doc] Update Llama4 Model Names in Supported Models (#16509) 
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-04-12 02:53:10 +00:00
Christian Sears
c09632a66c
Update openai_compatible_server.md (#16507) 
Signed-off-by: Christian Sears <csears@redhat.com>
 2025-04-11 22:54:58 +00:00
Ye (Charlotte) Qi
16eda8c43a
[Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463) 
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Kai Wu <kaiwu@meta.com>
 2025-04-12 06:26:17 +08:00
Isotr0py
5285589f37
[Doc] Document InternVL3 support (#16495) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-04-11 19:41:09 +00:00
Michael Goin
ed37599544
Update supported_hardware.md for TPU INT8 (#16437) 2025-04-11 12:28:07 +08:00
Cyrus Leung
83b824c8b4
[VLM] Remove BaseProcessingInfo.get_mm_max_tokens_per_item (#16408) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-10 09:06:58 -07:00
Reid
ce8d6b75fc
[doc] update the wrong link (#16401) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-10 21:02:37 +08:00
Reid
65e09094c4
[doc] add download model tips (#16389) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-10 07:45:26 +00:00
Yuxuan Zhang
1e44ffc3ff
Add GLM-4-0414 support (#16338) 
Signed-off-by: lvfei.lv <lvfei.lv@alibaba-inc.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Ajay Vohra <ajayvohr@amazon.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Accelerator1996 <lvfei.lv@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: ajayvohra2005 <ajayvohr@amazon.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>
 2025-04-10 09:19:42 +08:00
Nicolò Lucchesi
d55244df31
[Model] Add SupportsMultiModal.get_language_model interface (#16007) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-04-09 04:12:54 -07:00
Chauncey
102bf967f0
[Model] Add smolvlm support (#16017) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-04-08 19:12:17 -07:00
Simon Mo
995e3d1f41
[Docs] Add Slides from Singapore Meetup (#16213) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-04-08 07:20:22 +00:00
Roger Wang
f2ebb6f541
[V1] Scatter and gather placeholders in the model runner (#16076) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
 2025-04-08 10:43:41 +08:00
Driss Guessous
652907b354
Torchao (#14231) 
Signed-off-by: drisspg <drisspguessous@gmail.com>
 2025-04-07 19:39:28 -04:00
Cyrus Leung
66d433b94f
[V1] Revert the default max_num_seqs to V0 values for most hardware (#16158) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-07 13:54:36 -04:00
Cyrus Leung
027b204ff1
[Bugfix] Re-enable support for ChatGLMForConditionalGeneration (#16187) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-07 23:15:58 +08:00
Lu Fang
55dcce91df
Upstream Llama4 Support to Main (#16113) 
Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-07 08:06:27 -07:00
Robin
8017c8db7f
[Doc]Update image to latest version (#16186) 
Signed-off-by: WangErXiao <863579016@qq.com>
 2025-04-07 14:17:39 +00:00
YamPengLi
7699258ef0
[Model] Add Qwen3 and Qwen3MoE (#15289) 
Signed-off-by: YamPengLi <yampayne.lyp@alibaba-inc.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-04-07 04:06:41 -07:00
yihong
95d63f38c0
doc: fix some typos in doc (#16154) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-04-07 05:32:06 +00:00