xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 21:45:44 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,419 Commits 155 Branches 89 Tags
Commit Graph

169 Commits

Author SHA1 Message Date
Isotr0py
7920e9b1c5
[Bugfix] Fix failing GPT-OSS initialization test (#22557) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-08-09 00:03:26 -07:00
Thomas Parnell
8a0ffd6285
Remove mamba_ssm from vLLM requirements; install inside test container using --no-build-isolation (#22541) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-08-08 23:05:32 -07:00
Harry Mellor
41b9655751
Skip Qwen 1 in CI because remote code is no longer compatible with Transformers (#22536) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-08 16:20:58 -07:00
tc-mb
41b67f4263
[model] Support MiniCPM-V 4.0 (#22166) 
Co-authored-by: imning3 <hbning@pku.edu.cn>
 2025-08-06 18:35:46 -07:00
Woosuk Kwon
de98252f49
Add GPT-OSS model code and config [1/N] (#22327) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-05 23:26:00 -07:00
Harry Mellor
796bae07c5
Update transformers to v4.55 (#21931) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-05 22:56:14 -07:00
Yuxuan Zhang
6fa41e0c32
self.gate dtype update for GLM-4.5 (#22203) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
 2025-08-04 19:12:38 -07:00
Raghav Ravishankar
a5fff3bd49
Fix Arcee model weight loading: Add custom load_weights (#21725) 
Signed-off-by: alyosha-swamy <raghav@arcee.ai>
 2025-08-04 04:09:56 -07:00
Jee Jee Li
a7b8788d2c
[Misc] Modify the organization of GLM series (#22171) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-08-03 23:51:20 -07:00
Isotr0py
6a39ba85fe
[Bugfix] Fix failing multimodal standard test (#22153) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-08-03 19:04:38 +00:00
Isotr0py
3dddbf1f25
[Misc] Add tensor schema test coverage for multimodal models (#21754) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-08-03 00:52:14 -07:00
Yuxuan Zhang
25373b6c6c
for glm-4.1V update (#22000) 
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2025-08-02 01:46:57 -07:00
Harry Mellor
38c8bce8b6
Enable headless models for pooling in the Transformers backend (#21767) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-01 10:31:29 -07:00
Cyrus Leung
82de9b9d46
[Misc] Automatically resolve HF processor init kwargs (#22005) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-31 22:44:10 -07:00
Song
9484641616
[Model] Add step3 vl (#21998) 
Signed-off-by: oliveryuan <yuansong@step.ai>
Co-authored-by: oliveryuan <yuansong@step.ai>
 2025-07-31 23:19:06 +08:00
Cyrus Leung
004203e953
[CI/Build] Fix registry tests (#21934) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-30 09:10:41 -07:00
Varun Vinayak Shenoy
547795232d
[Tests] Fixing bug inside MultiModalProfiler. (#21842) 
Signed-off-by: Varun Shenoy <varun.vinayak.shenoy@oracle.com>
 2025-07-30 00:44:15 -07:00
Anton Vlasjuk
656c24f1b5
[Ernie 4.5] Name Change for Base 0.3B Model (#21735) 
Signed-off-by: vasqu <antonprogamer@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-28 12:22:32 +00:00
Isotr0py
eed2f463b2
[VLM] Support HF format Phi-4-MM model (#17121) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-26 20:07:57 -07:00
Lyu Han
875af38e01
Support Intern-S1 (#21628) 
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-07-26 19:14:04 +08:00
Farzad Abdolhosseini
62965de5fe
[Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818) 
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
Signed-off-by: Patrick Li <patrick8289@gmail.com>
Co-authored-by: Patrick Li <patrick8289@gmail.com>
 2025-07-25 18:12:31 -07:00
bigshanedogg
29c6fbe58c
[MODEL] New model support for naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B (#20931) 
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
 2025-07-25 06:05:42 -07:00
Harry Mellor
13abd0eaf9
[Model] Officially support Emu3 with Transformers backend (#21319) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-24 03:22:12 -07:00
Asher
2671334d45
[Model] add Hunyuan V1 Dense Model support. (#21368) 
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
 2025-07-23 03:54:08 -07:00
Isotr0py
4ecedd1806
[Bugfix] Fix nightly transformers CI failure (#21427) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-23 00:01:01 -07:00
Harry Mellor
f154bb9ff0
Simplify weight loading in Transformers backend (#21382) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-22 20:29:43 -07:00
Cyrus Leung
35366ae57c
[CI/Build] Fix test failure due to updated model repo (#21375) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-22 08:39:35 -07:00
Raghav Ravishankar
82b8027be6
Add arcee model (#21296) 
Signed-off-by: alyosha-swamy <raghav@arcee.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-22 00:57:43 -07:00
Raushan Turganbay
9499e26e2a
[Model] Support VLMs with transformers backend (#20543) 
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-20 13:25:50 +00:00
Yuxuan Zhang
10eb24cc91
GLM-4 Update (#20736) 
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>
 2025-07-19 22:40:31 +00:00
Woosuk Kwon
752c6ade2e
[V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-19 13:53:17 -07:00
Huy Do
cf8cc32674
Fix a couple of Voxtral tests (#21218) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-07-19 09:13:41 +00:00
김종곤
3e04107d97
[Model] EXAONE 4.0 model support (#21060) 
Signed-off-by: Deepfocused <rlawhdrhs27@gmail.com>
Signed-off-by: woongsik <rlawhdrhs27@gmail.com>
 2025-07-19 14:25:44 +08:00
Woosuk Kwon
dd572c0ab3
[V0 Deprecation] Remove V0 Spec Decode workers (#21152) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-18 21:47:50 -07:00
wang.yuqi
ca4eb82bcb
[Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-18 07:15:07 +00:00
kYLe
4ef00b5cac
[VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) 
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-17 03:07:55 -07:00
zhiweiz
c11013db8b
[Meta] Llama4 EAGLE Support (#20591) 
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>
 2025-07-15 21:14:15 -07:00
Patrick von Platen
cfbcb9ed87
[Voxtral] Add more tests (#21010) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-07-15 21:11:49 -07:00
Patrick von Platen
e7e3e6d263
Voxtral (#20970) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-15 07:35:30 -07:00
ant-yy
38efa28278
[Model] Add Ling implementation (#20680) 
Signed-off-by: vito.yy <vito.yy@antgroup.com>
 2025-07-14 22:10:32 +08:00
Minkyu Kim
bd4c1e6fdb
Support for LlamaForSequenceClassification (#20807) 
Signed-off-by: thechaos16 <thechaos16@gmail.com>
 2025-07-13 00:09:34 -07:00
Congcong Chen
2c11a738b3
[Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) 
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
 2025-07-12 06:02:10 -07:00
Michael Goin
922f316441
[Model] Support HF format of minimax (#20211) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-11 02:55:21 +00:00
shineran96
4bed167768
[Model][VLM] Support JinaVL Reranker (#20260) 
Signed-off-by: shineran96 <shinewang96@gmail.com>
 2025-07-10 10:43:43 -07:00
B-201
6bbf1795b7
[Misc] Fix the size of batched_dummy_mm_inputs in profile_run (#20434) 
Signed-off-by: bk-201 <joy25810@foxmail.com>
 2025-07-08 20:15:44 -07:00
wang.yuqi
110df74332
[Model][Last/4] Automatic conversion of CrossEncoding model (#19675) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-07 14:46:04 +00:00
Cyrus Leung
9fb52e523a
[V1] Support any head size for FlexAttention backend (#20467) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-06 09:54:36 -07:00
Thomas Parnell
2f35a022e6
Enable V1 for Hybrid SSM/Attention Models (#20016) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
 2025-07-04 17:46:53 +00:00
CSWYF3634076
e303dcf523
[Model] Add Ernie4.5 and Ernie4.5MoE Model Support (#20220) 
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
 2025-07-02 03:37:01 -07:00
Kwai-Keye
8452946c06
[Model][VLM] Support Keye-VL-8B-Preview (#20126) 
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
 2025-07-01 23:35:04 -07:00