xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-05-12 23:05:48 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,134 Commits 155 Branches 89 Tags
Commit Graph

296 Commits

Author SHA1 Message Date
Cyrus Leung
2ca5f82c2a
[Misc] Remove redundant config definitions (#21891) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-29 23:54:18 -07:00
Michard Hugo
25708d317a
[Bugfix] Mistral crashes on tool with no description (#21167) 
Signed-off-by: HugoMichard <hugo@harfanglab.fr>
 2025-07-28 08:03:35 -07:00
Cyrus Leung
86ae693f20
[Deprecation][2/N] Replace --task with --runner and --convert (#21470) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-27 19:42:40 -07:00
Isotr0py
eed2f463b2
[VLM] Support HF format Phi-4-MM model (#17121) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-26 20:07:57 -07:00
Reid
05c1126f29
[Misc] remove unused try-except in pooling config check (#21618) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-26 12:20:03 +00:00
Farzad Abdolhosseini
62965de5fe
[Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818) 
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
Signed-off-by: Patrick Li <patrick8289@gmail.com>
Co-authored-by: Patrick Li <patrick8289@gmail.com>
 2025-07-25 18:12:31 -07:00
Kebe
7311f74468
[Bugfix] GGUF: fix AttributeError: 'PosixPath' object has no attribute 'startswith' (#21579) 
Signed-off-by: Kebe <mail@kebe7jun.com>
 2025-07-25 03:42:23 -07:00
Julien Denize
6d8d0a24c0
Add think chunk (#21333) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
 2025-07-23 21:51:32 -07:00
Isotr0py
4ecedd1806
[Bugfix] Fix nightly transformers CI failure (#21427) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-23 00:01:01 -07:00
Cyrus Leung
378d33c392
[Bugfix] Fix missing placeholder in logger debug (#21280) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-20 22:50:06 -07:00
김종곤
3e04107d97
[Model] EXAONE 4.0 model support (#21060) 
Signed-off-by: Deepfocused <rlawhdrhs27@gmail.com>
Signed-off-by: woongsik <rlawhdrhs27@gmail.com>
 2025-07-19 14:25:44 +08:00
Woosuk Kwon
dd572c0ab3
[V0 Deprecation] Remove V0 Spec Decode workers (#21152) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-18 21:47:50 -07:00
wang.yuqi
5895afd780
[Bugfix] The special_tokens in tokenizer should also be controlled by do_lower_case in encoder_config. (#20750) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-18 09:10:47 +00:00
kYLe
4ef00b5cac
[VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) 
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-17 03:07:55 -07:00
Harry Mellor
a931b4cdcf
Remove Qwen Omni workaround that's no longer necessary (#21057) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-16 16:25:23 +00:00
Cyrus Leung
1c3198b6c4
[Model] Consolidate pooler implementations (#20927) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-16 13:39:13 +00:00
Patrick von Platen
e7e3e6d263
Voxtral (#20970) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-15 07:35:30 -07:00
Isotr0py
3fc964433a
[Misc] Clean up Aimv2 config registration in Ovis config (#20921) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-14 15:36:43 +00:00
Chauncey
a4851cfe68
[Bugfix]: Fix messy code when using logprobs (#20910) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-14 11:06:45 +00:00
Wang Siyuan
247102f07f
[Bugfix] Fix: add patch_rope_scaling after hf override (#20857) 
Signed-off-by: Wang Siyuan <wsy0227@sjtu.edu.cn>
Signed-off-by: Wang Siyuan <sywang0227@gmail.com>
 2025-07-13 00:13:25 -07:00
Harry Mellor
3482fd7e4e
[Doc] Add engine args back in to the docs (#20674) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-10 08:02:40 -07:00
Chauncey
93b9d9f499
[Bugfix]: Fix messy code when using logprobs (#19209) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-08 11:02:15 +08:00
Patrick von Platen
14601f5fba
[Config] Refactor mistral configs (#20570) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2025-07-07 15:25:10 -07:00
Cyrus Leung
c18b3b8e8b
[Bugfix] Add use_cross_encoder flag to use correct activation in ClassifierPooler (#20527) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-06 14:01:48 -07:00
Jee Jee Li
1caca5a589
[Misc] Add SPDX-FileCopyrightText (#20428) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-04 07:40:42 +00:00
Seiji Eicher
8d1096e7db
[Bugfix] Register reducer even if transformers_modules not available (#19510) 
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
 2025-07-03 22:08:12 +00:00
Isotr0py
71d6de3a26
[Misc] Clean up InternVL family config registration (#19992) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-03 20:01:47 +00:00
rongfu.leng
139508a418
[Misc] add handler HF_TOKEN is emptry string (#20369) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-07-02 09:14:31 -07:00
Ning Xie
2f1c19b245
[CI] change spell checker from codespell to typos (#18711) 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
 2025-06-11 19:57:10 -07:00
Li Wang
1efef71645
[Bugfix] Fix modelscope token passed in (#19389) 
Signed-off-by: wangli <wangli858794774@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-06-10 13:39:37 +08:00
wang.yuqi
2ffb9b6e07
[Bugfix] model_max_length should consider max_model_len in tokenizer_config (#19201) 2025-06-08 07:17:53 -07:00
Luis Vega
cb6d572e85
[Model] NemotronH support (#18863) 
Signed-off-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
Co-authored-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
 2025-06-05 21:29:28 +00:00
Patrick von Platen
f20f9f063b
[mistral_common] Add v11 tokenizer (#19193) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2025-06-05 08:27:41 -07:00
Simon Mo
02f0c7b220
[Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
Cyrus Leung
6aa8f9a4e7
[Core] Rework dtype resolution (#18751) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-06-01 11:04:23 +08:00
Maximilien de Bayser
515b413ebf
Prevent the cross-encoder logic from being applied to classification tasks (#18838) 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-28 19:16:17 -07:00
RonaldBXu
5e13c07d00
[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (2) (#18781) 
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>
 2025-05-28 05:09:14 +00:00
Michael Goin
5873877241
[Bugfix] Mistral tool calling when content is list (#18729) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-05-27 09:05:37 -07:00
Mengqing Cao
6ab681bcbe
[Misc][ModelScope] Change to use runtime VLLM_USE_MODELSCOPE (#18655) 
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2025-05-25 04:51:21 +00:00
Mathieu Borderé
45ab403a1f
config.py: Clarify that only local GGUF checkpoints are supported. (#18623) 
Signed-off-by: Mathieu Bordere <mathieu@letmetweakit.com>
 2025-05-24 08:46:34 +08:00
Feng XiaoLong
4fc1bf813a
[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) 
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
 2025-05-23 16:16:26 -07:00
Cyrus Leung
fbb13a2c15
Revert "[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (#18034)" (#18600) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-23 02:18:22 -07:00
RonaldBXu
4c611348a7
[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (#18034) 
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>
 2025-05-23 00:37:18 -07:00
Chenheli Hua
04eb88dc80
Re-submit: Fix: Proper RGBA -> RGB conversion for PIL images. (#18569) 
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
 2025-05-23 01:59:18 +00:00
Ekagra Ranjan
a04720bc36
[V1][Spec Decode][Bugfix] Load quantize weights for EAGLE (#18290) 2025-05-22 15:17:33 -07:00
汪志鹏
4ee4826ede
[BugFix] Correct max_model_len derivation from config.json for Mistral format (#17937) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: tracelogfb <48808670+tracelogfb@users.noreply.github.com>
Co-authored-by: Stephen Chen <tracelog@meta.com>
 2025-05-17 04:20:13 +00:00
Harry Mellor
8c946cecca
Update deprecated type hinting in vllm/transformers_utils (#18058) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-13 04:34:37 -07:00
Jee Jee Li
7ea6cb28b2
[Misc] Improve modelscope import error (#17983) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-05-12 10:46:45 +00:00
Isotr0py
021c16c7ca
[Model] Broadcast Ovis2 implementation to fit Ovis1.6 (#17861) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-05-11 17:56:30 -07:00
xinli-centml
90d0a74b60
[Bugfix] Add revision to transformers.Auto*.from_pretrained processors (#17948) 
Signed-off-by: Xin Li <xin@centml.ai>
 2025-05-11 07:52:44 +00:00