xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-05-11 12:41:27 +08:00
Code Issues Packages Projects Releases Wiki Activity
10,964 Commits 155 Branches 89 Tags
Commit Graph

388 Commits

Author SHA1 Message Date
Ekagra Ranjan
e136000595
[V1][Spec Decode] Make Eagle model arch config driven (#17323) 2025-04-29 10:22:02 +08:00
Cyrus Leung
aec9674dbe
[Core] Remove legacy input mapper/processor from V0 (#15686) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-28 15:38:48 +08:00
Cyrus Leung
93a126fbc7
[Misc] Make cached tokenizer pickle-compatible (#17048) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-27 13:05:00 +08:00
Harry Mellor
423e9f1cbe
Use Transformers helper get_text_config() instead of checking for text_config (#17105) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-04-25 08:47:35 -07:00
Michael Goin
9420a1fc30
Better error message for missing mistral params.json (#17132) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-24 23:43:08 +00:00
Isotr0py
b0c1f6202d
[Misc] Remove OLMo2 config copy (#17066) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-04-24 06:14:32 -07:00
Harry Mellor
0a05ed57e6
Simplify TokenizerGroup (#16790) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-04-24 04:43:56 -07:00
Michael Goin
aa72d9a4ea
Mistral-format support for compressed-tensors (#16803) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-23 08:46:23 -04:00
Chauncey
6bc1e30ef9
Revert "[Misc] Add S3 environment variables for better support of MinIO." (#17021) 2025-04-22 19:22:29 -07:00
Chauncey
68d4c33202
[Misc] Add S3 environment variables for better support of MinIO. (#16977) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-04-22 14:27:36 +00:00
Yang Fan
2c1bd848a6
[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) 
Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>
 2025-04-18 23:14:36 -07:00
courage17340
b1308b84a3
[Model][VLM] Add Kimi-VL model support (#16387) 
Signed-off-by: courage17340 <courage17340@163.com>
 2025-04-14 21:41:48 +00:00
Lily Liu
e8224f3dca
[V1][Spec Decode] Eagle Model loading (#16035) 
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
 2025-04-10 11:21:48 -07:00
Guillaume Calmettes
1da6a09274
[Bugfix]: do not shutdown server if skip_special_use=False for MistralTokenizer (#14094) 
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
 2025-04-09 19:43:09 -07:00
paolovic
da224daaa9
[Bugfix] add hf_token to EngineArgs (#16093) 
Signed-off-by: paolovic <paul-philipp.luley@uzh.ch>
Co-authored-by: paolovic <paul-philipp.luley@uzh.ch>
 2025-04-06 14:47:33 +00:00
Isotr0py
c2a9671510
[Misc] Improve model redirect to accept json dictionary (#16119) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-04-06 05:51:45 -07:00
Reid
86cbd2eee9
[Misc] improve gguf check (#15974) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-04 01:33:36 +00:00
yihong
37bfee92bf
fix: better error message for get_config close #13889 (#15943) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-04-03 03:53:19 +00:00
yihong
70fedd0f79
fix: Comments to English for better dev experience (#15768) 
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
 2025-03-30 10:47:57 -07:00
pengyuange
de1cb38769
[Model] Support Skywork-R1V (#15397) 
Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>
 2025-03-28 20:39:21 -07:00
Kebe
432cf22a6a
[Bugfix] Fix regex compile display format (#15368) 
Signed-off-by: Kebe <mail@kebe7jun.com>
 2025-03-28 08:58:44 -07:00
wang.yuqi
3f532cb6a6
[Misc] Use model_redirect to redirect the model name to a local folder. (#14116) 2025-03-27 02:21:23 -07:00
Bryan Lu
781d056280
[Feature] Enhance EAGLE Architecture with Proper RMS Norms (#14990) 
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-03-26 08:24:07 +00:00
Nick Hill
da6ea29f7a
[V1] Avoid redundant input processing in n>1 case (#14985) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-03-20 22:24:10 -07:00
Wang Ran (汪然)
c607a2652b
Fixing Imprecise Type Annotations (#15192) 2025-03-20 01:19:55 -07:00
Brayden Zhong
8b3e94a357
[Model] Remove duplicated message check in Mistral chat completion request (#15069) 
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2025-03-19 05:09:32 +00:00
Rémi Delacourt
61c6a5a796
[VLM] Merged multi-modal processor for Pixtral (#12211) 
Signed-off-by: remi <remi@mistral.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-03-15 06:28:27 -07:00
Harry Mellor
3b352a2f92
Correct capitalisation: VLLM -> vLLM (#14562) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-03-10 16:36:21 +00:00
Jee Jee Li
6a84164add
[Bugfix] Add file lock for ModelScope download (#14060) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-03-01 06:10:28 +00:00
Florian Greinacher
215bf150a6
[Bugfix] Handle None parameters in Mistral function calls. (#13786) 2025-02-26 03:06:21 -08:00
Jee Jee Li
5157338ed9
[Misc] Improve LoRA spelling (#13831) 2025-02-25 23:43:01 -08:00
Chen1022
340e39e387
Fix string parsing error (#13825) 2025-02-25 08:20:29 -08:00
Chen1022
32c3b6bfd1
[Misc]Clarify Error Handling for Non-existent Model Paths and HF Repo IDs (#13724) 
Signed-off-by: Chen-0210 <chenjincong11@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-02-25 10:12:19 +00:00
Shanshan Shen
2d87d7d1ac
[Bugfix] Modify modelscope api usage in transformer_utils (#13807) 2025-02-25 00:36:07 -08:00
cjackal
51010a1807
[Misc] set single whitespace between log sentences (#13771) 
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
 2025-02-25 10:26:12 +08:00
燃
041e294716
[Misc] add mm_processor_kwargs to extra_body for Qwen2.5-VL (#13533) 2025-02-19 23:04:30 -08:00
Isotr0py
550d97eb58
[Misc] Avoid calling unnecessary hf_list_repo_files for local model path (#13348) 
Signed-off-by: isotr0py <2037008807@qq.com>
 2025-02-19 18:57:48 +00:00
Cyrus Leung
377d10bd14
[VLM][Bugfix] Pass processor kwargs properly on init (#13516) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-02-19 13:13:50 +00:00
Kevin H. Luu
d5d214ac7f
[1/n][CI] Load models in CI from S3 instead of HF (#13205) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-19 07:34:59 +00:00
Isotr0py
29fc5772c4
[Bugfix] Remove noisy error logging during local model loading (#13458) 2025-02-18 03:15:48 -08:00
r.4ntix
ce77eb9410
[Bugfix] Fix VLLM_USE_MODELSCOPE issue (#13384) 2025-02-17 14:22:01 +00:00
Rafael Vasquez
314cfade02
[Frontend] Generate valid tool call IDs when using tokenizer-mode=mistral (#12332) 2025-02-12 08:29:56 -08:00
Shiyan Deng
f1042e86f0
[Misc] AMD Build Improvements (#12923) 2025-02-12 02:36:10 -08:00
Maximilien de Bayser
7c4033acd4
Further reduce the HTTP calls to huggingface.co (#13107) 2025-02-12 02:34:09 -08:00
Keyun Tong
3ee696a63d
[RFC][vllm-API] Support tokenizer registry for customized tokenizer in vLLM (#12518) 
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
 2025-02-12 12:25:58 +08:00
Florian Greinacher
cb080f32e3
[Bugfix] Support missing tool parameters in mistral tokenizer (#12884) 
Signed-off-by: Florian Greinacher <florian.greinacher@siemens.com>
 2025-02-11 03:33:33 +00:00
Farzad Abdolhosseini
08b2d845d6
[Model] Ultravox Model: Support v0.5 Release (#12912) 
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
 2025-02-10 22:02:48 +00:00
Kevin H. Luu
fde71262e0
[misc] Add retries with exponential backoff for HF file existence check (#13008) 2025-02-10 01:15:02 -08:00
Patrick von Platen
d366ccc4e3
[RFC] [Mistral] FP8 format (#10130) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2025-02-08 14:12:53 -07:00
zifeitong
d01f66b039
[Bugfix] Fix multi-round chat error when mistral tokenizer is used (#12859) 
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-02-08 07:04:34 +00:00