xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 06:55:01 +08:00
Code Issues Packages Projects Releases Wiki Activity
11,050 Commits 155 Branches 89 Tags
Commit Graph

547 Commits

Author SHA1 Message Date
Alex Brooks
e70fbc599b
[CI/Build] Loosen STT LoRA Translate Check (Flaky Test) (#28247) 
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Signed-off-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-11-07 02:51:27 +00:00
Isotr0py
3f5a4b6473
[Bugfix] Validate custom logits processor xargs for online serving (#27560) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-11-05 16:53:33 +00:00
Alex Brooks
b7cbc25416
[Model, Core] Support Granite Speech & LoRA for STT (#24455) 2025-11-05 08:33:48 +01:00
Misha Efimov
ba464e6ae2
Add ORCA endpoint load metrics support (#24905) 
Signed-off-by: Misha Efimov <mef@google.com>
 2025-11-03 08:21:31 +00:00
Vensen
0ce743f4e1
Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420) 
Signed-off-by: vensenmu <vensenmu@gmail.com>
 2025-11-02 16:24:01 +00:00
Ben Browning
758ea2e980
[CI/Build] Fix flaky test_transcription_validation.py::test_basic_audio_gemma (#27924) 
Signed-off-by: Ben Browning <bbrownin@redhat.com>
 2025-11-02 03:45:02 +00:00
Benjamin Bartels
1e88fb751b
Adds anthropic /v1/messages endpoint to openai api_server (#27882) 
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
 2025-11-01 12:45:42 -07:00
cong-meta
a2981c4272
[EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) 
Co-authored-by: Cong Chen <prowindy@gmail.com>
 2025-10-30 12:10:16 -07:00
wang.yuqi
4464723f22
[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) 
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-10-30 12:13:05 +00:00
Braulio Dumba
1da3309ace
[Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) 
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
 2025-10-29 09:32:01 -07:00
Alec S
ab2eb27b74
[Frontend] [gpt-oss] Mcp type bug (#27689) 
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-10-29 10:01:32 +00:00
Junpu Fan
b186149e8e
[Bugfix][Frontend] validate arg priority in frontend LLM class before add request (#27596) 
Signed-off-by: Junpu Fan <junpufan@gmail.com>
 2025-10-28 14:02:43 +00:00
wangln19
446912d1cb
fix: allow HuggingFace standard chat template params via **kwargs (#27622) 
Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-10-28 21:12:34 +08:00
Matthew Bonanni
44b5ce956d
[Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2025-10-28 12:00:56 +00:00
Andrew Xia
53a56e658b
[gpt-oss][2/N] Support input_messages in responsesRequest (#26962) 
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
 2025-10-27 23:15:49 +00:00
Ben Browning
3b96f85c36
[Chore]: Stream tokens vs characters in tool call parser tests (#26513) 
Signed-off-by: Ben Browning <bbrownin@redhat.com>
 2025-10-27 23:06:25 +08:00
Chauncey
a4fc21895e
[Bugfix] Fixed when return_token_ids=False, the first event still contains prompt_token_ids. (#27561) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-10-27 11:06:43 +00:00
Yeshwanth N
71b1c8b667
[Chore]:Extract math and argparse utilities to separate modules (#27188) 
Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>
 2025-10-26 04:03:32 -07:00
Chauncey
41a62564a7
Fix test named tool use (#27458) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-10-24 20:27:45 +08:00
strinczer
074475541a
[Bugfix] Fix Pydantic union resolution for ResponseFunctionToolCall in Responses API (#26706) 
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-10-23 22:53:42 -07:00
Cyrus Leung
fe2016de2d
[CI/Build] Remove unnecessary flags from test registry (#27353) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-23 14:42:40 +00:00
Chauncey
d00ce29d89
[CI] Reorganize entrypoints tests (#27403) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-10-23 10:10:06 +00:00
RED
c9461e05a4
Support Anthropic API /v1/messages Endpoint (#22627) 
Signed-off-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-10-22 09:13:18 -07:00
Russell Bryant
58fab50d82
[Frontend] Require flag for loading text and image embeds (#27204) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-22 15:52:02 +00:00
wang.yuqi
1f633b8632
[Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) 
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-10-22 18:38:57 +08:00
ExtReMLapin
a4c29e6e82
fixed reasoning streaming with tool_choice="required" (#24108) 
Signed-off-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Signed-off-by: ExtReMLapin <3909752+ExtReMLapin@users.noreply.github.com>
Co-authored-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2025-10-22 09:42:55 +00:00
Russell Bryant
3ada34f9cb
[Frontend] Enforce tokenize=False when applying chat template (#27205) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-10-21 02:57:34 +00:00
iAmir97
7a6c8c3fa1
[Chore] Separate out vllm.utils.network_utils (#27164) 
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
 2025-10-19 03:06:32 -07:00
dongbo910220
83004020fd
[Test] Add test for /health endpoint on engine failure (#26074) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2025-10-18 09:59:05 +00:00
Hanchenli
7c572544e4
[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515) 
Signed-off-by: Hanchenli <lihanc2002@gmail.com>
Signed-off-by: Hanchenli <61769611+Hanchenli@users.noreply.github.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wei Wei <wwei6@meta.com>
Co-authored-by: Wei Wei <weiweinpu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-10-17 21:55:54 -07:00
Tahsin Tunan
43721bc67f
[CI] Replace large models with tiny alternatives in tests (#24057) 
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-16 15:51:27 +01:00
Cyrus Leung
76f0d05bc6
[CI/Build] Update expected beam search output for Phi3V (#26978) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-16 05:12:44 +00:00
InChang Jeong
0ecc553ee6
[Bugfix] reasoning_parser parameter handling in run_batch.py (#26225) 
Signed-off-by: inc-jeong <inc.jeong@navercorp.com>
Signed-off-by: InChang Jeong <inc.jeong@navercorp.com>
Co-authored-by: USER <user@AL02367916.local>
 2025-10-16 10:24:05 +08:00
Pradeep Dasigi
4794c2bd92
Olmo 3 tool parser and tests (#26143) 
Signed-off-by: Pradeep Dasigi <pradeepd@allenai.org>
 2025-10-15 16:36:12 +00:00
wang.yuqi
f54f85129e
[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-10-15 11:14:41 +00:00
Cyrus Leung
b8a4572157
[Misc] Use helper function to generate dummy messages in OpenAI MM tests (#26875) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-15 07:17:37 +00:00
Ye Hu
0512c04aee
[frontend][gptoss] Add per turn stats into Harmony Context (#25061) 
Signed-off-by: lacora <hyelacora@gmail.com>
Co-authored-by: Ye Hu <yehu@fb.com>
 2025-10-14 16:48:13 -07:00
Chauncey
df850c4912
[Feature][Responses API] Stream Function Call - harmony (#24317) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-10-14 08:31:43 -07:00
Chauncey
780eb03d9b
[CI] Fix test_tool_id_kimi_k2 (#26787) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-10-14 10:27:07 +00:00
Max Wittig
fd85c9f426
[Bugfix][FE]: Always include usage with --enable-force-include-usage (#20983) 
Signed-off-by: Max Wittig <max.wittig@siemens.com>
Signed-off-by: Antoine Auger <antoineauger@users.noreply.github.com>
Co-authored-by: Antoine Auger <antoineauger@users.noreply.github.com>
 2025-10-14 09:17:39 +02:00
Jialin Ouyang
35bc22f23c
[ResponseAPI] Further polish message serialization and unit tests (#26728) 
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
 2025-10-13 23:31:35 +00:00
wang.yuqi
d2a7938582
[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64 (Still uses fp32 by default). (#26414) 
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-10-13 19:06:43 +00:00
Jialin Ouyang
4073c82c4e
[ResponseAPI] Simplify input/output message serialization (#26620) 
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
 2025-10-13 09:59:15 +00:00
wang.yuqi
767c3ab869
[Model][0/N] Improve all pooling task | clean up (#25817) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-10-13 16:44:50 +08:00
Harry Mellor
8fcaaf6a16
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-12 09:51:31 -07:00
Chauncey
910abdbd08
[Bugfix] fixed top_logprobs: -1 does not appear to work as intended (#26470) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-10-11 00:41:17 +08:00
Mark McLoughlin
e519281920
[Metrics] Add test for multi-modal cache stats logging (#26588) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2025-10-10 16:00:50 +00:00
Chauncey
1e6848a65d
[CI] fix test_run_batch.py::test_completions - AssertionError (#26578) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-10-10 22:16:28 +08:00
Chauncey
720d3cd0f0
[CI] fix ruff format (#26579) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-10-10 03:02:12 -07:00
Ashwin Phadke
ab196edefb
Remove LoRA bias support (#25807) 
Signed-off-by: Ashwin Phadke <ashwinphadke12@rediffmail.com>
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-10-10 09:50:33 +00:00