xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-04-29 23:57:20 +08:00
Code Issues Packages Projects Releases Wiki Activity
12,272 Commits 155 Branches 89 Tags
Commit Graph

297 Commits

Author SHA1 Message Date
Aaron Pham
29283e8976
[Chore] Cleanup guided namespace, move to structured outputs config (#22772) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-18 09:20:27 +00:00
Andrew Xia
bff2e5f1d6
[gpt-oss][2] fix types for streaming (#24556) 
Signed-off-by: Andrew Xia <axia@meta.com>
 2025-09-17 22:04:28 +00:00
Woosuk Kwon
5801e49776
[V0 Deprecation] Remove MQLLMEngine (#25019) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
 2025-09-16 21:29:27 -07:00
Andrew Xia
73df49ef3a
[gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still (#24759) 
Signed-off-by: Andrew Xia <axia@meta.com>
 2025-09-15 13:08:08 -07:00
Chen Zhang
1116590b16
[gpt-oss] Validate gpt-oss python tool during initialization (#23856) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-09-09 08:37:48 +00:00
wuhang
a38f8bd54c
[Feature][Responses API]Support MCP tools with streaming mode + background mode (#23927) 
Signed-off-by: wuhang <wuhang6@huawei.com>
 2025-09-04 04:05:10 +00:00
Christian Pinto
1cb39dbcdd
[Misc] IO Processor plugins for pooling models (#22820) 
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
 2025-08-31 23:07:12 -07:00
wang.yuqi
d9e00dbd1f
[Performance] V1 Classify Models E2E Performance Optimization (#23541) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-08-29 03:12:32 -07:00
Didier Durand
d3da2eea54
[Doc]: fix typos in Python scripts (#23828) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-08-28 05:37:38 -07:00
Chen Zhang
3210264421
[Frontend] Add --log-error-stack to print stack trace for error response (#22960) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-08-27 04:58:59 +00:00
Matúš Námešný
384dd1b0a8
[Bugfix] Add missing enable_log_outputs parameter to init_app_state function (#23634) 
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
 2025-08-26 12:13:15 +00:00
Chen Zhang
b95697d731
[Frontend] improve error logging of chat completion (#22957) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-08-20 13:03:37 -07:00
Russell Bryant
f77a0802b7
Limit HTTP header count and size (#23267) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2025-08-20 17:57:37 +00:00
22quinn
f7cf5b512e
[Frontend] Add /collective_rpc API endpoint (#23075) 
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
 2025-08-19 17:29:32 +00:00
Csrayz
a0632a3e03
[Frontend] Expose do_log_stats interval to env (#22905) 
Signed-off-by: Csrayz <jover@cmbchina.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-15 13:00:20 +00:00
yyweiss
baece8c3d2
[Frontend] Add unix domain socket support (#18097) 
Signed-off-by: <yyweiss@gmail.com>
Signed-off-by: yyw <yyweiss@gmail.com>
 2025-08-08 16:23:44 -07:00
Chen Zhang
fe6d8257a1
[gpt-oss] Support tool call and implement MCP tool server (#22427) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-08-08 15:06:37 -07:00
Moritz Sanft
370661856b
[Frontend] Update OpenAI error response to upstream format (#22099) 
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
 2025-08-06 23:06:00 -07:00
Lionel Villard
ad6c655dde
preload heavy modules when mp method is forkserver (#22214) 
Signed-off-by: Lionel Villard <villard@us.ibm.com>
 2025-08-06 20:33:24 -07:00
Chen Zhang
19c9365aa4
[gpt-oss] add demo tool server (#22393) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-08-06 17:47:14 -07:00
Nick Hill
8d524ce79f
[BugFix] Improve internal DP load balancing (#21617) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-08-01 19:45:27 -07:00
Harry Mellor
2d7b09b998
Deprecate --disable-log-requests and replace with --enable-log-requests (#21739) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-01 17:16:37 +01:00
Nick Hill
3146519add
[BugFix] Don't change title of top-level process (#22032) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-08-01 07:37:55 -07:00
wuhang
e6680f9e25
[Bugfix] Add log prefix in non-dp mode engine core (#21889) 
Signed-off-by: wuhang <wuhang6@huawei.com>
 2025-08-01 09:04:16 +00:00
Yan Pashkovsky
bf668b5bf5
[Feature] Support multiple api keys in server (#18548) 
Signed-off-by: Yan Pashkovsky <yanp.bugz@gmail.com>
 2025-07-30 07:03:23 -07:00
Nick Hill
7234fe2685
[Misc] Rework process titles (#21780) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-07-29 05:14:47 +00:00
rongfu.leng
2cc571199b
[feature] add log non default args in LLM (#21680) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-07-28 02:21:22 -07:00
Cyrus Leung
86ae693f20
[Deprecation][2/N] Replace --task with --runner and --convert (#21470) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-27 19:42:40 -07:00
Cyrus Leung
46d81d6951
[V1] Get supported tasks from model runner instead of model config (#21585) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-25 05:36:45 -07:00
Cyrus Leung
34ddcf9ff4
[Frontend] run-batch supports V1 (#21541) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-24 20:05:55 -07:00
Chauncey
6da0078523
[Feat] Allow custom naming of vLLM processes (#21445) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-24 03:15:23 -07:00
Shintarou Okada
6eca337ce0
Replace --expand-tools-even-if-tool-choice-none with --exclude-tools-when-tool-choice-none for v0.10.0 (#20544) 
Signed-off-by: okada <kokuzen@gmail.com>
Signed-off-by: okada shintarou <okada@preferred.jp>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-24 02:56:36 -07:00
Michael Goin
82ec66f514
[V0 Deprecation] Remove Prompt Adapters (#20588) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-23 16:36:48 -07:00
Cyrus Leung
042af0c8d3
[Model][1/N] Support multiple poolers at model level (#21227) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-21 02:22:21 -07:00
Rui Qiao
217937221b
Elastic Expert Parallel Initial Support (#20775) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-07-18 17:46:09 -07:00
Mac Misiura
18bdcf4113
feat - add a new endpoint get_tokenizer_info to provide tokenizer/chat-template information (#20575) 
Signed-off-by: m-misiura <mmisiura@redhat.com>
 2025-07-16 21:52:14 +08:00
Marko Rosenmueller
19c863068b
[Frontend] Support cache_salt in /v1/completions and /v1/responses (#20981) 
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
 2025-07-15 21:01:04 +00:00
Harry Mellor
313ae8c16a
[Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-15 15:57:53 +00:00
Nicolò Lucchesi
020f58abcd
[Core] Support multiple tasks per model (#20771) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-12 19:40:11 -07:00
Cyrus Leung
cbd14ed561
[Bugfix] Refactor /invocations to be task-agnostic (#20764) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-11 03:20:54 -07:00
Alex Brooks
41060c6e08
[Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) 
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
 2025-07-10 21:09:37 +01:00
rongfu.leng
8e807cdfa4
[Misc] feat output content in stream response (#19608) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-07-07 20:45:10 +00:00
Abirdcfly
448acad31e
[Misc] remove unused jinaai_serving_reranking (#18878) 
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
 2025-07-07 09:14:12 +00:00
Woosuk Kwon
462b269280
Implement OpenAI Responses API [1/N] (#20504) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-06 18:32:13 -07:00
Reid
7e90870491
[Misc] Add security warning for development mode endpoints (#20508) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-04 20:52:13 -07:00
wang.yuqi
6f1229f91d
[Model][2/N] Automatic conversion of CrossEncoding model (#19978) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-03 13:59:23 +00:00
Shintarou Okada
3d19d47d91
[Frontend] Expand tools even if tool_choice="none" (#17177) 
Signed-off-by: okada shintarou <okada@preferred.jp>
 2025-07-01 12:47:38 -04:00
Yazan Sharaya
6e244ae091
[Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) 
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
 2025-06-27 00:44:14 -04:00
Nicolò Lucchesi
e795d723ed
[Frontend] Add /v1/audio/translations OpenAI API endpoint (#19615) 
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
 2025-06-25 17:54:14 +00:00
Max Wittig
f59fc60fb3
[Feat][CLI] enforce-include-usage (#19695) 
Signed-off-by: Max Wittig <max.wittig@siemens.com>
 2025-06-25 01:43:04 -04:00