xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-22 13:36:14 +08:00
Code Issues Packages Projects Releases Wiki Activity
11,522 Commits 155 Branches 89 Tags
Commit Graph

36 Commits

Author SHA1 Message Date
wangxiyuan
577d498212
[Plugin] Make plugin group clear (#26757) 
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
 2025-10-14 07:49:59 +00:00
Harry Mellor
8fcaaf6a16
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-12 09:51:31 -07:00
Harry Mellor
e09d1753ec
Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-08 10:40:42 -07:00
Harry Mellor
d6953beb91
Convert formatting to use ruff instead of yapf + isort (#26247) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-05 07:06:22 -07:00
Kunshang Ji
81c57f60a2
[XPU] upgrade torch 2.8 on for XPU (#22300) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-08-08 17:03:45 -07:00
Woosuk Kwon
4de7146351
[V0 deprecation] Remove V0 HPU backend (#21131) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-17 16:37:36 -07:00
Simon Mo
02f0c7b220
[Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
Michael Goin
cc977286e7
Reduce logs in CLI scripts and plugin loader (#18970) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-06-03 06:00:45 +00:00
Cyrus Leung
503f8487c2
[Misc] Reduce logs on startup (#18649) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-24 23:03:53 -07:00
Harry Mellor
c8ea982d9b
Update deprecated type hinting in platform, plugins, triton_utils, vllm_flash_attn (#18129) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-14 05:28:16 -07:00
Russell Bryant
e489ad7a21
[Misc] Add SPDX-License-Identifier headers to python source files (#12628) 
- **Add SPDX license headers to python source files**
- **Check for SPDX headers using pre-commit**

commit 9d7ef44c3cfb72ca4c32e1c677d99259d10d4745
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:18:24 2025 -0500

    Add SPDX license headers to python source files
    
This commit adds SPDX license headers to python source files as
recommended to
the project by the Linux Foundation. These headers provide a concise way
that is
both human and machine readable for communicating license information
for each
source file. It helps avoid any ambiguity about the license of the code
and can
    also be easily used by tools to help manage license compliance.
    
The Linux Foundation runs license scans against the codebase to help
ensure
    we are in compliance with the licenses of the code we use, including
dependencies. Having these headers in place helps that tool do its job.
    
    More information can be found on the SPDX site:
    
    - https://spdx.dev/learn/handling-license-info/
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

commit 5a1cf1cb3b80759131c73f6a9dddebccac039dea
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:36:32 2025 -0500

    Check for SPDX headers using pre-commit
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

---------

Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-02-02 11:58:18 -08:00
youkaichao
c222f47992
[core][bugfix] configure env var during import vllm (#12209) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-01-20 19:35:59 +08:00
youkaichao
92e793d91a
[core] LLM.collective_rpc interface and RLHF example (#12084) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-01-16 20:19:52 +08:00
Yan Ma
78f4590b60
[Bugfix][XPU] fix silu_and_mul (#11823) 
Signed-off-by: yan ma <yan.ma@intel.com>
 2025-01-09 00:11:50 +08:00
youkaichao
b12e87f942
[platforms] enable platform plugins (#11602) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-12-30 20:24:45 +08:00
Russell Bryant
69d357ba12
[Core] Cleanup startup logging a bit (#10961) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2024-12-07 02:30:23 +00:00
Konrad Zawora
a43065272f
[Misc][Gaudi] Avoid torch.compile and enable lazy collectives (#10897) 
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
 2024-12-05 08:47:46 -08:00
Yan Ma
519cc6ca12
[Misc][XPU] Avoid torch compile for XPU platform (#10747) 
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
 2024-12-02 17:53:55 +00:00
youkaichao
05d1f8c9c6
[misc] move functions to config.py (#10624) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-25 09:27:30 +00:00
youkaichao
65813781a2
[torch.compile] add warning for unsupported models (#10622) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-24 23:27:51 -08:00
Jee Jee Li
7c2134beda
[torch.compile] force inductor threads (#10620) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2024-11-24 23:04:21 -08:00
youkaichao
388ee3de66
[torch.compile] limit inductor threads and lazy import quant (#10482) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-20 18:36:33 -08:00
youkaichao
803f37eaaa
[6/N] torch.compile rollout to users (#10437) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-19 10:09:03 -08:00
youkaichao
25f9c78961
[misc][plugin] improve plugin loading (#10443) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-19 10:43:21 +00:00
youkaichao
2298e69b5f
[ci][bugfix] fix kernel tests (#10431) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-18 15:29:37 -08:00
youkaichao
a03ea40792
[3/N][torch.compile] consolidate custom op logging (#10399) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-18 15:14:59 -08:00
youkaichao
51bb12d17b
[4/N][torch.compile] clean up set_torch_compile_backend (#10401) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-17 23:57:20 -08:00
youkaichao
4fd9375028
[2/N][torch.compile] make compilation cfg part of vllm cfg (#10383) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-16 18:02:14 -08:00
youkaichao
2f427c2d16
[misc][plugin] improve log messages (#10386) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-16 01:23:20 -08:00
youkaichao
755b85359b
[doc] add doc for the plugin system (#10372) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-15 21:46:27 -08:00
youkaichao
1a95f10ee7
[5/N] pass the whole config to model (#9983) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-09 14:17:28 +08:00
youkaichao
cea808f325
[3/N] model runner pass the whole config to model (#9958) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-11-02 12:08:49 -07:00
youkaichao
ff5ed6e1bc
[torch.compile] rework compile control with piecewise cudagraph (#9715) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2024-10-29 23:03:49 -07:00
youkaichao
e4d652ea3e
[torch.compile] integration with compilation control (#9058) 2024-10-10 12:39:36 -07:00
youkaichao
0a4806f0a9
[plugin][torch.compile] allow to add custom compile backend (#8445) 2024-09-13 09:32:42 -07:00
youkaichao
16422ea76f
[misc][plugin] add plugin system implementation (#7426) 2024-08-13 16:24:17 -07:00