xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 05:34:55 +08:00
Code Issues Packages Projects Releases Wiki Activity
10,110 Commits 155 Branches 89 Tags
Commit Graph

67 Commits

Author SHA1 Message Date
Tyler Michael Smith
27edd2aeb4
[Build/CI] Revert back to Ubuntu 20.04, install python 3.12 with uv (#26103) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2025-10-02 22:21:01 -07:00
Cyrus Leung
d00d652998
[CI/Build] Replace vllm.entrypoints.openai.api_server entrypoint with vllm serve command (#25967) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-02 10:04:57 -07:00
Huy Do
d4e7a1152d
Update base image to 22.04 (jammy) (#26065) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-10-02 05:48:04 -07:00
youkaichao
9360d34fa1
update to latest deepgemm for dsv3.2 (#25871) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-09-29 17:51:43 +08:00
Clayton Coleman
5546acb463
[Bug]: Set LD_LIBRARY_PATH to include the 'standard' CUDA location (#25766) 
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
 2025-09-27 13:36:28 -04:00
Cyrus Leung
d346ec695e
[CI/Build] Consolidate model loader tests and requirements (#25765) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-26 21:45:20 -07:00
Michael Goin
92da847cf5
Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (#25782) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-09-26 18:54:09 -07:00
Michael Goin
cf89202855
[CI] Fix FlashInfer AOT in release docker image (#25730) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-09-26 14:11:40 -07:00
Benjamin Bartels
64ad551878
Removes source compilation of nixl dependency (#24874) 
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Daniele <36171005+dtrifiro@users.noreply.github.com>
 2025-09-17 01:33:18 +00:00
Simon Mo
fd2f10546c
[ci] fix wheel names for arm wheels (#24898) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-09-15 14:39:08 -07:00
Benjamin Bartels
94b03f88dd
Bump Flashinfer to 0.3.1 (#24868) 
Signed-off-by: bbartels <benjamin@bartels.dev>
 2025-09-15 12:45:55 -07:00
Daniele
2f5e5c18de
[CI/Build] bump timm dependency (#24189) 
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
 2025-09-10 06:20:59 -07:00
Po-Han Huang (NVIDIA)
78336a0c3e
Upgrade FlashInfer to v0.3.0 (#24086) 
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2025-09-04 09:49:20 -07:00
Lucas Wilkinson
402759d472
[Attention] FlashAttn MLA (#14258) 
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
 2025-09-04 02:47:59 -07:00
dongbo910220
4ba0c587ba
FIX: Add libnuma-dev to Dockerfile for dev stage (#20388) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2025-09-03 07:17:20 -07:00
Jee Jee Li
dc1a53186d
[Kernel] Update DeepGEMM to latest commit (#23915) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2025-09-01 02:38:04 -07:00
weiliang
ae067888d6
Update Flashinfer to 0.2.14.post1 (#23537) 
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-08-25 18:30:44 -07:00
Michael Goin
f6818a92cb
[UX] Move Dockerfile DeepGEMM install to tools/install_deepgemm.sh (#23360) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-08-22 20:52:50 -06:00
Zhewen Li
0483fabc74
[CI/Build] add EP dependencies to docker (#21976) 
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2025-08-22 13:34:40 -07:00
Michael Goin
50df09fe13
Update to flashinfer-python==0.2.12 and disable AOT compile for non-release image (#23129) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-08-20 08:05:54 -04:00
Eli Uriegas
76144adf76
ci: Add CUDA + arm64 release builds (#21201) 
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
 2025-08-15 23:16:23 +00:00
Harry Mellor
e8b40c7fa2
[CI] Remove duplicated docs build from buildkite (#22924) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-15 05:58:06 -07:00
Frank Wang
ba81acbdc1
[Bugfix] Bump DeepGEMM Version to Fix SMXX Layout Issues (#22606) 
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
 2025-08-12 15:43:06 -07:00
Po-Han Huang (NVIDIA)
dc5e4a653c
Upgrade FlashInfer to v0.2.11 (#22613) 
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2025-08-11 19:58:41 -07:00
Doug Smith
d1af8b7be9
enable Docker-aware precompiled wheel setup (#22106) 
Signed-off-by: dougbtv <dosmith@redhat.com>
 2025-08-10 16:29:02 -07:00
Michael Goin
e8961e963a
Update flashinfer-python==0.2.10 (#22389) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-08-06 18:10:24 -07:00
Michael Goin
a7cb6101ca
[CI/Build] Update flashinfer to 0.2.9 (#22233) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-08-05 09:39:38 -07:00
Michael Goin
c494f96fbc
Use UV_LINK_MODE=copy in Dockerfile to avoid hardlink fail (#22128) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-08-05 06:57:10 -07:00
Simon Mo
da31f6ad3d
Revert precompile wheel changes (#22055) 2025-08-01 08:26:24 +00:00
Matthew Bonanni
e360316ab9
Add DeepGEMM to Dockerfile in vllm-base image (#21533) 
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2025-07-31 18:01:55 -07:00
Doug Smith
58bb902186
fix(setup): improve precompiled wheel setup for Docker builds (#22025) 
Signed-off-by: dougbtv <dosmith@redhat.com>
 2025-07-31 09:52:48 -07:00
Daniele
d2aab336ad
[CI/Build] get rid of unused VLLM_FA_CMAKE_GPU_ARCHES (#21599) 
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
 2025-07-31 15:00:08 +08:00
Doug Smith
a1873db23d
docker: docker-aware precompiled wheel support (#21127) 
Signed-off-by: dougbtv <dosmith@redhat.com>
 2025-07-29 14:45:19 -07:00
Michael Goin
a33ea28b1b
Add flashinfer_python to CUDA wheel requirements (#21389) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-29 12:51:58 -07:00
weiliang
01c753ed98
update flashinfer to v0.2.9rc2 (#21701) 
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
 2025-07-28 19:31:47 +00:00
weiliang
2dd72d23d9
update flashinfer to v0.2.9rc1 (#21485) 
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
 2025-07-24 14:06:11 -07:00
elvischenv
5a19a6c670
[Fix] Update mamba_ssm to 2.2.5 (#21421) 
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
 2025-07-24 03:25:41 -07:00
cjackal
526078a96c
bump flashinfer to v0.2.8 (#21385) 
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
 2025-07-24 03:20:38 -07:00
Matthew Bonanni
aa08a954f9
[Bugfix] Fix casing warning (#21468) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2025-07-23 20:41:23 -07:00
Kay Yan
8188196a1c
[CI] Cleanup modelscope version constraint in Dockerfile (#21243) 
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
 2025-07-20 20:13:02 -07:00
Michael Goin
a50d918225
[Docker] Allow FlashInfer to be built in the ARM CUDA Dockerfile (#21013) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-16 19:37:13 -07:00
Peter Pan
1eb2b9c102
[CI] update typos config for CI pre-commit and fix some spells (#20919) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
 2025-07-15 21:12:40 -07:00
Doug Smith
7976446015
Add Dockerfile argument for VLLM_USE_PRECOMPILED environment (#20943) 
Signed-off-by: dougbtv <dosmith@redhat.com>
 2025-07-15 19:53:57 -07:00
Michael Goin
cf75cd2098
[CI Bugfix] Specify same TORCH_CUDA_ARCH_LIST for flashinfer aot and install (#20772) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-11 01:16:01 +00:00
Michael Goin
4b9a9435bb
Update Dockerfile FlashInfer to v0.2.8rc1 (#20718) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-10 08:09:02 -07:00
Michael Goin
b7d9e9416f
[CI/Build] Fix FlashInfer double build in Dockerfile (#20651) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-09 17:41:56 -06:00
Peter Pan
5561681d04
[CI] add kvcache-connector dependency definition and add into CI build (#18193) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
 2025-07-04 06:49:18 -07:00
Jee Jee Li
1819fbda63
[Quantization] Bump to use latest bitsandbytes (#20424) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-03 21:58:46 +08:00
Tyler Michael Smith
bdb84e26b0
[Bugfix] Fixes for FlashInfer's TORCH_CUDA_ARCH_LIST (#20136) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
 2025-07-02 17:15:11 -07:00
Fabien Dupont
3c545c0c3b
[CI/Build] Allow hermetic builds (#18064) 
Signed-off-by: Fabien Dupont <fdupont@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Fabien Dupont <fabiendupont@pm.me>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Elias Levy <eliaslevy@google.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-06-27 09:04:39 -07:00