xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-04-20 02:07:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,271 Commits 155 Branches 89 Tags
Commit Graph

437 Commits

Author SHA1 Message Date
Kunshang Ji
68cf1601d3
[CI][Intel GPU] update XPU dockerfile and CI script (#15109) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-03-19 01:29:25 -07:00
Alexander Matveev
72a8639b68
[V1] TPU - CI/CD use smaller model (#15054) 
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
 2025-03-18 21:39:21 +00:00
Alexander Matveev
18551e820c
[V1] TPU - Fix CI/CD runner (#14974) 2025-03-17 21:07:07 +00:00
Aaron Pham
c0efdd655b
[Fix][Structured Output] using vocab_size to construct matcher (#14868) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2025-03-17 11:42:45 -04:00
Cyrus Leung
6eaf1e5c52
[Misc] Add --seed option to offline multi-modal examples (#14934) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-03-17 03:00:17 -07:00
Sibi
a73e183e36
[Misc] Replace os environ to monkeypatch in test suite (#14516) 
Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
 2025-03-16 20:35:57 -07:00
Robert Shaw
aecc780dba
[V1] Enable Entrypoints Tests (#14903) 2025-03-16 17:56:16 -07:00
Kunshang Ji
f58aea002c
[CI][Intel GPU] refine intel GPU ci docker build (#14860) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-03-15 11:58:53 +00:00
Robert Shaw
d4d93db2c5
[V1] V1 Enablement Oracle (#13726) 
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2025-03-14 22:02:20 -07:00
Liangfu Chen
9f37422779
[Neuron][CI] update docker run command (#14829) 
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
 2025-03-14 18:51:35 -07:00
Richard Liu
40677783aa
[CI] Add TPU v1 test (#14834) 
Signed-off-by: Richard Liu <ricliu@google.com>
 2025-03-14 17:13:30 -04:00
Alexei-V-Ivanov-AMD
270a5da495
Re-enable the AMD Entrypoints Test (#14711) 
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
 2025-03-14 12:18:13 -07:00
Kevin H. Luu
7097b4cc1c
[release] Remove log cleanup commands from TPU job (#14838) 2025-03-14 11:59:52 -07:00
Liangfu Chen
d3d4956261
[Neuron] flatten test parameterization for neuron attention kernels (#14712) 2025-03-13 20:46:56 -07:00
Kevin H. Luu
f1f632d9ec
[ci] Reduce number of tests in fastcheck (#14782) 2025-03-13 20:43:45 -07:00
Kevin H. Luu
ce20124671
[release] Add force remove for TPU logs (#14697) 2025-03-12 22:35:18 +00:00
Li, Jiang
ff47aab056
[CPU] Upgrade CPU backend to torch-2.6 (#13381) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2025-03-12 10:41:13 +00:00
Kevin H. Luu
9f583e360c
[release] Add commands to clean up logs on TPU release node (#14642) 2025-03-12 00:14:50 +00:00
Richard Liu
d374f04a33
Fix run_tpu_test (#14641) 
Signed-off-by: <ricliu@google.com>
Signed-off-by: Richard Liu <ricliu@google.com>
 2025-03-11 21:14:33 +00:00
Harry Mellor
206e2577fa
Move requirements into their own directory (#12547) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-03-08 16:44:35 +00:00
Aaron Pham
80e9afb5bc
[V1][Core] Support for Structured Outputs (#12388) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-03-07 07:19:11 -08:00
Thomas Parnell
8ca2b21c98
[CI] Disable spawn when running V1 Test (#14345) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-03-06 21:52:46 +00:00
youkaichao
151b08e0fe
[RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-03-07 00:32:46 +08:00
Russell Bryant
ffad94397d
[CI/Build] Use spawn multiprocessing mode for V1 test pipeline (#14243) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-03-05 17:08:02 -08:00
Sage Moore
3e1d223626
[ROCm] Disable a few more kernel tests that are broken on ROCm (#14145) 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-03-04 23:37:55 +00:00
TJian
848a6438ae
[ROCm] Faster Custom Paged Attention kernels (#12348) 2025-03-03 09:24:45 -08:00
Jee Jee Li
cc5e8f6db8
[Model] Add LoRA support for TransformersModel (#13770) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-03-02 09:17:34 +08:00
Sage Moore
38acae6e97
[ROCm] Fix the Kernels, Core, and Prefix Caching AMD CI groups (#13970) 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-02-27 20:31:47 +00:00
Michael Goin
ca377cf1b9
Use CUDA 12.4 as default for release and nightly wheels (#12098) 2025-02-26 19:06:37 -08:00
Huy Do
e7ef74e26e
Fix some issues with benchmark data output (#13641) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-02-24 10:23:18 +08:00
youkaichao
eb24dc4a45
[v1] torchrun compatibility (#13642) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-02-23 22:47:24 +08:00
Kevin H. Luu
2c5e637b57
[ci] Use env var to control whether to use S3 bucket in CI (#13634) 2025-02-22 19:19:45 -08:00
youkaichao
3e472d882a
[core] set up data parallel communication (#13591) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-02-22 19:28:59 +08:00
Harry Mellor
992e5c3d34
Merge similar examples in offline_inference into single basic example (#12737) 2025-02-20 04:53:51 -08:00
Kevin H. Luu
88f6ba3281
[ci] Add AWS creds for AMD (#13572) 2025-02-20 03:56:06 +00:00
Yannick Schnider
423330263b
[Feature] Pluggable platform-specific scheduler (#13161) 
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
 2025-02-19 17:16:38 +08:00
Lucia Fang
f525c0be8b
[Model][Speculative Decoding] DeepSeek MTP spec decode (#12755) 
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
 2025-02-19 17:06:23 +08:00
Kevin H. Luu
3b05cd4555
[perf-benchmark] Fix ECR path for premerge benchmark (#13512) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-19 07:56:11 +00:00
Kevin H. Luu
9aa95b0e6a
[perf-benchmark] Allow premerge ECR (#13509) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-19 05:13:41 +00:00
Harry Mellor
00b69c2d27
[Misc] Remove dangling references to --use-v2-block-manager (#13492) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-02-19 03:37:26 +00:00
Huy Do
45186834a0
Run v1 benchmark and integrate with PyTorch OSS benchmark database (#13068) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-02-17 08:16:32 +00:00
Nicolò Lucchesi
d84cef76eb
[Frontend] Add /v1/audio/transcriptions OpenAI API endpoint (#12909) 2025-02-13 07:23:45 -08:00
Kevin H. Luu
9f9704dca6
[perf-benchmark] cleanup unused Docker images and volumes in H100 benchmark instance (#12706) 2025-02-12 19:51:33 -08:00
Kevin H. Luu
842b0fd402
[ci] Add more source file dependencies for some tests (#13123) 
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
 2025-02-11 20:38:10 -08:00
youkaichao
aa0ca5ebb7
[core][rlhf] add colocate example for RLHF (#12984) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-02-10 10:28:59 +08:00
Cyrus Leung
8a69e0e20e
[CI/Build] Auto-fix Markdown files (#12941) 2025-02-08 04:25:15 -08:00
Liangfu Chen
c45d398e6f
[CI] Resolve transformers-neuronx version conflict (#12925) 2025-02-08 01:41:35 -08:00
Robert Shaw
932c6b7461
[V1] LM Eval With Streaming Integration Tests (#11590) 2025-02-07 15:07:03 -08:00
Rahul Tuli
3b2005e1db
Add: Support for Sparse24Bitmask Compressed Models 2025-02-05 13:30:43 -08:00
youkaichao
bc1bdecebf
[core][distributed] exact ray placement control (#12732) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-02-06 02:03:19 +08:00