xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-18 17:54:36 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,002 Commits 155 Branches 89 Tags
Commit Graph

623 Commits

Author SHA1 Message Date
Huy Do
e98def439c
[Take 2] Correctly kill vLLM processes after benchmarks (#21646) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-07-26 06:06:05 -07:00
QiliangCui
7728dd77bb
[TPU][Test] Divide TPU v1 Test into 2 parts. (#21431) 2025-07-26 06:20:30 +00:00
Huy Do
a55c95096b
Correctly kill vLLM processes after finishing serving benchmarks (#21641) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-07-25 19:06:21 -07:00
QiliangCui
07d80d7b0e
[TPU][TEST] HF_HUB_DISABLE_XET=1 the test 3. (#21539) 
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
 2025-07-24 15:33:04 -07:00
Robert Shaw
d5b981f8b1
[DP] Internal Load Balancing Per Node [one-pod-per-node] (#21238) 
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-07-23 20:57:32 -07:00
Liangliang Ma
13e4ee1dc3
[XPU][UT] increase intel xpu CI test scope (#21492) 
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
 2025-07-23 20:24:04 -07:00
Ming Yang
772ce5af97
[Misc] Add dummy maverick test to CI (#21324) 
Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-23 20:22:42 -07:00
QiliangCui
14bf19e39f
[TPU][TEST] Fix the downloading issue in TPU v1 test 11. (#21418) 
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
 2025-07-23 11:29:36 -07:00
Nick Hill
316b1bf706
[Tests] Add tests for headless internal DP LB (#21450) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-07-23 07:49:25 -07:00
Alexei-V-Ivanov-AMD
107111a859
Changing "amdproduction" allocation. (#21409) 
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
 2025-07-22 20:48:31 -07:00
Cyrus Leung
c401c64b4c
[CI/Build] Fix model executor tests (#21387) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-22 20:25:37 -07:00
Michael Goin
005ae9be6c
Fix bad lm-eval fork (#21318) 2025-07-21 10:47:51 -07:00
Li, Jiang
a15a50fc17
[CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-21 09:07:08 -07:00
Seiji Eicher
d1fb65bde3
Enable v1 metrics tests (#20953) 
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
 2025-07-20 03:22:02 +00:00
Woosuk Kwon
752c6ade2e
[V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-19 13:53:17 -07:00
Li, Jiang
e3a0e43d7f
[bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-19 05:13:55 -07:00
Woosuk Kwon
dd572c0ab3
[V0 Deprecation] Remove V0 Spec Decode workers (#21152) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-07-18 21:47:50 -07:00
XiongfeiWei
58760e12b1
[TPU] Start using python 3.12 (#21000) 
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
 2025-07-16 19:37:44 -07:00
Chendi.Xue
e9534c7202
[CI][HPU] update for v0 deprecate by switching to VLLM_TARGET_DEVICE=empty (#21006) 
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
 2025-07-15 20:07:05 -07:00
Cyrus Leung
c847e34b39
[CI/Build] Fix wrong path in Transformers Nightly Models Test (#20994) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-15 08:53:16 -07:00
Michael Goin
946aadb4a0
[CI/Build] Split Entrypoints Test into LLM and API Server (#20945) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-15 02:44:18 +00:00
Isotr0py
6d0cf239c6
[CI/Build] Add Transformers nightly tests in CI (#20924) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-07-14 16:33:17 +00:00
QiliangCui
c66e38ea4c
[Test] Remove docker build from test. (#20542) 
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
 2025-07-10 11:21:58 -07:00
shineran96
4bed167768
[Model][VLM] Support JinaVL Reranker (#20260) 
Signed-off-by: shineran96 <shinewang96@gmail.com>
 2025-07-10 10:43:43 -07:00
Michael Goin
1a4f35e2ea
Normalize lm-eval command between baseline and correctness test (#18560) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-10 13:27:32 +00:00
Kunshang Ji
b6e7e3d58f
[Intel GPU] support ray as distributed executor backend for XPU. (#20659) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-07-09 00:36:58 -07:00
Li, Jiang
7721ef1786
[CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-07 22:13:44 -07:00
Liangliang Ma
2c5ebec064
[XPU][CI] add v1/core test in xpu hardware ci (#20537) 
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
 2025-07-07 01:16:40 -07:00
Cyrus Leung
9fb52e523a
[V1] Support any head size for FlexAttention backend (#20467) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-06 09:54:36 -07:00
Woosuk Kwon
e202dd2736
[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2025-07-06 08:48:13 -07:00
Peter Pan
5561681d04
[CI] add kvcache-connector dependency definition and add into CI build (#18193) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
 2025-07-04 06:49:18 -07:00
Alexei-V-Ivanov-AMD
536fd33003
[CI] Trimming some failing test groups from AMDPRODUCTION. (#20390) 2025-07-03 08:21:31 -07:00
Li, Jiang
7f0367109e
[CI/Build][CPU] Enable cross compilation in CPU release pipeline (#20423) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-03 05:26:12 -07:00
QiliangCui
4ff61ababa
[TPU] Add a case to cover RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 (#20385) 
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
 2025-07-03 06:46:41 +00:00
Louie Tsai
9965c47d0d
Enable CPU nightly performance benchmark and its Markdown report (#18444) 
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
 2025-07-02 17:50:25 -07:00
Nick Hill
657f2f301a
[DP] Support external DP Load Balancer mode (#19790) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-07-02 10:21:52 -07:00
Li, Jiang
6cc1e7d96d
[CPU] Update custom ops for the CPU backend (#20255) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-01 07:25:03 +00:00
Chendi.Xue
a2f14dc8f9
[CI][Intel Gaudi][vllm-Plugin]Add CI for hpu-plugin-v1-test (#20196) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-07-01 04:17:07 +00:00
Thomas Parnell
8615d9776f
[CI/Build] Add new CI job to validate Hybrid Models for every PR (#20147) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2025-06-27 23:00:25 -07:00
Yang Wang
8b64c895c0
[CI] Sync test dependency with test.in for torch nightly (#19632) 
Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-06-26 20:55:25 -07:00
Bowen Wang
e9fd658a73
[Feature] Expert Parallelism Load Balancer (EPLB) (#18343) 
Signed-off-by: Bowen Wang <abmfy@icloud.com>
 2025-06-26 15:30:21 -07:00
Chengji Yao
04e1642e32
[TPU] add kv cache update kernel (#19928) 
Signed-off-by: Chengji Yao <chengjiyao@google.com>
 2025-06-26 10:01:37 -07:00
Kunshang Ji
b69781f107
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-06-26 09:27:18 -07:00
QiliangCui
4e0db57fff
Fix the path to the testing script. (#20082) 
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
 2025-06-25 20:48:17 +00:00
Nick Hill
c40692bf9a
[Misc] Add parallel state node_count function (#20045) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-06-25 13:38:53 -07:00
Nick Hill
8619e7158c
[BugFix] Fix multi-node offline data parallel (#19937) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-06-24 12:45:20 -07:00
QiliangCui
a738dbb2a1
Update test case parameter to have the throughput above 8.0 (#19994) 
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
 2025-06-24 00:18:10 +00:00
22quinn
a3bc76e4b5
[CI/Build] Push latest tag for cpu and neuron docker image (#19897) 
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
 2025-06-23 14:15:37 -07:00
Lukas Geiger
c3649e4fee
[Docs] Fix syntax highlighting of shell commands (#19870) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-06-23 17:59:09 +00:00
kourosh hakhamaneshi
5e666f72cd
[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583) 2025-06-19 22:01:16 -07:00