xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-31 03:03:05 +08:00
Code Issues Packages Projects Releases Wiki Activity
7,479 Commits 155 Branches 89 Tags
Commit Graph

134 Commits

Author SHA1 Message Date
Peter Pan
5561681d04
[CI] add kvcache-connector dependency definition and add into CI build (#18193) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
 2025-07-04 06:49:18 -07:00
Nicolò Lucchesi
d1b689c445
[Bugfix] Fix flaky test_streaming_response test (#20363) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-07-03 14:46:24 +00:00
Jee Jee Li
1819fbda63
[Quantization] Bump to use latest bitsandbytes (#20424) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-03 21:58:46 +08:00
Prashant Gupta
22e9d42040
[Misc] add xgrammar for arm64 (#18359) 
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
 2025-07-01 07:02:20 +00:00
Yang Wang
8b64c895c0
[CI] Sync test dependency with test.in for torch nightly (#19632) 
Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-06-26 20:55:25 -07:00
Dipika Sikka
a57d57fa72
[Quantization] Bump to use latest compressed-tensors (#20033) 
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
 2025-06-26 20:50:06 -07:00
Kunshang Ji
b69781f107
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-06-26 09:27:18 -07:00
Li, Jiang
0567c8249f
[CPU] Fix torch version in x86 CPU backend (#19258) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-06-26 03:34:47 -07:00
h-avsha
3443aaf8dd
Move to a faster base64 implementation (#19984) 
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
 2025-06-24 20:33:51 -07:00
Li, Jiang
01220ce89a
[CI][CPU] Improve dummy Triton interfaces and fix the CPU CI (#19838) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-06-19 15:46:09 +00:00
QiliangCui
04fefe7c9a
[TPU] Update torch-xla version to include paged attention tuned block change (#19813) 
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
 2025-06-18 22:41:13 +00:00
Chenyaaang
dac8cc49f4
[TPU] Update torch version to include paged attention kernel change (#19706) 
Signed-off-by: Chenyaaang <chenyangli@google.com>
 2025-06-17 22:24:49 +00:00
Ning Xie
c3fec47bb7
[MISC] bump huggingface_hub pkg to 0.33.0 (#19547) 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
 2025-06-16 05:22:28 -07:00
wang.yuqi
f40f763f12
[CI] Add mteb testing for rerank models (#19344) 2025-06-16 01:36:43 -07:00
Richard Zou
91b2c17a55
[CI/Build] Fix torch nightly CI dependencies part 2 (#19589) 2025-06-15 20:01:10 +08:00
汪志鹏
ace5cdaff0
[Fix] bump mistral common to support magistral (#19533) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-06-12 22:28:12 -07:00
kourosh hakhamaneshi
e6aab5de29
Revert "[Build/CI] Add tracing deps to vllm container image (#15224)" (#19378) 2025-06-12 17:26:40 -07:00
Richard Zou
42f52cc95b
[CI/Build] Fix torch nightly CI dependencies (#19505) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2025-06-11 14:40:42 -07:00
Louie Tsai
9368cc90b2
Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930) 
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
 2025-06-10 06:22:05 +00:00
Kyle Sayers
ebb2f383b8
[Quantization] Bump compressed-tensors version (#19295) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2025-06-09 14:33:15 -07:00
pramenku
88be823d57
[AMD] Update compatible packaging version (#19309) 
Signed-off-by: pramkuma <Pramendra.Kumar@amd.com>
 2025-06-07 20:55:09 +08:00
Dipika Sikka
94870359cd
[Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) 
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
 2025-06-06 01:21:54 -07:00
Chengji Yao
b61dc5f972
[TPU] update torch_xla pin (#19231) 
Signed-off-by: Chengji Yao <chengjiyao@google.com>
 2025-06-06 04:27:38 +00:00
Yang Wang
25b918eee6
[Torch Nightly]add missing dependency (#18770) 
Signed-off-by: Yang Wang <elainewy@meta.com>
 2025-06-04 21:56:12 -07:00
Cyrus Leung
01dc9a76db
[CI/Build][Bugfix] Ensure compatibility with transformers 4.52 (#18678) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-06-04 04:49:20 -07:00
Li, Jiang
4555143ea7
[CPU] V1 support for the CPU backend (#16441) 2025-06-03 18:43:01 -07:00
Lu Fang
d32aa2e670
[Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) 
Signed-off-by: Lu Fang <lufang@fb.com>
 2025-06-03 00:16:17 -07:00
Rui Qiao
bdce64f236
[V1] Support DP with Ray (#18779) 2025-06-02 21:15:13 -07:00
Gregory Shtrasberg
9e6f61e8c3
[ROCm][Build] Clean up the ROCm build (#19040) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2025-06-02 20:47:47 -07:00
Luka Govedič
c55d804672
[BugFix] Pydantic part 2 (#18911) 
Signed-off-by: luka <luka@neuralmagic.com>
 2025-05-31 03:39:28 -07:00
Chengji Yao
a1cc9f33a3
[TPU] remove transpose ops in moe kernel (#18923) 
Signed-off-by: Chengji Yao <chengjiyao@google.com>
 2025-05-29 23:00:11 +00:00
Luka Govedič
f274581f44
[BugFix] Update pydantic to fix error on python 3.10 (#18852) 
Signed-off-by: luka <luka@neuralmagic.com>
 2025-05-29 03:05:46 -07:00
Cyrus Leung
4318c0559d
[CI/Build] Remove imports of built-in re (#18750) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 09:19:18 +00:00
Kebe
e0f0ff87b8
[Build] fix cpu build missing libtbbmalloc.so (#18744) 
Signed-off-by: Kebe <mail@kebe7jun.com>
 2025-05-27 01:03:56 -07:00
Cyrus Leung
82e2339b06
[Doc] Move examples and further reorganize user guide (#18666) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-26 07:38:04 -07:00
dylan
243eb9199f
[Bugfix]: handle hf-xet CAS error when loading Qwen3 weights in vLLM (#18701) 2025-05-26 07:10:56 -07:00
Feng XiaoLong
4fc1bf813a
[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) 
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
 2025-05-23 16:16:26 -07:00
Kay Yan
7ab056c273
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to requirements/cpu.txt (#18542) 
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
 2025-05-23 04:38:42 -07:00
Harry Mellor
a1fe24d961
Migrate docs from Sphinx to MkDocs (#18145) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-23 02:09:53 -07:00
Michael Goin
3b17ea26e4
[TPU] Re-enable the Pallas MoE kernel (#18025) 
Signed-off-by: Michael Goin <mgoin64@gmail.com>
 2025-05-20 19:52:27 -07:00
Dilip Gowda Bhagavan
23baa2180b
fix:Build torch wheel inline rather than picking from nightly (#18351) 
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
 2025-05-20 22:22:24 +00:00
wang.yuqi
86847700d7
[CI] Add mteb testing to test the accuracy of the embedding model (#17175) 2025-05-20 06:51:12 -07:00
汪志鹏
d6c86d09ae
Update cpu.txt (#18398) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-05-20 10:53:23 +00:00
Alexei-V-Ivanov-AMD
566ec04c3d
Adding "Basic Models Test" and "Multi-Modal Models Test (Extended) 3" in AMD Pipeline (#18106) 
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-15 08:49:23 -07:00
Chauncey
dc1a821768
[Feature][V1] Support tool_choice: required when using Xgrammar as the StructuredOutputBackend. (#17845) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-05-12 23:01:31 -07:00
Alexei-V-Ivanov-AMD
3b602cdea7
AMD conditional all test execution // new test groups (#17556) 
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
 2025-05-09 15:35:58 -07:00
Shanshan Shen
760e3ecc8f
[V1][Structured Output] Update llguidance (>= 0.7.11) to avoid AttributeError (no StructTag) (#17839) 
Signed-off-by: shen-shanshan <467638484@qq.com>
 2025-05-08 20:14:18 -07:00
Harry Mellor
e4ca6e3a99
Fix transient dependency error in docs build (#17848) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-08 03:42:03 -07:00
Mikhail Podvitskii
c747d84576
[Installation] OpenTelemetry version update (#17771) 
Signed-off-by: Mikhail Podvitskii <podvitskiymichael@gmail.com>
 2025-05-07 22:32:49 -07:00
Christian Heimes
1a6af1453d
Only depend on importlib-metadata for Python < 3.10 (#17776) 
Signed-off-by: Christian Heimes <christian@python.org>
 2025-05-07 07:51:06 -07:00