xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-16 09:22:47 +08:00
Code Issues Packages Projects Releases Wiki Activity
7,704 Commits 155 Branches 89 Tags
Commit Graph

146 Commits

Author SHA1 Message Date
XiongfeiWei
d4170fad39
Use w8a8 quantized matmul Pallas kernel (#19170) 
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
 2025-07-15 03:06:33 +00:00
22quinn
f326ab9c88
[Bugfix] Bump up mistral_common to support v13 tokenizer (#20905) 
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
 2025-07-14 10:45:03 +00:00
Maroon Ayoub
66f6fbd393
[Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) 
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
 2025-07-14 02:45:31 +00:00
Woosuk Kwon
f45a332886
[Sched] Enhance the logic to remove stopped requests from queues (#20739) 2025-07-12 15:33:13 -07:00
Isotr0py
01cae37713
[CI/Build] Ensure compatability with Transformers v4.53 (#20541) 
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-07-11 20:53:07 -07:00
Luka Govedič
762be26a8e
[Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) 
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
 2025-07-11 00:15:22 -07:00
Nathan Hoos
d6902ce79f
[V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) 
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
 2025-07-10 15:30:26 -04:00
Harry Mellor
3482fd7e4e
[Doc] Add engine args back in to the docs (#20674) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-10 08:02:40 -07:00
Jacob Manning
bf03ff3575
[Kernel] Add Conch backend for mixed-precision linear layer (#19818) 
Signed-off-by: Jacob Manning <jmanning+oss@stackav.com>
 2025-07-09 13:17:55 -07:00
XiongfeiWei
849590a2a7
Update torch/xla pin to 20250703 (#20589) 
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
 2025-07-08 07:44:02 -07:00
Sanger Steel
72d14d0eed
[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619) 
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>
 2025-07-07 22:47:43 -07:00
Jee Jee Li
4ff79a136e
[Misc] Set the minimum openai version (#20539) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-07 09:15:26 +00:00
Peter Pan
5561681d04
[CI] add kvcache-connector dependency definition and add into CI build (#18193) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
 2025-07-04 06:49:18 -07:00
Nicolò Lucchesi
d1b689c445
[Bugfix] Fix flaky test_streaming_response test (#20363) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-07-03 14:46:24 +00:00
Jee Jee Li
1819fbda63
[Quantization] Bump to use latest bitsandbytes (#20424) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-07-03 21:58:46 +08:00
Prashant Gupta
22e9d42040
[Misc] add xgrammar for arm64 (#18359) 
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
 2025-07-01 07:02:20 +00:00
Yang Wang
8b64c895c0
[CI] Sync test dependency with test.in for torch nightly (#19632) 
Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-06-26 20:55:25 -07:00
Dipika Sikka
a57d57fa72
[Quantization] Bump to use latest compressed-tensors (#20033) 
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
 2025-06-26 20:50:06 -07:00
Kunshang Ji
b69781f107
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-06-26 09:27:18 -07:00
Li, Jiang
0567c8249f
[CPU] Fix torch version in x86 CPU backend (#19258) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-06-26 03:34:47 -07:00
h-avsha
3443aaf8dd
Move to a faster base64 implementation (#19984) 
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
 2025-06-24 20:33:51 -07:00
Li, Jiang
01220ce89a
[CI][CPU] Improve dummy Triton interfaces and fix the CPU CI (#19838) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-06-19 15:46:09 +00:00
QiliangCui
04fefe7c9a
[TPU] Update torch-xla version to include paged attention tuned block change (#19813) 
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
 2025-06-18 22:41:13 +00:00
Chenyaaang
dac8cc49f4
[TPU] Update torch version to include paged attention kernel change (#19706) 
Signed-off-by: Chenyaaang <chenyangli@google.com>
 2025-06-17 22:24:49 +00:00
Ning Xie
c3fec47bb7
[MISC] bump huggingface_hub pkg to 0.33.0 (#19547) 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
 2025-06-16 05:22:28 -07:00
wang.yuqi
f40f763f12
[CI] Add mteb testing for rerank models (#19344) 2025-06-16 01:36:43 -07:00
Richard Zou
91b2c17a55
[CI/Build] Fix torch nightly CI dependencies part 2 (#19589) 2025-06-15 20:01:10 +08:00
汪志鹏
ace5cdaff0
[Fix] bump mistral common to support magistral (#19533) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-06-12 22:28:12 -07:00
kourosh hakhamaneshi
e6aab5de29
Revert "[Build/CI] Add tracing deps to vllm container image (#15224)" (#19378) 2025-06-12 17:26:40 -07:00
Richard Zou
42f52cc95b
[CI/Build] Fix torch nightly CI dependencies (#19505) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2025-06-11 14:40:42 -07:00
Louie Tsai
9368cc90b2
Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930) 
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
 2025-06-10 06:22:05 +00:00
Kyle Sayers
ebb2f383b8
[Quantization] Bump compressed-tensors version (#19295) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2025-06-09 14:33:15 -07:00
pramenku
88be823d57
[AMD] Update compatible packaging version (#19309) 
Signed-off-by: pramkuma <Pramendra.Kumar@amd.com>
 2025-06-07 20:55:09 +08:00
Dipika Sikka
94870359cd
[Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) 
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
 2025-06-06 01:21:54 -07:00
Chengji Yao
b61dc5f972
[TPU] update torch_xla pin (#19231) 
Signed-off-by: Chengji Yao <chengjiyao@google.com>
 2025-06-06 04:27:38 +00:00
Yang Wang
25b918eee6
[Torch Nightly]add missing dependency (#18770) 
Signed-off-by: Yang Wang <elainewy@meta.com>
 2025-06-04 21:56:12 -07:00
Cyrus Leung
01dc9a76db
[CI/Build][Bugfix] Ensure compatibility with transformers 4.52 (#18678) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-06-04 04:49:20 -07:00
Li, Jiang
4555143ea7
[CPU] V1 support for the CPU backend (#16441) 2025-06-03 18:43:01 -07:00
Lu Fang
d32aa2e670
[Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) 
Signed-off-by: Lu Fang <lufang@fb.com>
 2025-06-03 00:16:17 -07:00
Rui Qiao
bdce64f236
[V1] Support DP with Ray (#18779) 2025-06-02 21:15:13 -07:00
Gregory Shtrasberg
9e6f61e8c3
[ROCm][Build] Clean up the ROCm build (#19040) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2025-06-02 20:47:47 -07:00
Luka Govedič
c55d804672
[BugFix] Pydantic part 2 (#18911) 
Signed-off-by: luka <luka@neuralmagic.com>
 2025-05-31 03:39:28 -07:00
Chengji Yao
a1cc9f33a3
[TPU] remove transpose ops in moe kernel (#18923) 
Signed-off-by: Chengji Yao <chengjiyao@google.com>
 2025-05-29 23:00:11 +00:00
Luka Govedič
f274581f44
[BugFix] Update pydantic to fix error on python 3.10 (#18852) 
Signed-off-by: luka <luka@neuralmagic.com>
 2025-05-29 03:05:46 -07:00
Cyrus Leung
4318c0559d
[CI/Build] Remove imports of built-in re (#18750) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 09:19:18 +00:00
Kebe
e0f0ff87b8
[Build] fix cpu build missing libtbbmalloc.so (#18744) 
Signed-off-by: Kebe <mail@kebe7jun.com>
 2025-05-27 01:03:56 -07:00
Cyrus Leung
82e2339b06
[Doc] Move examples and further reorganize user guide (#18666) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-26 07:38:04 -07:00
dylan
243eb9199f
[Bugfix]: handle hf-xet CAS error when loading Qwen3 weights in vLLM (#18701) 2025-05-26 07:10:56 -07:00
Feng XiaoLong
4fc1bf813a
[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) 
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
 2025-05-23 16:16:26 -07:00
Kay Yan
7ab056c273
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to requirements/cpu.txt (#18542) 
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
 2025-05-23 04:38:42 -07:00