rshaw@neuralmagic.com
|
f51f182d64
|
pre-commit
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
|
2025-03-23 20:18:50 +00:00 |
|
Robert Shaw
|
79e465f557
|
fix pre-commit
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-23 09:38:55 -04:00 |
|
Robert Shaw
|
2ba687d39f
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 18:52:06 -04:00 |
|
Robert Shaw
|
5d57896e2c
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 18:51:53 -04:00 |
|
Robert Shaw
|
f6f008ca1d
|
cleanup
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 18:51:21 -04:00 |
|
Robert Shaw
|
24cbbe4778
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 18:50:48 -04:00 |
|
Robert Shaw
|
2fec6e0b5c
|
working?
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 18:45:00 -04:00 |
|
Robert Shaw
|
47a3f26b2a
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 18:36:52 -04:00 |
|
Robert Shaw
|
144162fc8c
|
Merge branch 'main' into rob-fixes
|
2025-03-22 17:12:53 -04:00 |
|
Robert Shaw
|
522279ebb9
|
Stash
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 17:12:21 -04:00 |
|
Russell Bryant
|
b877031d80
|
Remove openvino support in favor of external plugin (#15339)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2025-03-22 14:06:39 -07:00 |
|
Robert Shaw
|
85687b43e7
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 17:00:46 -04:00 |
|
Robert Shaw
|
120bbdfd82
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 15:58:51 -04:00 |
|
Robert Shaw
|
2ceb7bc534
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 13:25:05 -04:00 |
|
Robert Shaw
|
9f7fb5ec84
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 13:22:00 -04:00 |
|
Robert Shaw
|
a8a621e419
|
updated
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
|
2025-03-22 13:11:50 -04:00 |
|
Wang Ran (汪然)
|
dd861b992f
|
[BugFix][Typing] Fix Imprecise Type Annotations (#15208)
Signed-off-by: Wang Ran (汪然) <wrran@outlook.com>
|
2025-03-22 09:05:03 -07:00 |
|
Russell Bryant
|
eb63ea1e18
|
[V1] Add disable-any-whitespace option support for xgrammar (#15316)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2025-03-22 15:56:17 +00:00 |
|
Naitong Yu
|
2f4bd358f1
|
[Model] Support Tele-FLM Model (#15023)
Signed-off-by: Naitong Yu <ntyu@baai.ac.cn>
Signed-off-by: jiangxin <horizon94@outlook.com>
Co-authored-by: Jason Fang <jasonfang3900@gmail.com>
Co-authored-by: jiangxin <horizon94@outlook.com>
|
2025-03-22 02:04:44 -07:00 |
|
Varun Sundar Rabindranath
|
8a8b30eac1
|
[Bugfix] LoRA V0 - Fix case where max_num_seqs is between cudagraph capture sizes (#15308)
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
|
2025-03-22 02:03:32 -07:00 |
|
Jee Jee Li
|
2fa0e1396b
|
[Bugfix] Fix torch.compile raise FileNotFoundError (#15278)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
|
2025-03-22 13:49:34 +08:00 |
|
wwl2755
|
1c2bec0f82
|
[Doc] add load_format items in docs (#14804)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
|
2025-03-21 22:36:43 -07:00 |
|
TJian
|
ec870fba9a
|
[FEAT] [ROCm]: Add AITER RMS Norm (Layer Norm) Feature (#14959)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2025-03-21 22:36:14 -07:00 |
|
Andy Lo
|
df1430265c
|
[Bugfix][V0] Multi-sequence logprobs streaming edge case (#15259)
Signed-off-by: Andy Lo <andy@mistral.ai>
|
2025-03-21 22:35:37 -07:00 |
|
Rui Qiao
|
4c69e228b3
|
[Misc] Increase RayDistributedExecutor RAY_CGRAPH_get_timeout (#15301)
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
|
2025-03-21 22:25:43 -07:00 |
|
Russell Bryant
|
790b79750b
|
[Build/CI] Fix env var typo (#15305)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2025-03-21 22:28:46 +00:00 |
|
Nicolò Lucchesi
|
cfbb8c930f
|
[TPU][V1] MHA Pallas backend (#15288)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2025-03-21 08:50:39 -07:00 |
|
Cyrus Leung
|
baec0d4de9
|
Revert "[Feature] specify model in config.yaml (#14855)" (#15293)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-03-21 08:30:23 -07:00 |
|
Mengqing Cao
|
c21b99b912
|
[Bugfix][VLM] fix llava processor (#15285)
Signed-off-by: Mengqing Cao <cmq0113@163.com>
|
2025-03-21 05:14:36 -07:00 |
|
Chen Zhang
|
93a00d7dde
|
[v1] Refactor KVCacheConfig (#14079)
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
|
2025-03-21 04:56:27 -07:00 |
|
Russell Bryant
|
61e8c18350
|
[Misc] Add cProfile helpers (#15074)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2025-03-21 04:56:09 -07:00 |
|
Isotr0py
|
8afcd0f633
|
[Bugfix] Fix broken kernel test due to missing rename for v1 Triton backend (#15282)
Signed-off-by: Isotr0py <2037008807@qq.com>
|
2025-03-21 11:42:06 +00:00 |
|
Lehua Ding
|
91ca929dc7
|
[V1] Fix wrong import path of get_flash_attn_version (#15280)
Signed-off-by: Lehua Ding <lehuading@tencent.com>
|
2025-03-21 03:54:11 -07:00 |
|
Isotr0py
|
84e00adc8a
|
[Bugfix] Fix incorrect resolving order for transformers fallback (#15279)
Signed-off-by: Isotr0py <2037008807@qq.com>
|
2025-03-21 03:54:08 -07:00 |
|
Isotr0py
|
47c7126213
|
[Misc] Add attention mask pre-computation optimization back to Qwen2.5-VL (#15273)
Signed-off-by: Isotr0py <2037008807@qq.com>
|
2025-03-21 10:32:33 +00:00 |
|
Shanshan Shen
|
a989ca2bf6
|
[Bugfix] Add int8 torch dtype for KVCache (#15260)
Signed-off-by: shen-shanshan <467638484@qq.com>
|
2025-03-21 08:58:28 +00:00 |
|
Wei Zeng
|
0fa3970deb
|
[Feature] specify model in config.yaml (#14855)
Signed-off-by: weizeng <weizeng@roblox.com>
|
2025-03-21 00:26:03 -07:00 |
|
Nick Hill
|
da6ea29f7a
|
[V1] Avoid redundant input processing in n>1 case (#14985)
Signed-off-by: Nick Hill <nhill@redhat.com>
|
2025-03-20 22:24:10 -07:00 |
|
Edwin Hernandez
|
7297941b38
|
[Doc] Update LWS docs (#15163)
Signed-off-by: Edwinhr716 <Edandres249@gmail.com>
|
2025-03-20 21:18:47 -07:00 |
|
Isotr0py
|
f8a08cb90d
|
[V1] Enable Triton(ROCm) Attention backend for Nvidia GPUs (#14071)
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2025-03-21 03:14:19 +00:00 |
|
Siyuan Liu
|
b15fd2be2a
|
[Hardware][TPU] Add check for no additional graph compilation during runtime (#14710)
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
|
2025-03-21 03:05:28 +00:00 |
|
Woosuk Kwon
|
e588ac237c
|
Add an example for reproducibility (#15262)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2025-03-20 19:55:47 -07:00 |
|
Cody Yu
|
5df2da5b97
|
[Misc] Better RayExecutor and multiprocessing compatibility (#14705)
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
|
2025-03-20 19:27:46 -07:00 |
|
Woosuk Kwon
|
11b986b3fb
|
[Docs] Trim the latest news in README (#15261)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2025-03-20 19:24:21 -07:00 |
|
Chih-Chieh Yang
|
296f927f24
|
[Model] RE: Mamba2 Prefill Performance Tweaks: Fixing Flurry of Unnecessary Memory Copies (#14857)
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
|
2025-03-20 19:21:08 -07:00 |
|
Travis Johnson
|
0032903a5b
|
[Bugfix] detect alibi and revert to FA2 (#15231)
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
|
2025-03-20 19:20:16 -07:00 |
|
Hyesoo Yang
|
47195057e9
|
[V1][TPU] Speed up top-k on TPU by using torch.topk (#15242)
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
|
2025-03-20 19:19:40 -07:00 |
|
Harry Mellor
|
6edbfa924d
|
Mention extra_body as a way top pass vLLM only parameters using the OpenAI client (#15240)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-03-20 19:18:36 -07:00 |
|
Isotr0py
|
1e508343e1
|
[Bugfix] Fix incorrect qwen2.5-vl attention mask pre-computation (#15200)
Signed-off-by: Isotr0py <2037008807@qq.com>
|
2025-03-20 19:18:04 -07:00 |
|
Sage Moore
|
2e0b4cfde0
|
[ROCM] Upgrade torch to 2.6 (#15244)
Signed-off-by: Sage Moore <sage@neuralmagic.com>
|
2025-03-20 19:17:33 -07:00 |
|