Russell Bryant
|
cdca8994bd
|
[CI/Build] mypy: check vllm/entrypoints (#9194)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2024-10-09 17:15:28 +00:00 |
|
Li, Jiang
|
ca77dd7a44
|
[Hardware][CPU] Support AWQ for CPU backend (#7515)
|
2024-10-09 10:28:08 -06:00 |
|
Ewout ter Hoeven
|
7dea289066
|
Add Dependabot configuration for GitHub Actions updates (#1217)
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2024-10-09 08:16:26 -07:00 |
|
Cyrus Leung
|
cfaa6008e6
|
[Bugfix] Access get_vocab instead of vocab in tool parsers (#9188)
|
2024-10-09 08:59:57 -06:00 |
|
Ahmad Fahadh Ilyas
|
21906a6f50
|
[Bugfix] Fix lora loading for Compressed Tensors in #9120 (#9179)
|
2024-10-09 12:10:44 +00:00 |
|
Jiangtao Hu
|
dc4aea677a
|
[Doc] Fix VLM prompt placeholder sample bug (#9170)
|
2024-10-09 08:59:42 +00:00 |
|
youkaichao
|
c8627cd41b
|
[ci][test] use load dummy for testing (#9165)
|
2024-10-09 00:38:40 -07:00 |
|
Cyrus Leung
|
8bfaa4e31e
|
[Bugfix] fix composite weight loading and EAGLE weight loading (#9160)
|
2024-10-09 00:36:55 -07:00 |
|
AlpinDale
|
0b5b5d767e
|
[Frontend] Log the maximum supported concurrency (#8831)
|
2024-10-09 00:03:14 -07:00 |
|
Hui Liu
|
cdc72e3c80
|
[Model] Remap FP8 kv_scale in CommandR and DBRX (#9174)
|
2024-10-09 06:43:06 +00:00 |
|
Joe Rowell
|
7627172bf4
|
[Bugfix][Doc] Report neuron error in output (#9159)
|
2024-10-08 22:43:34 -07:00 |
|
Travis Johnson
|
480b7f40cf
|
[Misc] Improve validation errors around best_of and n (#9167)
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
|
2024-10-09 04:54:48 +00:00 |
|
Yuan Tang
|
acce7630c1
|
Update link to KServe deployment guide (#9173)
|
2024-10-09 03:58:49 +00:00 |
|
Yuan Tang
|
ffc4b27ea8
|
Add classifiers in setup.py (#9171)
|
2024-10-08 19:30:48 -07:00 |
|
chenqianfzh
|
2f4117c38e
|
support bitsandbytes quantization with more models (#9148)
|
2024-10-08 19:52:19 -06:00 |
|
Michael Goin
|
9ba0bd6aa6
|
Add lm-eval directly to requirements-test.txt (#9161)
|
2024-10-08 18:22:31 -07:00 |
|
Russell Bryant
|
2a131965a8
|
mypy: check additional directories (#9162)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2024-10-08 22:08:22 +00:00 |
|
bnellnm
|
bd37b9fbe2
|
[Bugfix] Try to handle older versions of pytorch (#9086)
|
2024-10-08 14:28:12 -07:00 |
|
Rafael Vasquez
|
de24046fcd
|
[Doc] Improve contributing and installation documentation (#9132)
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
|
2024-10-08 20:22:08 +00:00 |
|
Sayak Paul
|
1874c6a1b0
|
[Doc] Update vlm.rst to include an example on videos (#9155)
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2024-10-08 18:12:29 +00:00 |
|
Daniele
|
9a94ca4a5d
|
[Bugfix] fix OpenAI API server startup with --disable-frontend-multiprocessing (#8537)
|
2024-10-08 09:38:40 -07:00 |
|
Peter Pan
|
cfba685bd4
|
[CI/Build] Add examples folder into Docker image so that we can leverage the templates*.jinja when serving models (#8758)
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
|
2024-10-08 09:37:34 -07:00 |
|
Alex Brooks
|
069d3bd8d0
|
[Frontend] Add Early Validation For Chat Template / Tool Call Parser (#9151)
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
|
2024-10-08 14:31:26 +00:00 |
|
Alex Brooks
|
a3691b6b5e
|
[Core][Frontend] Add Support for Inference Time mm_processor_kwargs (#9131)
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
|
2024-10-08 14:12:56 +00:00 |
|
Brendan Wong
|
8c746226c9
|
[Frontend] API support for beam search for MQLLMEngine (#9117)
|
2024-10-08 05:51:43 +00:00 |
|
youkaichao
|
e1faa2a598
|
[misc] improve ux on readme (#9147)
|
2024-10-07 22:26:25 -07:00 |
|
Kunshang Ji
|
80b57f00d5
|
[Intel GPU] Fix xpu decode input (#9145)
|
2024-10-08 03:51:14 +00:00 |
|
youkaichao
|
04c12f8157
|
[misc] update utils to support comparing multiple settings (#9140)
|
2024-10-08 02:51:49 +00:00 |
|
Simon Mo
|
8eeb857084
|
Add Slack to README (#9137)
|
2024-10-07 17:06:21 -07:00 |
|
youkaichao
|
fa45513a51
|
[misc] fix comment and variable name (#9139)
|
2024-10-07 16:07:05 -07:00 |
|
Kuntai Du
|
c0d9a98d0c
|
[Doc] Include performance benchmark in README (#9135)
|
2024-10-07 15:04:06 -07:00 |
|
Russell Bryant
|
e0dbdb013d
|
[CI/Build] Add linting for github actions workflows (#7876)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
|
2024-10-07 21:18:10 +00:00 |
|
TimWang
|
93cf74a8a7
|
[Doc]: Add deploying_with_k8s guide (#8451)
|
2024-10-07 13:31:45 -07:00 |
|
Cyrus Leung
|
151ef4efd2
|
[Model] Support NVLM-D and fix QK Norm in InternViT (#9045)
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2024-10-07 11:55:12 +00:00 |
|
Isotr0py
|
f19da64871
|
[Core] Refactor GGUF parameters packing and forwarding (#8859)
|
2024-10-07 10:01:46 +00:00 |
|
Isotr0py
|
4f95ffee6f
|
[Hardware][CPU] Cross-attention and Encoder-Decoder models support on CPU backend (#9089)
|
2024-10-07 06:50:35 +00:00 |
|
Cyrus Leung
|
8c6de96ea1
|
[Model] Explicit interface for vLLM models and support OOT embedding models (#9108)
|
2024-10-07 06:10:35 +00:00 |
|
youkaichao
|
18b296fdb2
|
[core] remove beam search from the core (#9105)
|
2024-10-07 05:47:04 +00:00 |
|
sroy745
|
c8f26bb636
|
[BugFix][Core] Fix BlockManagerV2 when Encoder Input is None (#9103)
|
2024-10-07 03:52:42 +00:00 |
|
Isotr0py
|
487678d046
|
[Bugfix][Hardware][CPU] Fix CPU model input for decode (#9044)
|
2024-10-06 19:14:27 -07:00 |
|
Varun Sundar Rabindranath
|
cb3b2b9ba4
|
[Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling (#9038)
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
|
2024-10-06 12:48:11 -07:00 |
|
Yanyi Liu
|
fdf59d30ea
|
[Bugfix] fix tool_parser error handling when serve a model not support it (#8709)
|
2024-10-06 12:51:08 +00:00 |
|
Cyrus Leung
|
b22b798471
|
[Model] PP support for embedding models and update docs (#9090)
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
|
2024-10-06 16:35:27 +08:00 |
|
Cyrus Leung
|
f22619fe96
|
[Misc] Remove user-facing error for removed VLM args (#9104)
|
2024-10-06 01:33:52 -07:00 |
|
Brendan Wong
|
168cab6bbf
|
[Frontend] API support for beam search (#9087)
Co-authored-by: youkaichao <youkaichao@126.com>
|
2024-10-05 23:39:03 -07:00 |
|
TJian
|
23fea8714a
|
[Bugfix] Fix try-catch conditions to import correct Flash Attention Backend in Draft Model (#9101)
|
2024-10-06 13:00:04 +08:00 |
|
youkaichao
|
f4dd830e09
|
[core] use forward context for flash infer (#9097)
|
2024-10-05 19:37:31 -07:00 |
|
Andy Dai
|
5df1834895
|
[Bugfix] Fix order of arguments matters in config.yaml (#8960)
|
2024-10-05 17:35:11 +00:00 |
|
Chen Zhang
|
cfadb9c687
|
[Bugfix] Deprecate registration of custom configs to huggingface (#9083)
|
2024-10-05 21:56:40 +08:00 |
|
Xin Yang
|
15986f598c
|
[Model] Support Gemma2 embedding model (#9004)
|
2024-10-05 06:57:05 +00:00 |
|