xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 03:15:20 +08:00
Code Issues Packages Projects Releases Wiki Activity
9,021 Commits 155 Branches 89 Tags
Commit Graph

54 Commits

Author SHA1 Message Date
Li, Jiang
ad39106b16
[CPU] Enable data parallel for CPU backend (#23903) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-08-29 02:19:58 -07:00
Didier Durand
d99c3a4f7b
[Doc]: fix typos in .md files (including those of #23751) (#23825) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-08-28 04:38:19 -07:00
Harry Mellor
2b61d2e22f
[Docs] Remove in-tree Gaudi install instructions (#23628) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-27 09:22:21 -07:00
Didier Durand
47455c424f
[Doc: ]fix various typos in multiple files (#23487) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-25 00:04:04 +00:00
Michael Goin
21dce80ea9
[CI/Build] Add support for Python 3.13 (#13164) 
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-08-19 13:49:34 -07:00
Daniele
0783f13960
[Doc] fix dead link (#22898) 
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
 2025-08-14 04:06:13 -07:00
Michael Goin
e18859298d
Add hardware plugins to installation doc (#22732) 
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-12 17:14:46 -07:00
Sooraj S
2f4657952b
[doc] Update x86 CPU-inference installation doc to reflect optionality of AVX512f (#22707) 
Signed-off-by: Sooraj S <94284954+sooraj-satheesh@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
 2025-08-12 00:21:08 -07:00
Nicolò Lucchesi
d1bf1b9711
[Docs][TPU] Highlight TPU Software version selection (#22242) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2025-08-05 02:33:46 -07:00
TankNee
83f7bbb318
Add chat doc in quick start (#21213) 
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-08-03 07:47:55 -07:00
David Xia
97608dc276
[Docs] use uv in CPU installation docs (#22089) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-08-01 07:55:55 -07:00
Yan Pashkovsky
bf668b5bf5
[Feature] Support multiple api keys in server (#18548) 
Signed-off-by: Yan Pashkovsky <yanp.bugz@gmail.com>
 2025-07-30 07:03:23 -07:00
Harry Mellor
ba5c5e5404
[Docs] Switch to better markdown linting pre-commit hook (#21851) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-29 19:45:08 -07:00
David Xia
37f86d9048
[Docs] use uv in GPU installation docs (#20277) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-07-29 10:32:06 -07:00
Kay Yan
2470419119
[Docs] Fix the outdated URL for installing from vLLM binaries (#21523) 
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-29 04:56:27 -07:00
Kebe
396ee94180
[CI] Unifying Dockerfiles for ARM and X86 Builds (#21343) 
Signed-off-by: Kebe <mail@kebe7jun.com>
 2025-07-25 07:33:56 -07:00
Li, Jiang
5e70dcd6e6
[Doc] Fix CPU doc format (#21316) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-21 21:47:49 -07:00
Li, Jiang
a15a50fc17
[CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-21 09:07:08 -07:00
Li, Jiang
e3a0e43d7f
[bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-19 05:13:55 -07:00
XiongfeiWei
58760e12b1
[TPU] Start using python 3.12 (#21000) 
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
 2025-07-16 19:37:44 -07:00
Nir David
01513a334a
Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010) 
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>
 2025-07-16 15:33:41 -04:00
Reid
a86754a12b
[docs] convert supported configs to table (#20858) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2025-07-12 06:54:50 -07:00
Harry Mellor
403b481573
Remove heading form installation inc.md file (#20697) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-09 10:42:51 -07:00
Li, Jiang
138709f8d1
[Doc] Update CPU doc (#20676) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-09 10:28:30 -07:00
Harry Mellor
b942c094e3
Stop using title frontmatter and fix doc that can only be reached by search (#20623) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-08 03:27:40 -07:00
Harry Mellor
b4bab81660
Remove unnecessary explicit title anchors and use relative links instead (#20620) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-08 02:49:13 -07:00
Harry Mellor
af107d5a0e
Make distinct code and console admonitions so readers are less likely to miss them (#20585) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 19:55:28 -07:00
Harry Mellor
1ad69e8375
[Doc] Fix some MkDocs snippets used in the installation docs (#20572) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 07:44:34 -07:00
Yang Yang
6e2c19ce22
[Refactor]Abstract Platform Interface for Distributed Backend and Add xccl Support for Intel XPU (#19410) 
Signed-off-by: dbyoung18 <yang5.yang@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-07-07 04:32:32 +00:00
Michael Yao
cb97f2bfc5
[Docs] Replace two list with tables in intel_gaudi.md (#20414) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-03 00:48:25 -07:00
Michael Yao
ae9c4d416f
[Docs] Make TPU ref prettier in google_tpu.md (#20356) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-02 02:04:08 -07:00
yyzxw
be0cfb2b68
fix[Docs]: link anchor is incorrect #20309 (#20315) 
Signed-off-by: zxw <1020938856@qq.com>
 2025-07-02 06:32:34 +00:00
Li, Jiang
6cc1e7d96d
[CPU] Update custom ops for the CPU backend (#20255) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-07-01 07:25:03 +00:00
Michael Goin
bf5181583f
[Doc] Guide for Incremental Compilation Workflow (#19109) 2025-06-25 22:06:46 +09:00
Reid
c53fec1fcb
[doc] add reference link for Intel XPU (#20064) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-25 12:24:07 +00:00
Kay Yan
0eed516951
[doc] Fix broken link in the installation for CPU (#19980) 
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
 2025-06-24 12:04:11 +08:00
Lukas Geiger
c3649e4fee
[Docs] Fix syntax highlighting of shell commands (#19870) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-06-23 17:59:09 +00:00
Reid
53243e5c42
[doc] improve readability for long commands (#19920) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-23 14:27:07 +00:00
Reid
f17aec0d63
[doc] Fold long code blocks to improve readability (#19926) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-23 05:24:23 +00:00
Reid
cca91a7a10
[doc] fix the incorrect label (#19787) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-18 10:30:58 +00:00
David Xia
93aee29fdb
[doc] split "Other AI Accelerators" tabs (#19708) 2025-06-17 22:05:29 +09:00
David Xia
119f683949
[doc] add project flag to gcloud TPU command (#19664) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-06-17 01:00:09 +00:00
Reid
1015296b79
[doc][mkdocs] fix the duplicate Supported features sections in GPU docs (#19606) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-13 16:25:08 +00:00
David Xia
89b0f84e17
[doc] fix "Other AI accelerators" getting started page (#19457) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-06-11 16:11:17 +00:00
Cyrus Leung
29a38f0352
[Doc] Support "important" and "announcement" admonitions (#19479) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-06-11 01:39:58 -07:00
Louie Tsai
9368cc90b2
Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930) 
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
 2025-06-10 06:22:05 +00:00
youkaichao
4e88723f32
[doc] clarify windows support (#19088) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-06-03 21:42:17 +08:00
Lu Fang
d32aa2e670
[Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) 
Signed-off-by: Lu Fang <lufang@fb.com>
 2025-06-03 00:16:17 -07:00
Gregory Shtrasberg
9e6f61e8c3
[ROCm][Build] Clean up the ROCm build (#19040) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2025-06-02 20:47:47 -07:00
aws-elaineyz
1661a9c28f
[Doc][Neuron] Update documentation for Neuron (#18868) 
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
 2025-05-28 19:44:01 -07:00