xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 03:44:58 +08:00
Code Issues Packages Projects Releases Wiki Activity
12,040 Commits 155 Branches 89 Tags
Commit Graph

58 Commits

Author SHA1 Message Date
wang.yuqi
2eb4fe9129
[examples] Resettle pooling examples. (#29365) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-12-02 15:54:28 +00:00
sangbumlikeagod
092bb73b8a
[Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) 
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
 2025-12-01 18:19:17 +01:00
wang.yuqi
62de4f4257
[Frontend] Resettle pooling entrypoints (#29634) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2025-12-01 15:30:43 +08:00
Ben Browning
e1dd706cd1
[Frontend] Respect Chat Completion parallel_tool_calls param (#26233) 
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2025-11-25 09:56:15 +00:00
Michael Act
3ed767ec06
docs: fixes distributed executor backend config for multi-node vllm (#29173) 
Signed-off-by: Michael Act <michael.a.c.tulenan@gdplabs.id>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-11-23 10:58:28 +08:00
Kevin H. Luu
c64c0b78de
[chore] Move the rest of wikimedia url to S3 (#28921) 
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-11-18 09:44:18 -08:00
the-codeboy
287bbbeb06
[Doc] Fix typo in serving docs (#28474) 
Signed-off-by: the-codeboy <71213855+the-codeboy@users.noreply.github.com>
 2025-11-11 16:45:49 +00:00
wang.yuqi
4464723f22
[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) 
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-10-30 12:13:05 +00:00
Patrick von Platen
b038d9c40c
[Data-parallel] Allow DP>1 for world_size > num_gpus on node (8) (#26367) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
 2025-10-17 08:24:42 -07:00
Harry Mellor
483ea64611
[Docs] Replace all explicit anchors with real links (#27087) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-17 02:22:06 -07:00
Harry Mellor
4ffd6e8942
[Docs] Reduce custom syntax used in docs (#27009) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-16 20:05:34 -07:00
youkaichao
650b51f9f9
[doc] add Context Parallel Deployment doc (#26877) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-10-15 16:33:52 +08:00
Cyrus Leung
6256697997
[Doc] ruff format remaining Python examples (#26795) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-15 01:25:49 -07:00
Michael Goin
3e051bda82
[UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-10-13 18:12:52 -07:00
Chendi.Xue
9fc983c707
[NIXL][non-cuda] Add install script for nixl with non-cuda ucx (#25959) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
 2025-10-08 14:19:53 +00:00
Cyrus Leung
2f652e6cdf
[Doc] Improve MM Pooling model documentation (#25966) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-09-30 18:58:29 +00:00
yyzxw
ecb37e276a
[docs] transcriptions API audio upload (#25446) 
Signed-off-by: zxw <1020938856@qq.com>
 2025-09-27 15:00:35 +00:00
Peter Pan
b1068903fd
[docs] fix nixl kv_connector_extra_config.backends key (#25565) 
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-09-24 11:00:27 +00:00
Chendi.Xue
5774b0a1da
[NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) 
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
 2025-09-23 04:17:42 +00:00
Kay Yan
eaffe4486c
[Docs] Fix pooling-params doc references in openai_compatible_server.md (#24939) 2025-09-18 04:36:47 -07:00
Aaron Pham
29283e8976
[Chore] Cleanup guided namespace, move to structured outputs config (#22772) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-18 09:20:27 +00:00
Benjamin Bartels
64ad551878
Removes source compilation of nixl dependency (#24874) 
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Daniele <36171005+dtrifiro@users.noreply.github.com>
 2025-09-17 01:33:18 +00:00
wang.yuqi
bf214ca226
[Misc] Fix examples openai_pooling_client.py (#24853) 
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-15 11:57:30 +00:00
Harry Mellor
51d41265ad
[Docs] Fix typos in EP deployment doc (#24669) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-11 09:07:23 -07:00
Tyler Michael Smith
8b83b93739
[Docs] Document the extra memory footprint overhead when using EPLB (#24537) 
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-09-10 06:09:49 -07:00
rongfu.leng
c44797a4d6
[Docs]add eplb_config param use docs (#24213) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-09-08 09:36:57 -07:00
Didier Durand
55be93baf5
[Doc]: fix 2 hyperlinks leading to Ray site after they changed Ray's doc structure (#24438) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-08 09:36:54 -07:00
Ricardo Decal
e290594072
[Docs] Rename “Distributed inference and serving” to “Parallelism & Scaling” (#22466) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-08-08 19:26:21 +00:00
Ricardo Decal
a2c6696bfe
[Docs] Factor out troubleshooting to its own guide; add section for Ray Observability (#21578) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-08-07 00:29:13 -07:00
Ricardo Decal
4cd7fe6cea
[Docs] Expand introduction to Ray in Multi-node deployment section (#21584) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-29 22:07:28 -07:00
Harry Mellor
ba5c5e5404
[Docs] Switch to better markdown linting pre-commit hook (#21851) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-29 19:45:08 -07:00
Cyrus Leung
86ae693f20
[Deprecation][2/N] Replace --task with --runner and --convert (#21470) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-27 19:42:40 -07:00
Simon Mo
a6c7fb8cff
[Docs] Add Expert Parallelism Initial Documentation (#21373) 
Signed-off-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-24 12:36:06 -07:00
Ricardo Decal
a7272c23d0
[Docs][minor] Fix broken gh-file link in distributed serving docs (#21543) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-24 10:36:56 -07:00
Ricardo Decal
684174115d
[Docs] Rewrite Distributed Inference and Serving guide (#20593) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-24 08:13:05 -07:00
deven-labovitch
63d92abb7c
[Frontend] Set MAX_AUDIO_CLIP_FILESIZE_MB via env var instead of hardcoding (#21374) 
Signed-off-by: Deven Labovitch <deven@videa.ai>
 2025-07-23 20:22:19 -07:00
Ricardo Decal
c4e3b12524
[Docs] Add minimal demo of Ray Data API usage (#21080) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-17 20:09:19 -07:00
Rui Qiao
d91278181d
[doc] Add more details for Ray-based DP (#20948) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-07-15 05:37:12 -07:00
Nick Hill
9907fc4494
[Docs] Data Parallel deployment documentation (#20768) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-07-11 09:42:10 -07:00
shineran96
4bed167768
[Model][VLM] Support JinaVL Reranker (#20260) 
Signed-off-by: shineran96 <shinewang96@gmail.com>
 2025-07-10 10:43:43 -07:00
Harry Mellor
b942c094e3
Stop using title frontmatter and fix doc that can only be reached by search (#20623) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-08 03:27:40 -07:00
Harry Mellor
b4bab81660
Remove unnecessary explicit title anchors and use relative links instead (#20620) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-08 02:49:13 -07:00
Ricardo Decal
90a2769f20
[Docs] Add Ray Serve LLM section to openai compatible server guide (#20595) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-07 20:08:05 -07:00
Ricardo Decal
0d914c81a2
[Docs] Rewrite offline inference guide (#20594) 
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
 2025-07-07 20:06:02 -07:00
Harry Mellor
6e428cdd7a
[Doc] Syntax highlight request responses as JSON instead of bash (#20582) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 20:02:45 -07:00
Harry Mellor
af107d5a0e
Make distinct code and console admonitions so readers are less likely to miss them (#20585) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-07 19:55:28 -07:00
wang.yuqi
6f1229f91d
[Model][2/N] Automatic conversion of CrossEncoding model (#19978) 
Signed-off-by: wang.yuqi <noooop@126.com>
 2025-07-03 13:59:23 +00:00
yyzxw
be0cfb2b68
fix[Docs]: link anchor is incorrect #20309 (#20315) 
Signed-off-by: zxw <1020938856@qq.com>
 2025-07-02 06:32:34 +00:00
Ernest Wong
bd5038af07
[Doc] add config and troubleshooting guide for NCCL & GPUDirect RDMA (#15897) 
Signed-off-by: Ernest Wong <chwong719@gmail.com>
 2025-06-30 21:44:39 -07:00
Yazan Sharaya
6e244ae091
[Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) 
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
 2025-06-27 00:44:14 -04:00