xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-09 18:49:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/vllm
History
Harry Mellor cf069aa8aa
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
..
adapter_commons
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
assets
[Frontend] Add /v1/audio/transcriptions OpenAI API endpoint (#12909)
2025-02-13 07:23:45 -08:00
attention
[core] Perf improvement for DSv3 on AMD GPUs (#13718)
2025-02-27 22:14:30 +00:00
compilation
[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename RedundantReshapesPass to NoopEliminationPass (#10902)
2025-02-28 16:20:11 -07:00
core
[Core] Reduce TTFT with concurrent partial prefills (#10235)
2025-02-14 15:36:07 -08:00
device_allocator
[core] fix sleep mode in pytorch 2.6 (#13456)
2025-02-18 13:48:10 +08:00
distributed
[Bugfix][Disaggregated] patch the inflight batching on the decode node in SimpleConnector to avoid hangs in SimpleBuffer (nccl based) (#13987)
2025-02-28 07:53:45 +00:00
engine
[v0][structured output] Support reasoning output (#12955)
2025-03-02 14:49:42 -05:00
entrypoints
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
executor
[core] Bump ray to 2.43 (#13994)
2025-02-28 21:47:44 +00:00
inputs
[VLM] Deprecate legacy input mapper for OOT multimodal models (#13979)
2025-02-27 19:14:55 +00:00
logging_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
lora
[Model] Add LoRA support for TransformersModel (#13770)
2025-03-02 09:17:34 +08:00
model_executor
[v0][structured output] Support reasoning output (#12955)
2025-03-02 14:49:42 -05:00
multimodal
[VLM][Bugfix] Enable specifying prompt target via index (#14038)
2025-02-28 07:35:55 -08:00
platforms
[V1][Minor] Do not print attn backend twice (#13985)
2025-03-01 07:09:14 +00:00
plugins
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
profiler
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
prompt_adapter
[Misc] set single whitespace between log sentences (#13771)
2025-02-25 10:26:12 +08:00
spec_decode
[Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626)
2025-02-27 15:28:08 -08:00
third_party
[core] port pynvml into vllm codebase (#12963)
2025-02-09 15:00:00 +08:00
transformers_utils
[Bugfix] Add file lock for ModelScope download (#14060)
2025-03-01 06:10:28 +00:00
triton_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
usage
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
v1
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
vllm_flash_attn
[ci][build] fix vllm-flash-attn (#8699)
2024-09-21 23:24:58 -07:00
worker
[Misc] Accurately capture the time of loading weights (#14063)
2025-03-01 17:20:30 -08:00
__init__.py
[MISC] Always import version library first in the vllm package (#12979)
2025-02-09 18:56:40 +08:00
_custom_ops.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
_ipex_ops.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
beam_search.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
config.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
connections.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
envs.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
forward_context.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
logger.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
logits_process.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
outputs.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
pooling_params.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
scalar_type.py
[NVIDIA] Support nvfp4 quantization (#12784)
2025-02-12 19:51:51 -08:00
scripts.py
[Frontend] Move CLI code into vllm.cmd package (#12971)
2025-02-12 23:12:21 -08:00
sequence.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
test_utils.py
Use smaller embedding model when not testing model specifically (#13891)
2025-02-28 00:50:43 -08:00
tracing.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
utils.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
version.py
[Metrics] Add --show-hidden-metrics-for-version CLI arg (#13295)
2025-02-22 00:20:45 -08:00