xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-24 22:54:31 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/vllm
History
kimbochen 013abde6ef
Adding Warmup to Benchmark Serving (#26943) 
Signed-off-by: Kimbo Chen <chentenghung@gmail.com>
2025-10-16 12:44:32 -07:00
..
assets
[bugfix] Lazy import cv2 (#26869)
2025-10-15 07:47:50 +00:00
attention
[Feature] Add process_weights_after_loading to AttentionImpl (#26870)
2025-10-16 08:02:30 -07:00
benchmarks
Adding Warmup to Benchmark Serving (#26943)
2025-10-16 12:44:32 -07:00
compilation
Deepseek-v3 Batch Invariant on 8xH100 (#26609)
2025-10-15 22:06:02 -07:00
config
Support block size of 256 used by Intel HPU (#26883)
2025-10-16 15:10:57 -04:00
device_allocator
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
distributed
[NIXL] Improve request_finished() debug logs (#25665)
2025-10-16 15:55:17 +02:00
engine
Support set in the CLI generation (#27031)
2025-10-16 18:07:18 +00:00
entrypoints
[gpt-oss][1/N] EZ: refactor serving_responses for modularity (#26948)
2025-10-16 18:44:06 +00:00
executor
[Chore] Rename utils submodules (#26920)
2025-10-16 03:58:13 +00:00
inputs
[Chore] Separate out vllm.utils.collections (#26990)
2025-10-16 08:35:35 +00:00
logging_utils
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
lora
[Lora]Load tuned multi-lora kernel configs from json files (#26319)
2025-10-15 09:45:14 +00:00
model_executor
[Compressed Tensors] Always clone output for compile robustness (#26849)
2025-10-16 19:29:59 +00:00
multimodal
[Chore] Separate out vllm.utils.collections (#26990)
2025-10-16 08:35:35 +00:00
platforms
[Misc] rename torch_dtype to dtype (#26695)
2025-10-15 12:11:48 +00:00
plugins
[Plugin] Make plugin group clear (#26757)
2025-10-14 07:49:59 +00:00
profiler
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
ray
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
reasoning
[Chore] Separate out vllm.utils.collections (#26990)
2025-10-16 08:35:35 +00:00
third_party
fix some typos (#24071)
2025-09-02 20:44:50 -07:00
transformers_utils
[Chore] Rename utils submodules (#26920)
2025-10-16 03:58:13 +00:00
triton_utils
[Misc] Update TritonLanguagePlaceholder to have attributes that are used by Flash Linear Attention ops. (#26853)
2025-10-15 08:37:49 +00:00
usage
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
utils
[Chore] Separate out vllm.utils.collections (#26990)
2025-10-16 08:35:35 +00:00
v1
[Feature] Add process_weights_after_loading to AttentionImpl (#26870)
2025-10-16 08:02:30 -07:00
vllm_flash_attn
…
__init__.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
_bc_linter.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
_custom_ops.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
_ipex_ops.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
beam_search.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
collect_env.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
connections.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
env_override.py
[BugFix] Patch inductor memory plan logic (#26878)
2025-10-15 12:51:45 +00:00
envs.py
[ROCm][FEAT] Fuse DeepSeek shared experts into AITER fused_moe ops (#24097)
2025-10-16 10:41:34 +08:00
forward_context.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
logger.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
logits_process.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
logprobs.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
outputs.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
pooling_params.py
[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)
2025-10-15 11:14:41 +00:00
py.typed
…
sampling_params.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
scalar_type.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
scripts.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
sequence.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
tasks.py
[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)
2025-10-15 11:14:41 +00:00
test_utils.py
Remove V0 Encoder-Decoder Support (#24907)
2025-09-15 21:17:14 -07:00
tracing.py
[Chore] Rename utils submodules (#26920)
2025-10-16 03:58:13 +00:00
version.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00