Ayush Satyam cd9890544b

fix(v1/kv_cache): resolve async KV transfer bug in cascade attention (#23485) ...

Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>

2025-10-08 04:46:33 +00:00

..

assets

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

attention

[Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125)

2025-10-08 10:09:34 +08:00

benchmarks

[Benchmark] Enable MM Embedding benchmarks (#26310)

2025-10-06 19:51:58 +00:00

compilation

[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)

2025-10-07 12:53:43 -07:00

config

[torchao] safetensors integration (#25969)

2025-10-07 20:12:35 -06:00

device_allocator

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

distributed

Fix per file ruff ignores related to line length (#26262)

2025-10-06 05:12:40 +00:00

engine

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)

2025-10-07 01:57:49 +00:00

entrypoints

Optimize KV cache distribution for asymmetric pipeline parallelism (#25164)

2025-10-07 09:20:30 +00:00

executor

Fix per file ruff ignores related to simplification (#26259)

2025-10-05 20:31:53 +00:00

inputs

[Frontend] Consolidate tokenizer init code (#26276)

2025-10-06 09:34:52 +00:00

logging_utils

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

lora

[Misc] Move LRUCache into its own file (#26342)

2025-10-07 15:08:40 +00:00

model_executor

Add SwigluOAI implementation for CPUFusedMOE (#26347)

2025-10-07 20:17:49 -06:00

multimodal

[Misc] Move LRUCache into its own file (#26342)

2025-10-07 15:08:40 +00:00

platforms

[Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125)

2025-10-08 10:09:34 +08:00

plugins

Fix per file ruff ignores related to typing (#26254)

2025-10-05 16:37:55 +00:00

profiler

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

ray

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

reasoning

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

third_party

fix some typos (#24071)

2025-09-02 20:44:50 -07:00

transformers_utils

[Model] Lfm2Moe (#26344)

2025-10-07 16:03:05 +00:00

triton_utils

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

usage

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils

[Bugfix] Fix MTP+FlashInfer crash when trtllm kernels are available but disabled (#26361)

2025-10-07 22:12:26 +00:00

v1

fix(v1/kv_cache): resolve async KV transfer bug in cascade attention (#23485)

2025-10-08 04:46:33 +00:00

vllm_flash_attn

[BugFix] Fix vllm_flash_attn install issues (#17267)

2025-04-27 17:27:56 -07:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

_bc_linter.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

_custom_ops.py

Fix per file ruff ignores related to simplification (#26259)

2025-10-05 20:31:53 +00:00

_ipex_ops.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

beam_search.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

collect_env.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

connections.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

env_override.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

envs.py

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)

2025-10-07 01:57:49 +00:00

forward_context.py

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)

2025-10-07 01:57:49 +00:00

logger.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

logits_process.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

logprobs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

pooling_params.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

py.typed

Add py.typed so consumers of vLLM can get type checking (#1509)

2023-10-30 14:50:47 -07:00

sampling_params.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

scalar_type.py

[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166)

2025-10-07 09:35:26 -04:00

scripts.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

tasks.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

test_utils.py

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

tracing.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00