Lukas Geiger 2c1c7dfb35

[Models][Qwen] Replace pad with cat for better performance (#26486) ...

Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>

2025-10-09 14:51:26 +00:00

..

assets

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

attention

[Bugfix] Move current_platform import to avoid python import cache. (#16601)

2025-10-09 10:46:19 +00:00

benchmarks

[Bugfix] Fix SHM cache initialization (#26427)

2025-10-09 02:48:04 -07:00

compilation

Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)

2025-10-09 05:43:55 -07:00

config

Upgrade Pydantic to v2.12.0 and remove hack for Python 3.13 (#26481)

2025-10-09 06:02:40 -07:00

device_allocator

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

distributed

[Attention] Implement universal BACKEND_MAP (#25900)

2025-10-08 12:00:25 -07:00

engine

[Bugfix] Fix SHM cache initialization (#26427)

2025-10-09 02:48:04 -07:00

entrypoints

[Bugfix] Fix SHM cache initialization (#26427)

2025-10-09 02:48:04 -07:00

executor

Fix per file ruff ignores related to simplification (#26259)

2025-10-05 20:31:53 +00:00

inputs

[Bugfix] Fix SHM cache initialization (#26427)

2025-10-09 02:48:04 -07:00

logging_utils

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

lora

[V0 deprecation] Remove QKVCrossParallelLinear implementation (#26475)

2025-10-09 10:52:27 +00:00

model_executor

[Models][Qwen] Replace pad with cat for better performance (#26486)

2025-10-09 14:51:26 +00:00

multimodal

[Misc] Move LRUCache into its own file (#26342)

2025-10-07 15:08:40 +00:00

platforms

Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)

2025-10-09 05:43:55 -07:00

plugins

Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416)

2025-10-08 10:40:42 -07:00

profiler

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

ray

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

reasoning

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

third_party

fix some typos (#24071)

2025-09-02 20:44:50 -07:00

transformers_utils

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)

2025-10-08 15:33:56 +08:00

triton_utils

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

usage

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils

[Misc] Upgrade more code to Python 3.10 (#26463)

2025-10-09 10:43:53 +01:00

v1

[Bugfix] Fix SHM cache initialization (#26427)

2025-10-09 02:48:04 -07:00

vllm_flash_attn

[BugFix] Fix vllm_flash_attn install issues (#17267)

2025-04-27 17:27:56 -07:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

_bc_linter.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

_custom_ops.py

[Kernel] Centralize platform kernel import in current_platform.import_kernels (#26286)

2025-10-08 20:25:31 +00:00

_ipex_ops.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

beam_search.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

collect_env.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

connections.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

env_override.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

envs.py

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)

2025-10-08 15:33:56 +08:00

forward_context.py

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)

2025-10-07 01:57:49 +00:00

logger.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

logits_process.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

logprobs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

pooling_params.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

py.typed

…

sampling_params.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

scalar_type.py

[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166)

2025-10-07 09:35:26 -04:00

scripts.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

tasks.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

test_utils.py

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

tracing.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00