Woosuk Kwon c0c25e25fa

[Model] Add support for Gemma 3 (#14660) ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

2025-03-12 08:36:33 -07:00

..

adapter_commons

…

assets

[Misc] Upgrade to Python 3.9 typing for additional directories (#14492)

2025-03-08 17:35:50 +00:00

attention

[CPU] Upgrade CPU backend to torch-2.6 (#13381)

2025-03-12 10:41:13 +00:00

benchmarks

[Feature] Add vllm bench CLI (#13993)

2025-03-12 00:31:48 +00:00

compilation

Correct capitalisation: VLLM -> vLLM (#14562)

2025-03-10 16:36:21 +00:00

core

[Bugfix][Core] fix abort_seq_group and memory leak when n>1 (#14326)

2025-03-06 23:59:32 +08:00

device_allocator

[sleep mode] error out with expandable_segments (#14189)

2025-03-04 18:54:19 +08:00

distributed

[Neuron] Add Neuron device communicator for vLLM v1 (#14085)

2025-03-10 18:37:04 -07:00

engine

[core][V1] pluggable scheduler (#14466)

2025-03-12 01:15:15 +00:00

entrypoints

[Model] Add support for Gemma 3 (#14660)

2025-03-12 08:36:33 -07:00

executor

[CPU] Upgrade CPU backend to torch-2.6 (#13381)

2025-03-12 10:41:13 +00:00

inputs

[Misc] Upgrade to Python 3.9 typing for additional directories (#14492)

2025-03-08 17:35:50 +00:00

logging_utils

…

lora

[V1] LoRA - Add triton kernels for V1 (#13096)

2025-03-10 17:27:53 -04:00

model_executor

[Model] Add support for Gemma 3 (#14660)

2025-03-12 08:36:33 -07:00

multimodal

[Frontend] support image embeds (#13955)

2025-03-10 12:36:03 +00:00

platforms

[CPU] Upgrade CPU backend to torch-2.6 (#13381)

2025-03-12 10:41:13 +00:00

plugins

…

profiler

…

prompt_adapter

…

spec_decode

[Bugfix] Fix DeepSeek MTP crash when using TP1ModelRunner with CUDA graph due to shape mismatch (#14237)

2025-03-05 22:22:40 +00:00

third_party

…

transformers_utils

Correct capitalisation: VLLM -> vLLM (#14562)

2025-03-10 16:36:21 +00:00

triton_utils

…

usage

[Misc] Upgrade to Python 3.9 typing for additional directories (#14492)

2025-03-08 17:35:50 +00:00

v1

[V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing (#14645)

2025-03-11 22:12:41 -07:00

vllm_flash_attn

…

worker

[Bugfix] Make the deviceprofiler include LoRA memory. (#14469)

2025-03-08 07:12:22 +00:00

__init__.py

…

_custom_ops.py

[ROCm][Bugfix] Ensure that the moe_wna16_gemm kernel is not built on ROCm platforms. (#14629)

2025-03-12 08:00:28 -04:00

_ipex_ops.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

beam_search.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

config.py

[Model] Add support for Gemma 3 (#14660)

2025-03-12 08:36:33 -07:00

connections.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

envs.py

Correct capitalisation: VLLM -> vLLM (#14562)

2025-03-10 16:36:21 +00:00

forward_context.py

[Bugfix] Remove num_tokens_across_dp (#14302)

2025-03-05 23:55:55 +00:00

logger.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

logits_process.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

outputs.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

pooling_params.py

…

py.typed

…

sampling_params.py

[V1] Support bad_words in sampler (#13376)

2025-03-08 14:50:26 -08:00

scalar_type.py

…

scripts.py

…

sequence.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

test_utils.py

…

tracing.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

utils.py

[V1] Support bad_words in sampler (#13376)

2025-03-08 14:50:26 -08:00

version.py

…