ElizaWszola 502640c3f9

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696) ...

Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

2025-10-02 19:35:13 +00:00

..

__init__.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

cache.py

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

2025-09-30 17:14:41 +08:00

compilation.py

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

2025-09-30 17:14:41 +08:00

device.py

Move DeviceConfig, ObservabilityConfig, SpeechToTextConfig to their own files (#25564)

2025-09-24 13:59:05 +00:00

kv_events.py

Move KVEventsConfig from config/__init__.py to config/kv_events.py (#24433)

2025-09-08 06:41:27 -07:00

kv_transfer.py

[Nixl][P/D] Add cuda2cpu support (HD->DH transfer) (#24690)

2025-09-29 14:31:51 +00:00

load.py

Fix typing for safetensors_load_strategy (#24641)

2025-09-11 10:41:39 +00:00

lora.py

Move LoRAConfig from config/__init__.py to config/lora.py (#24644)

2025-09-11 11:01:38 +00:00

model.py

Add explicit pooling classes for the Transformers backend (#25322)

2025-09-30 23:07:06 +01:00

multimodal.py

EVS Support (Video tokens pruning) (#22980)

2025-09-26 11:54:54 +08:00

observability.py

Move DeviceConfig, ObservabilityConfig, SpeechToTextConfig to their own files (#25564)

2025-09-24 13:59:05 +00:00

parallel.py

[Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982)

2025-09-27 14:22:28 +00:00

pooler.py

Move PoolerConfig from config/__init__.py to config/pooler.py (#25181)

2025-09-19 11:02:55 +00:00

scheduler.py

[Bugfix]: Clean up chunked prefill logging when using whisper (#25075)

2025-09-30 08:17:49 +00:00

speculative.py

[Model] MTP fallback to eager for DeepSeek v32 (#25982)

2025-10-01 01:53:22 +00:00

speech_to_text.py

Move DeviceConfig, ObservabilityConfig, SpeechToTextConfig to their own files (#25564)

2025-09-24 13:59:05 +00:00

structured_outputs.py

Move StructuredOutputsConfig from config/__init__.py to config/structured_outputs.py (#25153)

2025-09-18 11:24:27 +00:00

utils.py

Add explicit pooling classes for the Transformers backend (#25322)

2025-09-30 23:07:06 +01:00

vllm.py

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696)

2025-10-02 19:35:13 +00:00