billishyahao 2518230d3e

[MISC] Fix misleading batch_size_capture_list when cuda_graph_sizes < 4 (#25829) ...

Signed-off-by: billishyahao <bill.he@amd.com>
Co-authored-by: Luka Govedic <ProExpertProg@users.noreply.github.com>

2025-10-01 08:39:45 -04:00

..

__init__.py

MoveVllmConfig from config/__init__.py to config/vllm.py (#25271)

2025-09-29 19:49:49 -07:00

cache.py

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

2025-09-30 17:14:41 +08:00

compilation.py

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

2025-09-30 17:14:41 +08:00

device.py

Move DeviceConfig, ObservabilityConfig, SpeechToTextConfig to their own files (#25564)

2025-09-24 13:59:05 +00:00

kv_events.py

Move KVEventsConfig from config/__init__.py to config/kv_events.py (#24433)

2025-09-08 06:41:27 -07:00

kv_transfer.py

[Nixl][P/D] Add cuda2cpu support (HD->DH transfer) (#24690)

2025-09-29 14:31:51 +00:00

load.py

Fix typing for safetensors_load_strategy (#24641)

2025-09-11 10:41:39 +00:00

lora.py

Move LoRAConfig from config/__init__.py to config/lora.py (#24644)

2025-09-11 11:01:38 +00:00

model.py

Add explicit pooling classes for the Transformers backend (#25322)

2025-09-30 23:07:06 +01:00

multimodal.py

EVS Support (Video tokens pruning) (#22980)

2025-09-26 11:54:54 +08:00

observability.py

Move DeviceConfig, ObservabilityConfig, SpeechToTextConfig to their own files (#25564)

2025-09-24 13:59:05 +00:00

parallel.py

[Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982)

2025-09-27 14:22:28 +00:00

pooler.py

Move PoolerConfig from config/__init__.py to config/pooler.py (#25181)

2025-09-19 11:02:55 +00:00

scheduler.py

[Bugfix]: Clean up chunked prefill logging when using whisper (#25075)

2025-09-30 08:17:49 +00:00

speculative.py

[Model] MTP fallback to eager for DeepSeek v32 (#25982)

2025-10-01 01:53:22 +00:00

speech_to_text.py

Move DeviceConfig, ObservabilityConfig, SpeechToTextConfig to their own files (#25564)

2025-09-24 13:59:05 +00:00

structured_outputs.py

Move StructuredOutputsConfig from config/__init__.py to config/structured_outputs.py (#25153)

2025-09-18 11:24:27 +00:00

utils.py

Add explicit pooling classes for the Transformers backend (#25322)

2025-09-30 23:07:06 +01:00

vllm.py

[MISC] Fix misleading batch_size_capture_list when cuda_graph_sizes < 4 (#25829)

2025-10-01 08:39:45 -04:00