PatrykSaffer 4c2e10ea19

[Bugfix] Fix cuda graph sizes when running with speculative decoding (#30330) ...

Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>

2025-12-10 00:47:07 +00:00

..

__init__.py

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

attention.py

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)

2025-12-05 09:48:43 -08:00

cache.py

[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978)

2025-12-05 00:34:33 -08:00

compilation.py

Add evaluate_guards option to DynamicShapesConfig (#27432)

2025-12-08 10:46:15 -05:00

device.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

ec_transfer.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

kv_events.py

…

kv_transfer.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

load.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

lora.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

model.py

[Model][7/N] Improve all pooling task | Deprecation as_reward_model. Extract hidden states prefer using new multi-vector retrieval API (#26686)

2025-12-08 08:10:09 +00:00

multimodal.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

observability.py

[Feature] Add Layer-wise NVTX Support (#29990)

2025-12-05 11:20:07 +00:00

parallel.py

Better error when world size is larger than node and distributed_executor_backend is not set (#30140)

2025-12-05 20:53:52 -08:00

pooler.py

Improve enable chunked_prefill & prefix_caching logic. (#26623)

2025-11-27 22:05:48 -08:00

profiler.py

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

scheduler.py

Remove default values from InitVars so that they're not stored (#29859)

2025-12-02 12:16:37 +00:00

speculative.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

speech_to_text.py

…

structured_outputs.py

Reduce validation to a warning (#28749)

2025-12-05 14:02:49 +00:00

utils.py

[Compile] Conditional compilation. Introduce compile_ranges (#24252)

2025-12-05 18:17:32 +00:00

vllm.py

[Bugfix] Fix cuda graph sizes when running with speculative decoding (#30330)

2025-12-10 00:47:07 +00:00