danielafrimi 13618626df

[MoE-FP8-modelopt] Add FlashInfer alignment padding for intermediate dimensions (#29748) ...

Signed-off-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

2025-12-12 20:42:32 +00:00

..

fla

…

fused_moe

[Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532)

2025-12-12 05:57:47 -08:00

mamba

Add SpecDec support to selective_state_update (#29488)

2025-12-08 16:45:18 -05:00

quantization

[MoE-FP8-modelopt] Add FlashInfer alignment padding for intermediate dimensions (#29748)

2025-12-12 20:42:32 +00:00

rotary_embedding

Standardise get_rope to use rope_parameters["partial_rotary_factor"], not rotary_dim (#30389)

2025-12-11 20:45:23 +00:00

__init__.py

…

activation.py

[ROCm] Fallback pytorch GELU with tanh approximation to GELU() (#29244)

2025-12-02 02:02:22 +00:00

attention_layer_base.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

batch_invariant.py

[Feature] Batch-Invariant Support for FA2 and LoRA (#30018)

2025-12-09 10:01:38 -05:00

conv.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842)

2025-11-18 18:56:04 +00:00

kda.py

[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)

2025-11-19 16:24:55 +00:00

layernorm.py

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

lightning_attn.py

[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132)

2025-11-21 11:53:09 -05:00

linear.py

…

logits_processor.py

…

mla.py

fix#30092 Kimi-Linear model loading failure with missing indexer_rotary_emb (#30093)

2025-12-05 20:55:09 -08:00

pooler.py

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

resampler.py

…

utils.py

[platform] Move get_cu_count to utils (#27005)

2025-11-13 08:48:47 +08:00

vocab_parallel_embedding.py

…