Vasiliy Kuznetsov 0d402d2600

online fp8 quant with streaming weight post-processing (#29196) ...

Signed-off-by: vasiliy <vasiliy@fb.com>

2025-12-08 20:15:10 +00:00

..

fla

…

fused_moe

[ROCm] [Fused Moe EP] Use binary expert mask for aiter fused moe kernel (#29773)

2025-12-08 05:23:46 +00:00

mamba

[Attention][CUDAGraph] Remove CG padding from attention backends (#29352)

2025-12-02 13:48:08 -05:00

quantization

online fp8 quant with streaming weight post-processing (#29196)

2025-12-08 20:15:10 +00:00

rotary_embedding

Access partial_rotary_factor from rope_parameters (#29966)

2025-12-04 18:42:49 +00:00

__init__.py

…

activation.py

[ROCm] Fallback pytorch GELU with tanh approximation to GELU() (#29244)

2025-12-02 02:02:22 +00:00

attention_layer_base.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

batch_invariant.py

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345)

2025-11-26 09:38:52 -07:00

conv.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842)

2025-11-18 18:56:04 +00:00

kda.py

[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)

2025-11-19 16:24:55 +00:00

layernorm.py

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

lightning_attn.py

[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132)

2025-11-21 11:53:09 -05:00

linear.py

…

logits_processor.py

…

mla.py

fix#30092 Kimi-Linear model loading failure with missing indexer_rotary_emb (#30093)

2025-12-05 20:55:09 -08:00

pooler.py

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

resampler.py

…

utils.py

[platform] Move get_cu_count to utils (#27005)

2025-11-13 08:48:47 +08:00

vocab_parallel_embedding.py

…