Ning Xie 326976291b

[Misc] code clean duplicate set_current_vllm_config in _set_vllm_config (#22566) ...

Signed-off-by: Andy Xie <andy.xning@gmail.com>

2025-08-10 00:08:48 -07:00

..

attention

[NVIDIA] Support Flashinfer TRT-LLM Prefill Attention Kernel (#22095)

2025-08-05 02:45:34 -07:00

core

[perf] Add fused MLA QKV + strided layernorm (#21116)

2025-07-22 07:07:44 -07:00

mamba

[Model] Mamba2 preallocate SSM output tensor to avoid d2d copy overhead (#21075)

2025-08-02 01:59:34 -07:00

moe

[Misc] code clean duplicate set_current_vllm_config in _set_vllm_config (#22566)

2025-08-10 00:08:48 -07:00

quantization

[CI] Initial tests for SM100 Blackwell runner (#21877)

2025-08-01 16:18:38 -07:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

allclose_default.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

quant_utils.py

[Refactor] Remove Duplicate per_block_cast_to_fp8, Remove Dependencies of DeepGEMM (#21787)

2025-08-01 01:13:27 +00:00

test_apply_repetition_penalties.py

[BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491)

2025-07-05 19:38:02 -07:00

test_cutlass_mla_decode.py

[NVIDIA] Add Cutlass MLA backend (#17625)

2025-06-03 21:40:26 -07:00

test_flex_attention.py

Support encoder_only attention for FlexAttention (#22273)

2025-08-06 18:37:14 -07:00

test_fused_quant_activation.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_mrope.py

[FEAT] [Performance] Add triton mrope to replace the torch code path (#22375)

2025-08-09 11:50:03 -07:00

test_shuffle_rows.py

[Bugfix] Fix CUDA arch flags for MoE permute (#21426)

2025-07-24 03:23:59 -07:00

test_triton_flash_attention.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[Misc] Add unit tests for MoE ModularKernel combinations + Profiling utility (#20449)

2025-07-11 07:51:46 -07:00