elvischenv 03752dba8f

[NVIDIA] Support Flashinfer TRTLLM FP8-q/kv/out Attention Kernel (#21716) ...

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2025-08-19 08:22:15 -04:00

..

piecewise

[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)

2025-08-15 10:01:39 -04:00

__init__.py

[torch.compile] register allreduce operations as custom ops (#8526)

2024-09-16 22:57:57 -07:00

backend.py

[torch.compile][ROCm] Fuse quantization onto attention using a torch.compile pass (#16756)

2025-06-12 08:31:04 -07:00

test_async_tp.py

[Feature] Add async tensor parallelism for scaled mm (#20155)

2025-07-30 17:23:41 -04:00

test_basic_correctness.py

[V0 Deprecation] Remove V0 FlashInfer attention backend (#22776)

2025-08-18 19:54:16 -07:00

test_config.py

[Bugfix] VLLM_V1 supports passing other compilation levels (#19340)

2025-07-29 09:35:58 -04:00

test_full_graph.py

[Kernel/Quant] Remove AQLM (#22943)

2025-08-16 19:38:21 +00:00

test_functionalization.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_fusion_all_reduce.py

[CI] Initial tests for SM100 Blackwell runner (#21877)

2025-08-01 16:18:38 -07:00

test_fusion_attn.py

[NVIDIA] Support Flashinfer TRTLLM FP8-q/kv/out Attention Kernel (#21716)

2025-08-19 08:22:15 -04:00

test_fusion.py

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830)

2025-07-11 04:56:28 +00:00

test_pass_manager.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sequence_parallelism.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

test_silu_mul_quant_fusion.py

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830)

2025-07-11 04:56:28 +00:00

test_wrapper.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00