Alexander Matveev 396d92d5e0

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)

2024-07-21 19:41:42 -04:00

..

__init__.py

…

allclose_default.py

…

conftest.py

…

quant_utils.py

[ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593)

2024-07-19 18:15:26 -07:00

test_activation.py

…

test_attention_selector.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

test_attention.py

[Kernel][Attention] Separate Attention.kv_scale into k_scale and v_scale (#6081)

2024-07-16 15:31:32 -07:00

test_blocksparse_attention.py

[Kernel][Attention] Separate Attention.kv_scale into k_scale and v_scale (#6081)

2024-07-16 15:31:32 -07:00

test_cache.py

[Kernel][Attention] Separate Attention.kv_scale into k_scale and v_scale (#6081)

2024-07-16 15:31:32 -07:00

test_cutlass.py

[hardware][misc] introduce platform abstraction (#6080)

2024-07-02 20:12:22 -07:00

test_encoder_decoder_attn.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

test_flash_attn.py

…

test_flashinfer.py

[Kernel][Model] logits_soft_cap for Gemma2 with flashinfer (#6051)

2024-07-04 16:35:51 -07:00

test_fp8_quant.py

[ Kernel ] FP8 Dynamic Per Token Quant - Add scale_ub (#6593)

2024-07-19 18:15:26 -07:00

test_int8_quant.py

[ Kernel ] FP8 Dynamic-Per-Token Quant Kernel (#6511)

2024-07-18 01:38:35 +00:00

test_layernorm.py

…

test_marlin_gemm.py

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)

2024-07-21 19:41:42 -04:00

test_moe.py

…

test_pos_encoding.py

…

test_prefix_prefill.py

…

test_rand.py

…

test_sampler.py

…

utils.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00