SangBin Cho 8a7cc254a0

Revert "[Kernel] Use flash-attn for decoding (#3648)" (#4820) ...

Lora 3 & 4 test seems to have illegal memory access failure after this commit;

[2024-05-14 23:51:18,182 E 22 22] logging.cc:101: Unhandled exception: N3c105ErrorE. what(): CUDA error: an illegal memory access was encountered
<br class="Apple-interchange-newline">
Exmaple: https://buildkite.com/vllm/ci/builds/7382#018f793d-1527-4e1c-ab59-c3a34ec55241

This reverts commit 1356df5.

FILL IN THE PR DESCRIPTION HERE

FIX #xxxx (link existing issues this PR will resolve)

2024-05-15 11:52:45 +09:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

allclose_default.py

[ROCm] Fix some kernels failed unit tests (#2498)

2024-02-05 14:25:36 -08:00

conftest.py

[Kernel] Use flashinfer for decoding (#4353)

2024-05-03 15:51:27 -07:00

test_activation.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_attention.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_cache.py

[Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (#4535)

2024-05-09 18:04:17 -06:00

test_layernorm.py

[Kernel] Layernorm performance optimization (#3662)

2024-03-30 14:26:38 -07:00

test_moe.py

[Kernel] Support MoE Fp8 Checkpoints for Mixtral (Static Weights with Dynamic/Static Activations) (#4527)

2024-05-04 11:45:16 -07:00

test_pos_encoding.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_prefix_prefill.py

[Bugfix][Kernel] allow non-power-of-2 for prefix prefill with alibi (#4573)

2024-05-08 09:19:58 -07:00

test_rand.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

test_sampler.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00