wang.yuqi 6e36f4fa6c

improve chunked prefill performance ...

[Bugfix] Fix #7592 vllm 0.5.4 enable_chunked_prefill throughput is slightly lower than 0.5.3~0.5.0. (#7874)

2024-09-02 14:20:12 -07:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_basic_correctness.py

[core][distributed] simplify code to support pipeline parallel (#6406)

2024-07-14 21:20:51 -07:00

test_chunked_prefill.py

improve chunked prefill performance

2024-09-02 14:20:12 -07:00

test_cpu_offload.py

[CI] Move quantization cpu offload tests out of fastcheck (#7574)

2024-08-15 21:16:20 -07:00

test_preemption.py

[Core] Asynchronous Output Processor (#7049)

2024-08-26 20:53:20 -07:00