SangBin Cho e7c46b9527

[Scheduler] Warning upon preemption and Swapping (#4647) ...

Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

2024-05-13 23:50:44 +09:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_basic_correctness.py

[Core] Fix circular reference which leaked llm instance in local dev env (#4737)

2024-05-10 23:54:32 +09:00

test_chunked_prefill.py

[Bug fix][Core] assert num_new_tokens == 1 fails when SamplingParams.n is not 1 and max_tokens is large & Add tests for preemption (#4451)

2024-05-01 19:24:13 -07:00

test_preemption.py

[Scheduler] Warning upon preemption and Swapping (#4647)

2024-05-13 23:50:44 +09:00