Cyrus Leung 5ae5ed1e60

[Core] Consolidate prompt arguments to LLM engines (#4328) ...

Co-authored-by: Roger Wang <ywang@roblox.com>

2024-05-28 13:29:31 -07:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

api_server_async_engine.py

Migrate linter from pylint to ruff (#1665)

2023-11-20 11:58:01 -08:00

test_api_server.py

[Core] Fix engine-use-ray broken (#4105)

2024-04-16 05:24:53 +00:00

test_async_llm_engine.py

[Core] Consolidate prompt arguments to LLM engines (#4328)

2024-05-28 13:29:31 -07:00

test_chat_template.py

[Frontend] Move async logic outside of constructor (#4674)

2024-05-08 22:48:33 -07:00

test_merge_async_iterators.py

[Bugfix] Abort requests when the connection to /v1/completions is interrupted (#4363)

2024-04-27 09:48:37 -07:00

test_openapi_server_ray.py

[Core] Consolidate prompt arguments to LLM engines (#4328)

2024-05-28 13:29:31 -07:00

test_request_tracker.py

Add health check, make async Engine more robust (#3015)

2024-03-04 22:01:40 +00:00