Cyrus Leung 640052b069

[Bugfix][Frontend] Cleanup "fix chat logprobs" (#5026)

2024-06-10 22:36:46 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend][Misc] Enforce Pixel Values as Input Type for VLMs in API Server (#5374)

2024-06-10 09:13:39 +00:00

cli_args.py

[Bugfix] Fix inappropriate content of model_name tag in Prometheus metrics (#3937)

2024-05-04 15:39:34 -07:00

protocol.py

[Bugfix][Frontend] Cleanup "fix chat logprobs" (#5026)

2024-06-10 22:36:46 -07:00

run_batch.py

[Frontend] Separate OpenAI Batch Runner usage from API Server (#4851)

2024-05-17 00:42:41 +09:00

serving_chat.py

[Bugfix][Frontend] Cleanup "fix chat logprobs" (#5026)

2024-06-10 22:36:46 -07:00

serving_completion.py

[Bugfix][Frontend] Cleanup "fix chat logprobs" (#5026)

2024-06-10 22:36:46 -07:00

serving_embedding.py

[Core] Consolidate prompt arguments to LLM engines (#4328)

2024-05-28 13:29:31 -07:00

serving_engine.py

[Frontend] OpenAI API server: Add add_special_tokens to ChatCompletionRequest (default False) (#5278)

2024-06-05 09:32:58 -07:00