9 Commits

Author	SHA1	Message	Date
Cyrus Leung	739b61a348	[Frontend] Refactor prompt processing (#4028) ... Co-authored-by: Roger Wang <ywang@roblox.com>	2024-07-22 10:13:53 -07:00
zifeitong	ff9ddbceee	[Misc] Remove #4789 workaround left in vllm/entrypoints/openai/run_batch.py (#5756)	2024-06-22 03:33:12 +00:00
Michael Goin	8065a7e220	[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718)	2024-06-20 17:00:13 -06:00
zifeitong	26e1188e51	[Fix] Use utf-8 encoding in entrypoints/openai/run_batch.py (#5606)	2024-06-17 23:16:10 +00:00
zifeitong	3ce2c050dd	[Fix] Correct OpenAI batch response format (#5554)	2024-06-15 16:57:54 -07:00
Cyrus Leung	0e9164b40a	[mypy] Enable type checking for test directory (#5017)	2024-06-15 04:45:31 +00:00
Cyrus Leung	03dccc886e	[Misc] Add vLLM version getter to utils (#5098)	2024-06-13 11:21:39 -07:00
Alex Wu	5e0391c040	[Frontend] Separate OpenAI Batch Runner usage from API Server (#4851)	2024-05-17 00:42:41 +09:00
Alex Wu	52f8107cf2	[Frontend] Support OpenAI batch file format (#4794) ... Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>	2024-05-15 19:13:36 -04:00