220 Commits

Author	SHA1	Message	Date
Dylan Hawk	e0ade06d63	Support logit bias for OpenAI API (#3027)	2024-02-27 11:51:53 +08:00
Jared Moore	70f3e8e3a1	Add LogProbs for Chat Completions in OpenAI (#2918)	2024-02-26 10:39:34 +08:00
Mustafa Eyceoz	5574081c49	Added early stopping to completion APIs (#2939)	2024-02-21 18:24:01 -08:00
Nick Hill	7d2dcce175	Support per-request seed (#2514)	2024-02-21 11:47:00 -08:00
Federico Galatolo	f1f6cc10c7	Added include_stop_str_in_output and length_penalty parameters to OpenAI API (#2562)	2024-01-24 10:21:56 -08:00
Jannis Schönleber	71d63ed72e	migrate pydantic from v1 to v2 (#2531)	2024-01-21 16:05:56 -08:00
Simon Mo	dd7e8f5f64	refactor complemention api for readability (#2499)	2024-01-18 16:45:14 -08:00
Roy	60dc62dc9e	add custom server params (#1868)	2023-12-03 12:59:18 -08:00
Adam Brusselback	66785cc05c	Support chat template and echo for chat API (#1756)	2023-11-30 16:43:13 -08:00
Yunmo Chen	665cbcec4b	Added echo function to OpenAI API server. (#1504)	2023-11-26 21:29:17 -08:00
Iskren Ivov Chernev	686f5e3210	Return usage for openai streaming requests (#1663)	2023-11-16 15:28:36 -08:00
Dan Lord	7013a80170	Add support for spaces_between_special_tokens	2023-10-30 16:52:56 -07:00
Dan Lord	20f7cc4cde	Add skip_special_tokens sampling params (#1186)	2023-09-27 19:21:42 -07:00
Wen Sun	bbbf86565f	Align max_tokens behavior with openai (#852)	2023-09-23 18:10:13 -07:00
Ricardo Lu	f98b745a81	feat: support stop_token_ids parameter. (#1097)	2023-09-21 15:34:02 -07:00
WanMok	e06f504a76	Supports tokens and arrays of tokens as inputs to the OpenAI completion API (#715)	2023-08-11 12:14:34 -07:00
Zhuohan Li	d6fa1be3a8	[Quality] Add code formatter and linter (#326)	2023-07-03 11:31:55 -07:00
Michele Catalano	0bd2a573a5	Allow send list of str for the Prompt on openai demo endpoint /v1/completions (#323) ... * allow str or List[str] for prompt * Update vllm/entrypoints/openai/api_server.py Co-authored-by: Zhuohan Li <zhuohan123@gmail.com> --------- Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>	2023-07-03 09:17:50 -07:00
Ricardo Lu	49b26e2cec	feat: add ChatCompletion endpoint in OpenAI demo server. (#330)	2023-07-02 22:54:33 -07:00
Woosuk Kwon	0b98ba15c7	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00