4 Commits

Author	SHA1	Message	Date
Nick Hill	39178c7fbc	[Tests] Disable retries and use context manager for openai client (#7565)	2024-08-26 21:33:17 -07:00
Nick Hill	e2fbaee725	[BugFix][Frontend] Use LoRA tokenizer in OpenAI APIs (#6227) ... Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>	2024-07-18 15:13:30 +08:00
Cyrus Leung	5bf35a91e4	[Doc][CI/Build] Update docs and tests to use vllm serve (#6431)	2024-07-17 07:43:21 +00:00
sasha0552	7a3d2a5b95	[Frontend] Support for chat completions input in the tokenize endpoint (#5923)	2024-07-16 20:18:09 +08:00