5 Commits

Author	SHA1	Message	Date
Zhuohan Li	eedb46bf03	Rename servers and change port numbers to reduce confusion (#149)	2023-06-17 00:13:02 +08:00
Woosuk Kwon	311490a720	Add script for benchmarking serving throughput (#145)	2023-06-14 19:55:38 -07:00
Zhuohan Li	4298374265	Add docstrings for LLMServer and related classes and examples (#142)	2023-06-07 18:25:20 +08:00
Zhuohan Li	1a956e136b	Fix various issues of async servers (#135)	2023-06-05 23:44:50 +08:00
Zhuohan Li	057daef778	OpenAI Compatible Frontend (#116)	2023-05-23 21:39:50 -07:00