5 Commits

Author	SHA1	Message	Date
Zhuohan Li	eedb46bf03	Rename servers and change port numbers to reduce confusion (#149)	2023-06-17 00:13:02 +08:00
Woosuk Kwon	376725ce74	[PyPI] Packaging for PyPI distribution (#140)	2023-06-05 20:03:14 -07:00
Woosuk Kwon	211318d44a	Add throughput benchmarking script (#133)	2023-05-28 03:20:05 -07:00
Woosuk Kwon	655a5e48df	Introduce LLM class for offline inference (#115)	2023-05-21 17:04:18 -07:00
Woosuk Kwon	c3442c1f6f	Refactor system architecture (#109)	2023-05-20 13:06:59 -07:00