5 Commits

Author	SHA1	Message	Date
Philipp Schmid	345be0e244	[benchmark] Update TGI version (#7917)	2024-08-27 15:07:53 -07:00
Kuntai Du	c3af44722c	[Doc]Add documentation to benchmarking script when running TGI (#4920)	2024-05-20 20:16:57 +00:00
Roger Wang	a4211a4dc3	Serving Benchmark Refactoring (#2433)	2024-02-12 22:53:00 -08:00
Zhuohan Li	43710e8d09	[Fix] Fix default port number in benchmark scripts (#265)	2023-06-26 13:15:35 -07:00
Woosuk Kwon	311490a720	Add script for benchmarking serving throughput (#145)	2023-06-14 19:55:38 -07:00