3 Commits

Author	SHA1	Message	Date
Nick Hill	39178c7fbc	[Tests] Disable retries and use context manager for openai client (#7565)	2024-08-26 21:33:17 -07:00
Pooya Davoodi	8da48e4d95	[Frontend] Publish Prometheus metrics in run_batch API (#7641)	2024-08-23 23:04:22 -07:00
Robert Shaw	e3b318216d	[ Bugfix ] Fix Prometheus Metrics With zeromq Frontend (#7279) ... Co-authored-by: Nick Hill <nickhill@us.ibm.com>	2024-08-18 20:19:48 +00:00