5 Commits

Author	SHA1	Message	Date
Ronen Schaffer	5e401bce17	[CI]Add regression tests to ensure the async engine generates metrics (#4524)	2024-05-01 19:57:12 -07:00
Zhuohan Li	2f8844ba08	Re-enable the 80 char line width limit (#3305)	2024-03-10 19:49:14 -07:00
Harry Mellor	ef978fe411	Port metrics from aioprometheus to prometheus_client (#2730)	2024-02-25 11:54:00 -08:00
Ronen Schaffer	4caf7044e0	Include tokens from prompt phase in counter_generation_tokens (#2802)	2024-02-22 14:00:12 -08:00
Ronen Schaffer	e433c115bc	Fix vllm:prompt_tokens_total metric calculation (#2869)	2024-02-18 23:55:41 -08:00