6 Commits

Author	SHA1	Message	Date
Varun Sundar Rabindranath	c2ec430ab5	[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) ... Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>	2024-09-27 13:32:07 -07:00
Alexander Matveev	6d646d08a2	[Core] Optimize Async + Multi-step (#8050)	2024-09-03 18:50:29 +00:00
afeldman-nm	428dd1445e	[Core] Logprobs support in Multi-step (#7652)	2024-08-29 19:19:08 -07:00
Alexander Matveev	3f60f2244e	[Core] Combine async postprocessor and multi-step (#7921)	2024-08-29 11:18:26 -07:00
Abhinav Goyal	a3fce56b88	[Speculative Decoding] EAGLE Implementation with Top-1 proposer (#6830)	2024-08-22 02:42:24 -07:00
William Lin	47b65a5508	[core] Multi Step Scheduling (#7000) ... Co-authored-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>	2024-08-19 13:52:13 -07:00