4 Commits

Author	SHA1	Message	Date
Nicolò Lucchesi	6116ca8cd7	[Feature] [Spec decode]: Enable MLPSpeculator/Medusa and prompt_logprobs with ChunkedPrefill (#10132) ... Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: wallashss <wallashss@ibm.com> Co-authored-by: wallashss <wallashss@ibm.com>	2025-01-27 13:38:35 -08:00
Nicolò Lucchesi	9d43afcc53	[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291) ... Signed-off-by: NickLucche <nlucches@redhat.com>	2024-11-07 08:15:14 -08:00
Lily Liu	89feb4c84d	[SpecDec] Remove Batch Expansion (2/3) (#9298)	2024-10-12 05:13:37 +00:00
Lily Liu	1570203864	[Spec Decode] (1/2) Remove batch expansion (#8839)	2024-10-01 16:04:42 -07:00