5 Commits

Author	SHA1	Message	Date
Nick Hill	4fe5895361	[AsyncScheduling] Make async overlap work with logprobs (#27615) ... Signed-off-by: Nick Hill <nhill@redhat.com>	2025-10-28 22:35:54 +00:00
Huy Do	becb7de40b	Update PyTorch to 2.9.0+cu129 (#24994) ... Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>	2025-10-21 17:20:18 -04:00
Bram Wasti	b2f78cbad4	[small][batch invariance] Rename the env and internal flags to simplify usage (#26855) ... Signed-off-by: Bram Wasti <bwasti@meta.com>	2025-10-16 21:40:25 +00:00
Nick Hill	5bc26c438d	[BugFix] Make penalties and bad_words work with async scheduling (#26467) ... Signed-off-by: Nick Hill <nhill@redhat.com>	2025-10-10 23:27:04 +00:00
Nick Hill	949cb0170d	[BugFix] Fix async scheduling + request preemption (#26385) ... Signed-off-by: Nick Hill <nhill@redhat.com>	2025-10-10 20:29:57 +00:00