5 Commits

Author	SHA1	Message	Date
Harry Mellor	cf069aa8aa	Update deprecated Python 3.8 typing (#13971)	2025-03-02 17:34:51 -08:00
Lily Liu	5629f26df7	[V1][Spec Decode] Change Spec Decode Rejection Sampling API (#13729)	2025-02-25 18:14:48 -08:00
Lu Fang	bb78fb318e	[v1] Support allowed_token_ids in v1 Sampler (#13210) ... Signed-off-by: Lu Fang <lufang@fb.com>	2025-02-22 14:13:05 +08:00
Nick Hill	30172b4947	[V1] Optimize handling of sampling metadata and req_ids list (#13244) ... Signed-off-by: Nick Hill <nhill@redhat.com>	2025-02-18 12:15:33 -08:00
Lily Liu	80f63a3966	[V1][Spec Decode] Ngram Spec Decode (#12193) ... Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>	2025-02-15 18:05:11 -08:00