10 Commits

Author	SHA1	Message	Date
Zhuohan Li	9d9072a069	Implement prompt logprobs & Batched topk for computing logprobs (#1328) ... Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>	2023-10-16 10:56:50 -07:00
Woosuk Kwon	84e4e37d14	[Minor] Fix type annotations (#1238)	2023-10-02 15:28:31 -07:00
Dan Lord	20f7cc4cde	Add skip_special_tokens sampling params (#1186)	2023-09-27 19:21:42 -07:00
Zhuohan Li	947b794146	[Sampler] Vectorized sampling (simplified) (#1048) ... Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>	2023-09-22 17:48:04 -07:00
Ricardo Lu	f98b745a81	feat: support stop_token_ids parameter. (#1097)	2023-09-21 15:34:02 -07:00
Zhuohan Li	002800f081	Align vLLM's beam search implementation with HF generate (#857)	2023-09-04 17:29:42 -07:00
wangcx18	0c04ce3234	Fix typo in sampling_params.py (#788)	2023-08-18 10:12:46 +09:00
Zhuohan Li	d6fa1be3a8	[Quality] Add code formatter and linter (#326)	2023-07-03 11:31:55 -07:00
Lily Liu	425040d4c1	remove floats == 0 comparison (#285)	2023-06-28 14:11:51 -07:00
Woosuk Kwon	0b98ba15c7	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00