Zhuohan Li 947b794146

[Sampler] Vectorized sampling (simplified) (#1048) ...

Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

2023-09-22 17:48:04 -07:00

..

core

Fix hanging when prompt exceeds limit (#1029)

2023-09-17 01:48:56 -07:00

engine

feat: support stop_token_ids parameter. (#1097)

2023-09-21 15:34:02 -07:00

entrypoints

feat: support stop_token_ids parameter. (#1097)

2023-09-21 15:34:02 -07:00

model_executor

[Sampler] Vectorized sampling (simplified) (#1048)

2023-09-22 17:48:04 -07:00

transformers_utils

Fix warning message on LLaMA FastTokenizer (#1037)

2023-09-14 17:33:32 -07:00

worker

Replace DtypeTensor (#1123)

2023-09-21 00:51:47 -07:00

__init__.py

Bump up the version to v0.1.7 (#1013)

2023-09-11 00:54:30 -07:00

block.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

config.py

rope_theta and max_position_embeddings from config (#1096)

2023-09-20 13:35:11 -07:00

logger.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

outputs.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

sampling_params.py

[Sampler] Vectorized sampling (simplified) (#1048)

2023-09-22 17:48:04 -07:00

sequence.py

Fix get_max_num_running_seqs for waiting and swapped seq groups (#1068)

2023-09-18 11:49:40 -07:00

utils.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00