Woosuk Kwon e86717833d

Incrementally decode output tokens (#121)

2023-05-23 20:46:32 -07:00

..

core

Incrementally decode output tokens (#121)

2023-05-23 20:46:32 -07:00

entrypoints

Fix latency benchmark script (#118)

2023-05-22 17:03:40 -07:00

model_executor

Add contributing guideline and mypy config (#122)

2023-05-23 17:58:51 -07:00

server

Incrementally decode output tokens (#121)

2023-05-23 20:46:32 -07:00

worker

Add contributing guideline and mypy config (#122)

2023-05-23 17:58:51 -07:00

__init__.py

Introduce LLM class for offline inference (#115)

2023-05-21 17:04:18 -07:00

block.py

Add docstrings to some modules and classes (#100)

2023-05-14 22:32:38 -07:00

config.py

Print warnings/errors for large swap space (#123)

2023-05-23 18:22:26 -07:00

logger.py

Add a system logger (#85)

2023-05-08 23:03:35 -07:00

outputs.py

Add contributing guideline and mypy config (#122)

2023-05-23 17:58:51 -07:00

sampling_params.py

Implement stop strings and best_of (#114)

2023-05-21 11:18:00 -07:00

sequence.py

Incrementally decode output tokens (#121)

2023-05-23 20:46:32 -07:00

utils.py

Print warnings/errors for large swap space (#123)

2023-05-23 18:22:26 -07:00