Zhuohan Li 96853af5a8

Optimize MQA Kernel (#452)

2023-07-14 20:06:40 -04:00

..

core

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

engine

Fix handling of special tokens in decoding. (#418)

2023-07-12 11:14:56 -04:00

entrypoints

Sort the outputs before return (#402)

2023-07-08 14:48:18 -07:00

model_executor

Optimize MQA Kernel (#452)

2023-07-14 20:06:40 -04:00

transformers_utils

Fix handling of special tokens in decoding. (#418)

2023-07-12 11:14:56 -04:00

worker

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

__init__.py

Bump up the version (#300)

2023-07-04 21:41:53 -07:00

block.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

config.py

Optimize MQA Kernel (#452)

2023-07-14 20:06:40 -04:00

logger.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

outputs.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

sampling_params.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

sequence.py

avoid python list copy in sequence initialization (#401)

2023-07-08 12:42:08 -07:00

utils.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00