Woosuk Kwon 04e5acc08e

Fix a bug in 1D input shape (#5)

2023-03-06 10:05:27 -08:00

..

master

Implement single_query_cached_kv_attention kernel (#3)

2023-03-01 15:02:19 -08:00

models

Fix a bug in 1D input shape (#5)

2023-03-06 10:05:27 -08:00

worker

Implement single_query_cached_kv_attention kernel (#3)

2023-03-01 15:02:19 -08:00

block.py

Add __repr__

2023-02-14 09:34:07 +00:00

sampling_params.py

Add max_num_steps to SamplingParams

2023-02-24 11:44:40 +00:00

sequence.py

Add is_finished

2023-02-24 11:44:21 +00:00

utils.py

Fix typo

2023-02-14 01:19:27 +00:00