Woosuk Kwon 3e9f991d6a

Use FlashAttention for multi_query_kv_attention (#4)

2023-03-01 21:13:08 -08:00

..

__init__.py

Add input metadata

2023-02-22 19:01:20 +00:00

attention.py

Use FlashAttention for multi_query_kv_attention (#4)

2023-03-01 21:13:08 -08:00

input_metadata.py

Fix attention

2023-02-23 23:02:25 +00:00

model_utils.py

Fix a bug in tying OPT embeddings (#1)

2023-02-24 16:29:36 -08:00

opt.py

Fix a bug in tying OPT embeddings (#1)

2023-02-24 16:29:36 -08:00

sample.py

Fix sampler

2023-02-23 20:30:12 +00:00