Cody Yu ce532ff45c

[Speculative decoding] Improve n-gram efficiency (#4724)

2024-05-13 15:00:13 -07:00

..

e2e

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

__init__.py

…

test_batch_expansion.py

…

test_dynamic_spec_decode.py

[Dynamic Spec Decoding] Auto-disable by the running queue size (#4592)

2024-05-08 21:44:00 +00:00

test_metrics.py

…

test_multi_step_worker.py

[Misc][Refactor] Introduce ExecuteModelData (#4540)

2024-05-03 17:47:07 -07:00

test_ngram_worker.py

[Speculative decoding] Improve n-gram efficiency (#4724)

2024-05-13 15:00:13 -07:00

test_spec_decode_worker.py

[Misc][Refactor] Introduce ExecuteModelData (#4540)

2024-05-03 17:47:07 -07:00

test_utils.py

…

utils.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00