sroy745 14f91fe67c

[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. (#6485)

2024-07-20 23:58:58 -07:00

..

__init__.py

…

conftest.py

…

test_compatibility.py

…

test_integration_dist_tp2.py

…

test_integration_dist_tp4.py

…

test_integration.py

…

test_logprobs.py

…

test_medusa_correctness.py

…

test_mlp_correctness.py

…

test_multistep_correctness.py

…

test_ngram_correctness.py

…

test_seed.py

…