Peng Guanwen f710fb5265

[Core] Use flashinfer sampling kernel when available (#7137) ...

Co-authored-by: Michael Goin <michael@neuralmagic.com>

2024-08-19 03:24:03 +00:00

..

__init__.py

…

test_beam_search.py

…

test_ignore_eos.py

…

test_logits_processor.py

…

test_logprobs.py

[Core] Reduce unnecessary compute when logprobs=None (#6532)

2024-07-29 16:47:31 +00:00

test_ranks.py

…

test_rejection_sampler.py

[SpecDecode] [Minor] Fix spec decode sampler tests (#7183)

2024-08-06 10:40:32 -07:00

test_sampler.py

[Core] Use flashinfer sampling kernel when available (#7137)

2024-08-19 03:24:03 +00:00

test_seeded_generate.py

…

test_typical_acceptance_sampler.py

[SpecDecode] [Minor] Fix spec decode sampler tests (#7183)

2024-08-06 10:40:32 -07:00