Cody Yu 309aaef825

[Bugfix] Fix decode tokens w. CUDA graph (#6757)

2024-07-24 22:33:56 -07:00

..

__init__.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

test_model_input.py

[Core] Refactor _prepare_model_input_tensors - take 2 (#6164)

2024-07-17 09:37:16 -07:00

test_model_runner.py

[Bugfix] Fix decode tokens w. CUDA graph (#6757)

2024-07-24 22:33:56 -07:00

test_swap.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00