afeldman-nm fd95e026e0

[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942) ...

Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

2024-08-06 16:51:47 -04:00

..

__init__.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

test_encoder_decoder_model_runner.py

[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)

2024-08-06 16:51:47 -04:00

test_model_input.py

[Core] Refactor _prepare_model_input_tensors - take 2 (#6164)

2024-07-17 09:37:16 -07:00

test_model_runner.py

[Bugfix] Fix decode tokens w. CUDA graph (#6757)

2024-07-24 22:33:56 -07:00

test_swap.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00