Chen Zhang 69d765f5a5

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960) ...

Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2025-01-17 07:39:35 +00:00

..

backends

[Misc] Add multipstep chunked-prefill support for FlashInfer (#10467)

2025-01-15 12:47:49 +08:00

ops

[Bugfix] Fix chunked prefill with model dtype float32 on Turing Devices (#9850)

2024-11-25 12:23:32 -05:00

__init__.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

layer.py

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960)

2025-01-17 07:39:35 +00:00

selector.py

[Platform] Do not raise error if _Backend is not found (#12023)

2025-01-15 10:14:15 +00:00