Isotr0py f9ecbb18bf

[Misc] Allow passing logits_soft_cap for xformers backend (#11252) ...

Signed-off-by: Isotr0py <2037008807@qq.com>

2024-12-17 00:37:04 -08:00

..

backends

[Misc] Allow passing logits_soft_cap for xformers backend (#11252)

2024-12-17 00:37:04 -08:00

ops

[Bugfix] Fix chunked prefill with model dtype float32 on Turing Devices (#9850)

2024-11-25 12:23:32 -05:00

__init__.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

layer.py

[Model] Consolidate ViTs attention implementation without mask (#10893)

2024-12-04 18:11:08 +00:00

selector.py

[Platform][Refactor] Extract func get_default_attn_backend to Platform (#10358)

2024-11-19 11:22:26 +08:00