Charlie Fu a44b1c951d

[Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) ...

Signed-off-by: charlifu <charlifu@amd.com>

2025-06-17 17:03:06 -04:00

..

attention

[Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158)

2025-06-17 17:03:06 -04:00

core

[V1][Metrics] Deprecate metrics with gpu_ prefix for non GPU specific metrics. (#18354)

2025-06-14 11:07:36 +08:00

engine

[Mis] remove duplicate engine status checks (#19647)

2025-06-17 08:17:38 -07:00

executor

[Multi Modal] Add an env var for message queue max chunk bytes (#19242)

2025-06-08 21:39:12 +08:00

metrics

[V1][Metrics] Deprecate metrics with gpu_ prefix for non GPU specific metrics. (#18354)

2025-06-14 11:07:36 +08:00

sample

improve logits bias (#19041)

2025-06-06 19:59:25 +08:00

spec_decode

[CUDA] Enable full cudagraph for FlashMLA (#18581)

2025-06-13 18:12:26 +00:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

worker

[V1] Change return type on get_multimodal_embeddings() (#19446)

2025-06-16 13:32:15 -04:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

kv_cache_interface.py

[v1] Hybrid Memory Allocator (#17996)

2025-06-05 20:47:09 -07:00

outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

request.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[Bugfix]: Fix TypeError: 'float' object cannot be interpreted as an integer (#19283)

2025-06-08 08:16:31 +08:00