Lucas Wilkinson 0f9e7354f5

[BugFix] Fix full-cuda-graph illegal memory access in FA3 (#20057) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

2025-06-25 08:39:04 +00:00

..

attention

[BugFix] Fix full-cuda-graph illegal memory access in FA3 (#20057)

2025-06-25 08:39:04 +00:00

core

[Core] feat: Implement Priority Scheduling in V1 Engine (#19057)

2025-06-22 20:18:08 -07:00

engine

[BugFix] Fix multi-node offline data parallel (#19937)

2025-06-24 12:45:20 -07:00

executor

[Misc] Configurable timeout for execute_model RPC calls via env var (#19544)

2025-06-22 20:36:26 -07:00

metrics

Export NaNs in logits to scheduler_stats if output is corrupted (#18777)

2025-06-20 22:47:16 +08:00

pool

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

sample

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

spec_decode

[CUDA] Enable full cudagraph for FlashMLA (#18581)

2025-06-13 18:12:26 +00:00

structured_output

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

worker

[Bugfix][CPU] Fix InputBatch for pooling models in the CPU v1 (#20014)

2025-06-24 13:20:04 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

kv_cache_interface.py

[v1] Support mamba2 (#19327)

2025-06-18 20:34:15 +00:00

outputs.py

Export NaNs in logits to scheduler_stats if output is corrupted (#18777)

2025-06-20 22:47:16 +08:00

request.py

[Core] feat: Implement Priority Scheduling in V1 Engine (#19057)

2025-06-22 20:18:08 -07:00

serial_utils.py

[Core] Do not copy array during hashing (#19484)

2025-06-18 15:36:55 -07:00

utils.py

[Bugfix]: Fix TypeError: 'float' object cannot be interpreted as an integer (#19283)

2025-06-08 08:16:31 +08:00