Nathan Hoos d6902ce79f

[V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) ...

Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>

2025-07-10 15:30:26 -04:00

..

attention

[Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218)

2025-07-09 12:53:55 -07:00

core

[Misc] Simplify the prefix caching logic on draft tokens (#20701)

2025-07-09 14:48:35 -07:00

engine

[V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975)

2025-07-10 15:30:26 -04:00

executor

[KVConnector] Aggregate finished requests on the scheduler (#19555)

2025-07-10 09:22:18 +01:00

metrics

Export NaNs in logits to scheduler_stats if output is corrupted (#18777)

2025-06-20 22:47:16 +08:00

pool

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

sample

[v1] Re-add fp32 support to v1 engine through FlexAttention (#19754)

2025-07-05 09:41:10 +00:00

spec_decode

[V1] Support any head size for FlexAttention backend (#20467)

2025-07-06 09:54:36 -07:00

structured_output

[V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975)

2025-07-10 15:30:26 -04:00

worker

[KVConnector] Aggregate finished requests on the scheduler (#19555)

2025-07-10 09:22:18 +01:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

kv_cache_interface.py

Enable V1 for Hybrid SSM/Attention Models (#20016)

2025-07-04 17:46:53 +00:00

outputs.py

Export NaNs in logits to scheduler_stats if output is corrupted (#18777)

2025-06-20 22:47:16 +08:00

request.py

[Core] feat: Implement Priority Scheduling in V1 Engine (#19057)

2025-06-22 20:18:08 -07:00

serial_utils.py

[Core] Do not copy array during hashing (#19484)

2025-06-18 15:36:55 -07:00

utils.py

[DP] Support external DP Load Balancer mode (#19790)

2025-07-02 10:21:52 -07:00