Victor Ziliang Peng f1599ca55d

feat(metrics): Add prefill KV compute metric excluding cached tokens (#30189) ...

Signed-off-by: Ziliang Peng <ziliang@character.ai>

2025-12-09 00:08:48 +00:00

..

attention

[Perf] Improve fp8 quant in mla; replace ReduceSum with ReduceScatterSum (#29795)

2025-12-08 15:02:34 -08:00

core

[Misc][Core] Remove unused req_index increment in scheduler (#30176)

2025-12-07 08:39:21 +00:00

engine

feat(metrics): Add prefill KV compute metric excluding cached tokens (#30189)

2025-12-09 00:08:48 +00:00

executor

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

kv_offload

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

metrics

feat(metrics): Add prefill KV compute metric excluding cached tokens (#30189)

2025-12-09 00:08:48 +00:00

pool

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

sample

[Perf] Avoid pageable HtoD transfer in MinTokensLogitsProcessor (#29826)

2025-12-02 21:25:52 +00:00

spec_decode

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

structured_output

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

worker

[v1] Add PrefixLM support to FlexAttention backend (#27938)

2025-12-07 15:51:36 +00:00

__init__.py

…

cudagraph_dispatcher.py

[Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579)

2025-11-26 14:07:13 -05:00

kv_cache_interface.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

outputs.py

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

request.py

[Bugfix] fix --scheduling-policy=priority & n>1 crashes engine (#29764)

2025-12-02 22:42:28 +00:00

serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00