Or Ozeri 647464719b

[KVConnector][Core] Support cross-layer KV blocks (#27743) ...

Signed-off-by: Or Ozeri <oro@il.ibm.com>

2025-11-20 19:09:59 +01:00

..

attention

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

core

[Redo] #26368 (#28771)

2025-11-14 22:47:41 -08:00

cudagraph

…

determinism

[Bug] Fix torch dynamo warning Dynamo detected a call to a functools.lru_cache (#29038)

2025-11-20 16:52:23 +08:00

distributed

[Test] Add non-MoE DP test coverage (#28235)

2025-11-06 20:59:57 +00:00

e2e

[CI] Fix async scheduling + spec decoding test flake (#28902)

2025-11-18 05:26:32 +00:00

ec_connector

[Doc]: fix typos in various files (#29010)

2025-11-19 04:56:21 -08:00

engine

[Chore] Rename SchedulerConfig.chunked_prefill_enabled (#28735)

2025-11-14 18:39:57 +00:00

entrypoints

[chore] Move the rest of wikimedia url to S3 (#28921)

2025-11-18 09:44:18 -08:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[KVConnector][Core] Support cross-layer KV blocks (#27743)

2025-11-20 19:09:59 +01:00

kv_offload

[KVConnector][Core] Support cross-layer KV blocks (#27743)

2025-11-20 19:09:59 +01:00

logits_processors

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

sample

[Config] Clean up SchedulerConfig initialization (#28665)

2025-11-14 22:41:02 +08:00

shutdown

…

spec_decode

Add support for Eagle with separate lm-head and embed_tokens layers (#28549)

2025-11-15 06:12:02 -08:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

tpu

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

tracing

…

worker

[KVConnector][Core] Support cross-layer KV blocks (#27743)

2025-11-20 19:09:59 +01:00

__init__.py

…

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214)

2025-11-09 19:11:46 +00:00

test_request.py

…

test_serial_utils.py

…

utils.py

…