Sage Moore 2e3484c237 debugging ...

Signed-off-by: Sage Moore <sage@neuralmagic.com>

2025-06-03 19:25:01 +00:00

..

attention

Merge branch 'main' of https://github.com/neuralmagic/vllm into lwilkinson/attn-slicing

2025-06-03 00:52:39 +00:00

core

[Misc] Fix estimated max model len msg (#18966)

2025-05-31 16:43:44 +08:00

engine

[BugFix] Fix multi-node offline data-parallel (#18981)

2025-05-31 08:34:52 -07:00

executor

[BugFix] Increase TP execute_model timeout (#18558)

2025-05-23 10:22:11 +08:00

metrics

[BugFix] Fix incorrect metrics shutdown error log message (#18992)

2025-06-01 11:42:23 +08:00

sample

[V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)

2025-05-26 11:49:36 -04:00

spec_decode

[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (2) (#18781)

2025-05-28 05:09:14 +00:00

structured_output

[Bugfix]: Fix the incompatibility issue with Structured Outputs when Thinking is disabled (#18879)

2025-05-31 09:20:54 +00:00

worker

debugging

2025-06-03 19:25:01 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

kv_cache_interface.py

[v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593)

2025-05-23 09:39:47 -07:00

outputs.py

[P/D] NIXL Integration (#17751)

2025-05-12 09:46:16 -07:00

request.py

[Perf] API-server scaleout with many-to-many server-engine comms (#17546)

2025-05-30 08:17:00 -07:00

serial_utils.py

[Bugfix] Ensure tensors are contiguous during serialisation (#18860)

2025-05-29 03:05:20 -07:00

utils.py

[Perf] API-server scaleout with many-to-many server-engine comms (#17546)

2025-05-30 08:17:00 -07:00