Nick Hill 0cdbe7b744

[Core] Async scheduling + structured outputs compatibility (#26866) ...

Signed-off-by: Nick Hill <nhill@redhat.com>

2025-11-01 00:35:04 +00:00

..

attention

Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663)

2025-10-31 11:12:19 -07:00

core

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

engine

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

executor

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

kv_offload

[KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770)

2025-10-30 22:10:29 +08:00

metrics

[Fix] Skip record_sleep_state logic in PrometheusStatsLogger if not in dev mode (#27789)

2025-10-30 19:26:27 +00:00

pool

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

sample

[Log] Optimize Startup Log (#26740)

2025-10-24 19:27:04 -04:00

spec_decode

[MISC] cudagraph_capture_sizes related improvements (#26016)

2025-10-24 05:11:05 -07:00

structured_output

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

worker

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

__init__.py

…

cudagraph_dispatcher.py

[LoRA] LoRA cuda graph specialization (#25914)

2025-10-20 04:21:09 +00:00

kv_cache_interface.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

outputs.py

[AsyncScheduling] Make async overlap work with logprobs (#27615)

2025-10-28 22:35:54 +00:00

request.py

[Core] Streamline some structured output related code (#26737)

2025-10-14 23:27:44 +00:00

serial_utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00

utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00