Isotr0py a21cd9ed23

[Bugfix] Fix incorrect image_grid_thw rank for HunyuanOCR from missing merge_by_field_config=True (#29950) ...

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2025-12-03 10:05:10 +00:00

..

basic

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

disaggregated-prefill-v1

…

kv_load_failure_recovery

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

logits_processor

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

openai_batch

[Doc] ruff format remaining Python examples (#26795)

2025-10-15 01:25:49 -07:00

qwen2_5_omni

[[V0 deprecation]]Remove VLLM_USE_V1 env (#28204)

2025-11-11 18:22:16 -07:00

qwen3_omni

[Multimodal][Qwen3 Omni] Make Qwen3 Omni work with audio-in-video inputs in V1 engine. (#27721)

2025-11-24 19:24:37 +00:00

async_llm_streaming.py

…

audio_language.py

Add TP CLI argument to multimodal inference examples (#29301)

2025-11-25 06:03:20 +00:00

automatic_prefix_caching.py

…

batch_llm_inference.py

…

chat_with_tools.py

…

context_extension.py

Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542)

2025-11-19 09:06:36 -08:00

data_parallel.py

[Chore] Separate out vllm.utils.network_utils (#27164)

2025-10-19 03:06:32 -07:00

disaggregated_prefill.py

…

encoder_decoder_multimodal.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

llm_engine_example.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

llm_engine_reset_kv.py

[Core] Support reseting all running requests' KV while calling reset_prefix_cache (#28827)

2025-12-02 02:25:05 +00:00

load_sharded_state.py

[Misc] fix typo and add detailed log (#28178)

2025-11-09 05:33:46 +00:00

lora_with_quantization_inference.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

metrics.py

…

mistral-small.py

…

mlpspeculator.py

[[V0 deprecation]]Remove VLLM_USE_V1 env (#28204)

2025-11-11 18:22:16 -07:00

multilora_inference.py

[LoRA] Cleanup LoRA unused code (#29611)

2025-11-28 22:52:58 -08:00

prefix_caching.py

…

prompt_embed_inference.py

…

qwen_1m.py

…

reproducibility.py

[Doc] Update more docs with respect to V1 (#29188)

2025-11-23 10:58:48 +08:00

rlhf_colocate.py

…

rlhf_online_quant.py

Move online quantization to model.load_weights (#26327)

2025-11-18 16:52:41 -08:00

rlhf_utils.py

[V0 deprecation] Remove more V0 references (#29088)

2025-11-21 11:56:59 +00:00

rlhf.py

Move online quantization to model.load_weights (#26327)

2025-11-18 16:52:41 -08:00

save_sharded_state.py

[V0 deprecation] Remove more V0 references (#29088)

2025-11-21 11:56:59 +00:00

simple_profiling.py

…

skip_loading_weights_in_engine_init.py

…

spec_decode.py

Attempt to fix GPU OOM in a spec-decoding test (#29419)

2025-11-25 14:23:36 -05:00

structured_outputs.py

…

torchrun_dp_example.py

[CI/Build] Test torchrun with 8 cards (#27548)

2025-10-29 10:26:06 -07:00

torchrun_example.py

…

vision_language_multi_image.py

[Bugfix] Fix incorrect image_grid_thw rank for HunyuanOCR from missing merge_by_field_config=True (#29950)

2025-12-03 10:05:10 +00:00

vision_language.py

Fix some more Transformers nightly tests (#29872)

2025-12-02 21:49:44 +00:00