wuyaoxuehun d3ade61e42

[Model] fix glm4_moe_mtp load weights with GLM-4.6 checkpoint. (#27597) ...

Signed-off-by: wuao.scotty <wuao.scotty@bytedance.com>
Co-authored-by: wuao.scotty <wuao.scotty@bytedance.com>

2025-11-12 10:14:00 +00:00

..

transformers

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

__init__.py

[Chore] Remove SupportsV0Only interface and update supported models docs (#26783)

2025-10-14 04:55:10 -07:00

adapters.py

[Bugfix] Fix Qwen3-Reranker-8B load (#28117)

2025-11-05 18:33:50 +00:00

aimv2.py

…

apertus.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

arcee.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

arctic.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

aria.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

aya_vision.py

…

baichuan.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

bailing_moe.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

bamba.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

bee.py

[Model][VLM] Support Bee-8B Model (#27012)

2025-10-20 02:31:26 +00:00

bert_with_rope.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

bert.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

blip2.py

…

blip.py

…

bloom.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

chameleon.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

chatglm.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

clip.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

cohere2_vision.py

…

commandr.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

config.py

[Performance][gpt-oss] Revert gpt-oss max cudagraph size to 1024 (#28345)

2025-11-08 15:50:10 -07:00

dbrx.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

deepencoder.py

[Model] Upstream Deepseek-OCR model (#27247)

2025-10-22 07:59:15 -07:00

deepseek_eagle.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

deepseek_mtp.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

deepseek_ocr.py

[Model] Consolidate Deepseek-MoE implementation with DeepSeek-v2 (#28101)

2025-11-08 05:01:27 +00:00

deepseek_v2.py

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

deepseek_vl2.py

[Model] Consolidate Deepseek-MoE implementation with DeepSeek-v2 (#28101)

2025-11-08 05:01:27 +00:00

dots1.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

dots_ocr.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

ernie45_moe.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

ernie45_vl_moe.py

[Model][Bugfix] fix ernie45 vl run failed from shared experts optimization (#26885)

2025-10-16 03:37:35 -07:00

ernie45_vl.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

ernie45.py

[Model] Add PaddleOCR-VL Model Support (#27758)

2025-11-03 19:04:22 +08:00

ernie_mtp.py

…

exaone4.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

exaone.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

fairseq2_llama.py

…

falcon_h1.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

falcon.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

flex_olmo.py

…

fuyu.py

…

gemma2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

gemma3_mm.py

[fix] Revert "fixing mm placeholder replacement issue with gemma3" (#28285)

2025-11-07 12:09:09 +00:00

gemma3.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

gemma3n_mm.py

Remove unused imports (#26972)

2025-10-16 19:51:17 -07:00

gemma3n.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

gemma.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

glm4_1v.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

glm4_moe_mtp.py

[Model] fix glm4_moe_mtp load weights with GLM-4.6 checkpoint. (#27597)

2025-11-12 10:14:00 +00:00

glm4_moe.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

glm4.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

glm4v.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

glm.py

…

gpt2.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

gpt_bigcode.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

gpt_j.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

gpt_neox.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

gpt_oss.py

[Quantization] fix attention quantization of gpt_oss model (#27334)

2025-11-11 12:06:00 -05:00

granite_speech.py

[Model, Core] Support Granite Speech & LoRA for STT (#24455)

2025-11-05 08:33:48 +01:00

granite.py

…

granitemoe.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

granitemoehybrid.py

[BugFix]: --enable-lora with model granite-4.0-micro crash (#27733)

2025-11-12 09:03:56 +00:00

granitemoeshared.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

gritlm.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

grok1.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

h2ovl.py

…

hunyuan_v1.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

hyperclovax_vision.py

[Bugfix] Standardize merging multimodal embeddings (#26771)

2025-10-14 09:36:21 +00:00

idefics2_vision_model.py

…

idefics3.py

…

interfaces_base.py

[Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169)

2025-10-19 05:20:55 -07:00

interfaces.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

intern_vit.py

…

internlm2_ve.py

…

internlm2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

interns1_vit.py

[Bugfix] Fix interns1-vit qk norm code path (#27480)

2025-10-24 17:43:45 +00:00

interns1.py

[Bugfix] Fix HF format InternVL large variants video processing (#27330)

2025-10-22 08:39:23 -07:00

internvl.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

jais.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

jamba.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

jina_vl.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

keye_vl1_5.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

keye.py

[BugFix] Add fallback path in apply_rotary_pos_emb_flashattn for non-cuda platforms (#28447)

2025-11-12 03:13:21 +00:00

kimi_linear.py

fix incorrect type annotation in KimiMLP (#27885)

2025-10-31 17:38:02 +00:00

kimi_vl.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

lfm2_moe.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

lfm2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

lightonocr.py

[Model] Add support for LightOnOCR (#26916)

2025-10-17 05:05:24 +00:00

llama4_eagle.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

llama4.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

llama_eagle3.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

llama_eagle.py

[Bugfix][Speculative Decoding] Extend Eagle quantization config fix to llama_eagle.py (#26590)

2025-10-13 17:17:13 +00:00

llama.py

Add llama 4 scaling support (#28145)

2025-11-06 18:55:17 +00:00

llava_next_video.py

[Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169)

2025-10-19 05:20:55 -07:00

llava_next.py

…

llava_onevision.py

[Bugfix] Standardize merging multimodal embeddings (#26771)

2025-10-14 09:36:21 +00:00

llava.py

…

longcat_flash_mtp.py

…

longcat_flash.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

mamba2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

mamba.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

medusa.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

midashenglm.py

[Model] Use merge_by_field_config for MM models (M-N) (#26710)

2025-10-14 01:27:01 +08:00

mimo_mtp.py

…

mimo.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

minicpm3.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

minicpm_eagle.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

minicpm.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

minicpmo.py

[Bugfix] Standardize merging multimodal embeddings (#26771)

2025-10-14 09:36:21 +00:00

minicpmv.py

[Quantization] Automatically infer AWQ modules_to_not_convert field (#26909)

2025-10-21 01:49:28 +00:00

minimax_m2.py

Fix MiniMax-M2 rmsnorm precision and remove useless code (#27627)

2025-10-29 21:01:05 +08:00

minimax_text_01.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

minimax_vl_01.py

…

mistral3.py

…

mixtral.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

mllama4.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

mlp_speculator.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

modernbert.py

[Bugfix] Correct LayerNorm epsilon parameter in modernbert.py (#27008)

2025-10-16 12:27:44 +00:00

module_mapping.py

…

molmo.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

moonvit.py

[CI/Build] Bump transformers version (#27528)

2025-10-31 22:11:07 -07:00

mpt.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

nano_nemotron_vl.py

Nemotron Nano V2 VL + EVS Video Support (#27107)

2025-10-20 22:19:11 +08:00

nemotron_h.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

nemotron_nas.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

nemotron_vl.py

[Bugfix] Standardize merging multimodal embeddings (#26771)

2025-10-14 09:36:21 +00:00

nemotron.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

nvlm_d.py

…

olmo2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

olmo.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

olmoe.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

openpangu_mtp.py

[model] Add support for openPangu_Ultra_MoE (#27521)

2025-11-04 08:17:20 -08:00

openpangu.py

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

opt.py

…

orion.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

ouro.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

ovis2_5.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

ovis.py

[Docs] Replace rst style double-backtick with md single-backtick (#27091)

2025-10-17 02:47:34 -07:00

paddleocr_vl.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

paligemma.py

[Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309)

2025-10-22 10:05:34 -07:00

persimmon.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

phi3.py

…

phi3v.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

phi4_multimodal.py

[Model] Use merge_by_field_config for MM models (O-P) (#26776)

2025-10-14 09:42:45 +00:00

phi4mm_audio.py

…

phi4mm_utils.py

…

phi4mm.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

phi.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

phimoe.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

pixtral.py

[BugFix] Fix RuntimeError in PixtralHFAttention on CPU/XPU (#28444)

2025-11-11 15:29:33 +00:00

plamo2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

qwen2_5_omni_thinker.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

qwen2_5_vl.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

qwen2_audio.py

[Model] Use merge_by_field_config for MM models (Qwen series) (#27546)

2025-10-27 05:38:05 +00:00

qwen2_moe.py

…

qwen2_rm.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

qwen2_vl.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

qwen2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

qwen3_moe.py

[Performance] Support FP8 flashinfer TRTLLM MOE on Qwen3 and Qwen-3next (#27492)

2025-11-10 12:34:57 -05:00

qwen3_next_mtp.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

qwen3_next.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

qwen3_omni_moe_thinker.py

[Model] Pass mm_features directly into get_mrope_input_positions (#28399)

2025-11-11 21:14:48 +08:00

qwen3_vl_moe.py

[Model]Improve Qwen3VLMoeForConditionalGeneration packed_modules_mapping (#27096)

2025-10-17 04:47:00 -07:00

qwen3_vl.py

[Model][Qwen3VL] Simplify get_mrope_input_positions using numpy (#28302)

2025-11-12 02:55:10 +00:00

qwen3.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

qwen_vl.py

[Model] Use merge_by_field_config for MM models (Qwen series) (#27546)

2025-10-27 05:38:05 +00:00

qwen.py

[Misc][Model][Refactor] Pass the prefix into Linear layers (#28259)

2025-11-07 19:38:38 +08:00

radio.py

Nemotron Nano V2 VL + EVS Video Support (#27107)

2025-10-20 22:19:11 +08:00

registry.py

[Model] Consolidate Deepseek-MoE implementation with DeepSeek-v2 (#28101)

2025-11-08 05:01:27 +00:00

roberta.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

rvl.py

…

seed_oss.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

siglip2navit.py

[BugFix] Fix Siglip2Attention on XPU (#28448)

2025-11-11 18:18:02 +00:00

siglip.py

[bugfix] fix siglip batch text output error (#28365)

2025-11-10 21:21:15 +08:00

skyworkr1v.py

[Model] Use merge_by_field_config for MM models (M-N) (#26710)

2025-10-14 01:27:01 +08:00

smolvlm.py

…

solar.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

stablelm.py

…

starcoder2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

step3_text.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

step3_vl.py

…

swin.py

…

tarsier.py

…

telechat2.py

…

teleflm.py

…

terratorch.py

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973)

2025-10-23 14:46:18 +00:00

ultravox.py

…

utils.py

[V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955)

2025-11-04 20:51:16 -08:00

vision.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

voxtral.py

…

whisper.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00

zamba2.py

[LoRA][1/N]Remove LoRA extra vocab (#28382)

2025-11-11 11:06:21 -08:00