vllm/models at c2894d3883c1b21299822c685e6be73ec3be046b - vllm

transformers

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

__init__.py

…

adapters.py

[Chore] Move tokenizer initialization methods (#29793 )

2025-12-02 13:33:37 +08:00

afmoe.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

aimv2.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842 )

2025-11-18 18:56:04 +00:00

apertus.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

arcee.py

Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542 )

2025-11-19 09:06:36 -08:00

arctic.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

aria.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

aya_vision.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

baichuan.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

bailing_moe.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

bamba.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

bee.py

…

bert_with_rope.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

bert.py

Improve enable chunked_prefill & prefix_caching logic. (#26623 )

2025-11-27 22:05:48 -08:00

blip2.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

blip.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842 )

2025-11-18 18:56:04 +00:00

bloom.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

chameleon.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

chatglm.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

clip.py

[Core] Enable inputs_embeds_size separate from hidden_size (#29741 )

2025-11-30 17:31:12 +08:00

cohere2_vision.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

commandr.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

config.py

[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978 )

2025-12-05 00:34:33 -08:00

dbrx.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

deepencoder.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842 )

2025-11-18 18:56:04 +00:00

deepseek_eagle.py

[Misc] Remove redundant attention var constants (#29650 )

2025-11-28 04:35:19 -08:00

deepseek_mtp.py

[Bugfix] Fix DeepSeek R1 MTP weight loading (#29545 )

2025-12-02 15:52:18 +00:00

deepseek_ocr.py

[Chore] Deprecate merge_by_field_config arg (#30035 )

2025-12-04 17:21:24 +00:00

deepseek_v2.py

[BUGFIX] llama_4_scaling wrongly passed to DeepseekAttention (#29908 )

2025-12-02 14:51:20 -08:00

deepseek_vl2.py

[Chore] Move tokenizer initialization methods (#29793 )

2025-12-02 13:33:37 +08:00

dots1.py

[Bugfix] fix dots.llm1.inst (#29687 )

2025-11-28 15:25:26 -08:00

dots_ocr.py

Remove upstream fa checks (#29471 )

2025-11-28 05:52:42 -08:00

ernie45_moe.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

ernie45_vl_moe.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

ernie45_vl.py

Remove upstream fa checks (#29471 )

2025-11-28 05:52:42 -08:00

ernie45.py

…

ernie_mtp.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

exaone4.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

exaone.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

fairseq2_llama.py

…

falcon_h1.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

falcon.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

flex_olmo.py

…

fuyu.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

gemma2.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

gemma3_mm.py

[Bugfix] Revert custom attention mask for gemma3-mm (#28995 )

2025-11-20 13:23:22 +08:00

gemma3.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

gemma3n_mm.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

gemma3n.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

gemma.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

glm4_1v.py

[Chore] Enable passing tokenizer=None into MM processor (#29724 )

2025-11-29 06:25:10 -08:00

glm4_moe_mtp.py

[BugFix] Fix glm4_moe_mtp load weights bug (#28805 )

2025-11-17 17:13:11 +08:00

glm4_moe.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

glm4.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

glm4v.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842 )

2025-11-18 18:56:04 +00:00

glm.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

gpt2.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

gpt_bigcode.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

gpt_j.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

gpt_neox.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

gpt_oss.py

Fix parameter order in GPT-OSS weight loading function for non-MXFP4 weights (#29506 )

2025-11-28 00:45:10 -08:00

granite_speech.py

[Chore] Move tokenizer initialization methods (#29793 )

2025-12-02 13:33:37 +08:00

granite.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

granitemoe.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

granitemoehybrid.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

granitemoeshared.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

gritlm.py

[Misc] Move functions into PoolingMetadata (#30027 )

2025-12-04 08:21:19 +00:00

grok1.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

h2ovl.py

[Misc] Refactor tokenizer interface (#29693 )

2025-11-29 04:02:21 -08:00

hunyuan_v1.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

hunyuan_vision.py

[Misc] Various cleanups for MM input processing (#29970 )

2025-12-04 06:22:20 +00:00

hyperclovax_vision.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

idefics2_vision_model.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842 )

2025-11-18 18:56:04 +00:00

idefics3.py

[Bugfix] Fix incorrect channel order for idefics3 in edge case (#29881 )

2025-12-02 16:03:52 +00:00

interfaces_base.py

Add missing return in _check_vllm_model_embed_input_ids (#29834 )

2025-12-01 19:22:50 -08:00

interfaces.py

[Chore] Deprecate merge_by_field_config arg (#30035 )

2025-12-04 17:21:24 +00:00

intern_vit.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842 )

2025-11-18 18:56:04 +00:00

internlm2_ve.py

Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542 )

2025-11-19 09:06:36 -08:00

internlm2.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

interns1_vit.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842 )

2025-11-18 18:56:04 +00:00

interns1.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

internvl.py

[Misc] Refactor tokenizer interface (#29693 )

2025-11-29 04:02:21 -08:00

jais.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

jamba.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

jina_vl.py

Fix some Transformers nightly tests (#29802 )

2025-12-02 07:05:27 +00:00

keye_vl1_5.py

[Misc] Various cleanups for MM input processing (#29970 )

2025-12-04 06:22:20 +00:00

keye.py

[Misc] Various cleanups for MM input processing (#29970 )

2025-12-04 06:22:20 +00:00

kimi_linear.py

Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542 )

2025-11-19 09:06:36 -08:00

kimi_vl.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

lfm2_moe.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

lfm2.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

lightonocr.py

[Chore] Deprecate merge_by_field_config arg (#30035 )

2025-12-04 17:21:24 +00:00

llama4_eagle.py

[Bugfix] Fix spec decode memory regression after #28549 (#28819 )

2025-11-20 19:05:50 +08:00

llama4.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

llama_eagle3.py

[Spec Decode] Add support for EAGLE3 heads that do not use_aux_hidden_states (#27688 )

2025-11-24 20:13:12 -05:00

llama_eagle.py

[Bugfix] Fix spec decode memory regression after #28549 (#28819 )

2025-11-20 19:05:50 +08:00

llama.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

llava_next_video.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

llava_next.py

[Bugfix] Fix handling of image embeds in models (#29480 )

2025-11-26 05:00:15 -08:00

llava_onevision.py

[Bugfix] Fix handling of image embeds in models (#29480 )

2025-11-26 05:00:15 -08:00

llava.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

longcat_flash_mtp.py

…

longcat_flash.py

[Refactor] Optimize select_experts (#28069 )

2025-11-19 18:53:15 -05:00

mamba2.py

[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear projections under custom op (#28587 )

2025-11-18 16:49:36 -08:00

mamba.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

medusa.py

[LoRA][1/N]Remove LoRA extra vocab (#28382 )

2025-11-11 11:06:21 -08:00

midashenglm.py

[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842 )

2025-11-18 18:56:04 +00:00

mimo_mtp.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

mimo.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

minicpm3.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

minicpm_eagle.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

minicpm.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

minicpmo.py

…

minicpmv.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

minimax_m2.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

minimax_text_01.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

minimax_vl_01.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

mistral3.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

mistral_large_3_eagle.py

Add Mistral Large 3 and Ministral 3 (#29757 )

2025-12-02 10:29:00 +00:00

mistral_large_3.py

Add Mistral Large 3 and Ministral 3 (#29757 )

2025-12-02 10:29:00 +00:00

mixtral.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

mllama4.py

Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542 )

2025-11-19 09:06:36 -08:00

mlp_speculator.py

[LoRA][1/N]Remove LoRA extra vocab (#28382 )

2025-11-11 11:06:21 -08:00

modernbert.py

Fix some Transformers nightly tests (#29802 )

2025-12-02 07:05:27 +00:00

module_mapping.py

…

molmo.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

moonvit.py

[XPU]fix Kimi-VL-A3B-thinking on xpu (#29309 )

2025-11-24 21:02:21 +00:00

mpt.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

nano_nemotron_vl.py

[Chore] Deprecate merge_by_field_config arg (#30035 )

2025-12-04 17:21:24 +00:00

nemotron_h.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

nemotron_nas.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

nemotron_vl.py

[Misc] Refactor tokenizer interface (#29693 )

2025-11-29 04:02:21 -08:00

nemotron.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

nvlm_d.py

…

olmo2.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

olmo.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

olmoe.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

opencua.py

[Chore] Deprecate merge_by_field_config arg (#30035 )

2025-12-04 17:21:24 +00:00

openpangu_mtp.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

openpangu.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

opt.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

orion.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

ouro.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

ovis2_5.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

ovis.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

paddleocr_vl.py

[Chore] Deprecate merge_by_field_config arg (#30035 )

2025-12-04 17:21:24 +00:00

paligemma.py

[Chore] Deprecate merge_by_field_config arg (#30035 )

2025-12-04 17:21:24 +00:00

persimmon.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

phi3.py

…

phi3v.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

phi4mm_audio.py

…

phi4mm_utils.py

…

phi4mm.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

phi.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

phimoe.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

pixtral.py

[Chore] Move tokenizer initialization methods (#29793 )

2025-12-02 13:33:37 +08:00

plamo2.py

[V0 deprecation] Remove more V0 references (#29088 )

2025-11-21 11:56:59 +00:00

plamo3.py

[Bugfix] Fix Plamo3 rope handling (#29092 )

2025-11-21 11:38:35 +08:00

qwen2_5_omni_thinker.py

[Chore] Use tokenizer.encode and tokenizer.decode directly (#29851 )

2025-12-02 12:30:40 +00:00

qwen2_5_vl.py

[Chore] Deprecate merge_by_field_config arg (#30035 )

2025-12-04 17:21:24 +00:00

qwen2_audio.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

qwen2_moe.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

qwen2_rm.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

qwen2_vl.py

Fix some more Transformers nightly tests (#29872 )

2025-12-02 21:49:44 +00:00

qwen2.py

Fix some Transformers nightly tests (#29802 )

2025-12-02 07:05:27 +00:00

qwen3_moe.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

qwen3_next_mtp.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

qwen3_next.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

qwen3_omni_moe_thinker.py

[ROCm] [Bugfix] compute_attn_mask_seqlen for qwen3 omni (#29974 )

2025-12-04 08:20:24 +00:00

qwen3_vl_moe.py

[LoRA] Continue optimizing MoE LoRA weight loading (#29322 )

2025-11-27 05:56:28 -08:00

qwen3_vl.py

support qwen3-vl handle requests with embeddings (#30037 )

2025-12-04 17:34:06 +00:00

qwen3.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

qwen_vl.py

[Chore] Enable passing tokenizer=None into MM processor (#29724 )

2025-11-29 06:25:10 -08:00

qwen.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

radio.py

…

registry.py

Delete HF version of Phi 4 MM (#30049 )

2025-12-04 13:44:50 +00:00

roberta.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

rvl.py

…

seed_oss.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

siglip2navit.py

Remove upstream fa checks (#29471 )

2025-11-28 05:52:42 -08:00

siglip.py

[Core] Enable inputs_embeds_size separate from hidden_size (#29741 )

2025-11-30 17:31:12 +08:00

skyworkr1v.py

[Misc] Refactor tokenizer interface (#29693 )

2025-11-29 04:02:21 -08:00

smolvlm.py

…

solar.py

[LoRA] Cleanup LoRA unused code (#29611 )

2025-11-28 22:52:58 -08:00

stablelm.py

Access partial_rotary_factor from rope_parameters (#29966 )

2025-12-04 18:42:49 +00:00

starcoder2.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

step3_text.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342 )

2025-11-26 10:53:15 -07:00

step3_vl.py

[Misc] Refactor tokenizer interface (#29693 )

2025-11-29 04:02:21 -08:00

swin.py

…

tarsier.py

Rename clashing method names for vLLM model protocol (#27583 )

2025-11-12 19:14:33 -08:00

telechat2.py

…

teleflm.py

[LoRA][2/2]Remove LoRA extra vocab (#28545 )

2025-11-21 09:46:43 +08:00

terratorch.py

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145 )

2025-12-04 13:44:15 +00:00

ultravox.py

[Bugfix] Update Ultravox compatibility (#29588 )

2025-11-27 01:36:18 -08:00

utils.py

[Deprecation] Advance deprecation status (#29617 )

2025-11-27 19:04:58 +00:00

vision.py

[Model][MM] Extract conv layer as CustomOp (#28455 )

2025-11-14 19:16:13 +08:00

voxtral.py

[Chore] Move tokenizer initialization methods (#29793 )

2025-12-02 13:33:37 +08:00

whisper.py

[Chore] Move tokenizer initialization methods (#29793 )

2025-12-02 13:33:37 +08:00

zamba2.py

Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542 )

2025-11-19 09:06:36 -08:00