vllm/models at ff08e51940a77d2dd14a6c512bec4613d060b4fa - vllm

__init__.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

adapters.py

[Model][1/N] Support multiple poolers at model level (#21227 )

2025-07-21 02:22:21 -07:00

aimv2.py

[Misc] Remove redundant config definitions (#21891 )

2025-07-29 23:54:18 -07:00

arcee.py

Add arcee model (#21296 )

2025-07-22 00:57:43 -07:00

arctic.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

aria.py

Migrate AriaImagePixelInputs to TensorSchema for shape validation (#21620 )

2025-07-26 06:08:15 -07:00

aya_vision.py

Migrate AyaVisionImagePixelInputs to TensorSchema for shape validation (#21622 )

2025-07-26 06:08:18 -07:00

baichuan.py

[CI] change spell checker from codespell to typos (#18711 )

2025-06-11 19:57:10 -07:00

bailing_moe.py

support torch.compile for bailing moe (#21664 )

2025-07-26 23:54:32 +00:00

bamba.py

[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194 )

2025-07-19 19:27:21 +00:00

bart.py

[Model] use AutoWeightsLoader for bart (#18299 )

2025-07-20 08:15:50 +00:00

bert_with_rope.py

[Model]: Fused MoE for nomic-embed-text-v2-moe (#18321 )

2025-07-29 03:13:27 -07:00

bert.py

Support encoder-only models without KV-Cache (#21270 )

2025-07-26 21:09:52 +08:00

blip2.py

Migrate Blip2ImagePixelInputs and Blip2ImageEmbeddingInputs to TensorSchema (#21656 )

2025-07-27 10:33:52 +08:00

blip.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

bloom.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

chameleon.py

Migrate ChameleonImagePixelInputs to TensorSchema (#21657 )

2025-07-26 19:34:25 -07:00

chatglm.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

clip.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

commandr.py

[CI/Build] Ensure compatability with Transformers v4.53 (#20541 )

2025-07-11 20:53:07 -07:00

config.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470 )

2025-07-27 19:42:40 -07:00

constant_size_cache.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

dbrx.py

[Misc] Remove redundant config definitions (#21891 )

2025-07-29 23:54:18 -07:00

deepseek_mtp.py

[V1][Speculative Decoding] Fix DeepSeek MTP (#20022 )

2025-06-25 08:41:02 -07:00

deepseek_v2.py

[Model] Remove DSV2 unused code (#21903 )

2025-07-30 00:55:03 -07:00

deepseek_vl2.py

Migrate DeepseekVL2ImageInputs to TensorSchema (#21658 )

2025-07-26 19:34:11 -07:00

deepseek.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

dots1.py

[Quantization] Enable BNB support for more MoE models (#21370 )

2025-07-25 03:57:34 -07:00

ernie45_moe.py

[Bugfix] Fix Ernie4_5_MoeForCausalLM shared experts (#21717 )

2025-07-28 11:02:25 +00:00

ernie45.py

[Ernie 4.5] Name Change for Base 0.3B Model (#21735 )

2025-07-28 12:22:32 +00:00

exaone4.py

[Misc] Remove redundant config definitions (#21891 )

2025-07-29 23:54:18 -07:00

exaone.py

[Misc] Remove redundant config definitions (#21891 )

2025-07-29 23:54:18 -07:00

fairseq2_llama.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

falcon_h1.py

[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194 )

2025-07-19 19:27:21 +00:00

falcon.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

florence2.py

Migrate Florence2ImagePixelInputs to TensorSchema (#21663 )

2025-07-27 02:43:02 -07:00

fuyu.py

[Bugfix] Fix shape checking for Fuyu (#21709 )

2025-07-28 00:05:56 -07:00

gemma2.py

Mark invariant normalizer in Gemma as non-persistent (#19788 )

2025-06-18 22:56:03 -07:00

gemma3_mm.py

Migrate Gemma3ImagePixelInputs to TensorSchema (#21676 )

2025-07-27 22:36:05 -07:00

gemma3.py

[CI/Build] Ensure compatability with Transformers v4.53 (#20541 )

2025-07-11 20:53:07 -07:00

gemma3n.py

[Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with BitsAndBytes quantization (#21808 )

2025-07-30 11:35:21 +08:00

gemma.py

[Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103 )

2025-07-18 07:15:07 +00:00

glm4_1v.py

[Bugfix] Fix glm4.1v video_grid_thw tensor shape scheme (#21744 )

2025-07-28 04:26:49 -07:00

glm4_moe_mtp.py

GLM-4 Update (#20736 )

2025-07-19 22:40:31 +00:00

glm4_moe.py

[Quantization] Enable BNB support for more MoE models (#21370 )

2025-07-25 03:57:34 -07:00

glm4.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

glm4v.py

Migrate GLMVImagePixelInputs to TensorSchema (#21679 )

2025-07-27 22:36:11 -07:00

glm.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

gpt2.py

[Model][1/N] Support multiple poolers at model level (#21227 )

2025-07-21 02:22:21 -07:00

gpt_bigcode.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

gpt_j.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

gpt_neox.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

granite_speech.py

[Bugfix] Fix granite speech shape validation (#21762 )

2025-07-28 14:19:21 -04:00

granite.py

[Bugfix] Fix Tensor Parallelism Padding Consistency in Granite Models (#20843 )

2025-07-12 06:11:30 -07:00

granitemoe.py

Let GraniteMoeAttention use YaRN (#21174 )

2025-07-18 05:52:52 -07:00

granitemoehybrid.py

[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194 )

2025-07-19 19:27:21 +00:00

granitemoeshared.py

Let GraniteMoeAttention use YaRN (#21174 )

2025-07-18 05:52:52 -07:00

gritlm.py

[V1] Get supported tasks from model runner instead of model config (#21585 )

2025-07-25 05:36:45 -07:00

grok1.py

[Quantization] Enable BNB support for more MoE models (#21100 )

2025-07-18 17:52:02 -07:00

h2ovl.py

[Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058 )

2025-06-30 17:26:49 +00:00

hunyuan_v1.py

[Model] add Hunyuan V1 Dense Model support. (#21368 )

2025-07-23 03:54:08 -07:00

hyperclovax_vision.py

[MODEL] New model support for naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B (#20931 )

2025-07-25 06:05:42 -07:00

idefics2_vision_model.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

idefics3.py

Migrate Idefics3ImagePixelInputs and Idefics3ImageEmbeddingInputs to … (#21683 )

2025-07-27 22:37:23 -07:00

interfaces_base.py

[Model] Update pooling model interface (#21058 )

2025-07-17 16:05:40 +00:00

interfaces.py

[Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577 )

2025-07-23 11:00:23 -07:00

intern_vit.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

internlm2_ve.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

internlm2.py

[Model][1/N] Support multiple poolers at model level (#21227 )

2025-07-21 02:22:21 -07:00

interns1_vit.py

Support Intern-S1 (#21628 )

2025-07-26 19:14:04 +08:00

interns1.py

[VLM] Add video support for Intern-S1 (#21671 )

2025-07-27 11:49:43 +00:00

internvl.py

Migrate InternVLImageInputs and InternVLVideoInputs to TensorSchema (#21684 )

2025-07-28 22:09:45 -07:00

jais.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

jamba.py

[Model] Refactor JambaForCausalLM (#21394 )

2025-07-29 18:25:07 +08:00

jina_vl.py

[Model][1/N] Support multiple poolers at model level (#21227 )

2025-07-21 02:22:21 -07:00

keye.py

[Misc] Remove redundant config definitions (#21891 )

2025-07-29 23:54:18 -07:00

kimi_vl.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

llama4_eagle.py

[Meta] Llama4 EAGLE Support (#20591 )

2025-07-15 21:14:15 -07:00

llama4.py

[NVIDIA] Fix Llama4 Scout FP4 functionality issues (#21499 )

2025-07-30 07:33:40 -07:00

llama_eagle3.py

[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033 )

2025-06-05 19:10:08 -07:00

llama_eagle.py

[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033 )

2025-06-05 19:10:08 -07:00

llama.py

[Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103 )

2025-07-18 07:15:07 +00:00

llava_next_video.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

llava_next.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

llava_onevision.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

llava.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

mamba2.py

[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194 )

2025-07-19 19:27:21 +00:00

mamba_cache.py

[Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218 )

2025-07-09 12:53:55 -07:00

mamba.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

medusa.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

mimo_mtp.py

[Model] Remove model sampler (#21059 )

2025-07-16 19:03:37 +00:00

mimo.py

[Model] Remove model sampler (#21059 )

2025-07-16 19:03:37 +00:00

minicpm3.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

minicpm_eagle.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

minicpm.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

minicpmo.py

[CI/Build] Ensure compatability with Transformers v4.53 (#20541 )

2025-07-11 20:53:07 -07:00

minicpmv.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

minimax_cache.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

minimax_text_01.py

[Model] Support HF format of minimax (#20211 )

2025-07-11 02:55:21 +00:00

minimax_vl_01.py

[Misc] Remove redundant config definitions (#21891 )

2025-07-29 23:54:18 -07:00

mistral3.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

mixtral_quant.py

[CI] change spell checker from codespell to typos (#18711 )

2025-06-11 19:57:10 -07:00

mixtral.py

[Quantization] add BNB for MixtralForCausalLM (#20893 )

2025-07-14 07:34:34 +00:00

mllama4.py

Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419 )

2025-07-11 23:07:16 -07:00

mllama.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

mlp_speculator.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

modernbert.py

[V1] Get supported tasks from model runner instead of model config (#21585 )

2025-07-25 05:36:45 -07:00

module_mapping.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

molmo.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

moonvit.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

mpt.py

[Misc] Remove redundant config definitions (#21891 )

2025-07-29 23:54:18 -07:00

nemotron_h.py

[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194 )

2025-07-19 19:27:21 +00:00

nemotron_nas.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

nemotron_vl.py

[VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349 )

2025-07-17 03:07:55 -07:00

nemotron.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

nvlm_d.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

olmo2.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

olmo.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

olmoe.py

[Quantization] add BNB for MixtralForCausalLM (#20893 )

2025-07-14 07:34:34 +00:00

opt.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

orion.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

ovis.py

[Misc] Remove redundant config definitions (#21891 )

2025-07-29 23:54:18 -07:00

paligemma.py

[CI/Build] Ensure compatability with Transformers v4.53 (#20541 )

2025-07-11 20:53:07 -07:00

persimmon.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

phi3.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

phi3v.py

Integrate TensorSchema with shape validation for Phi3VImagePixelInputs (#21232 )

2025-07-24 21:43:52 -07:00

phi4_multimodal.py

[VLM] Support HF format Phi-4-MM model (#17121 )

2025-07-26 20:07:57 -07:00

phi4flash.py

[Model] Remove model sampler (#21059 )

2025-07-16 19:03:37 +00:00

phi4mm_audio.py

[CI] change spell checker from codespell to typos (#18711 )

2025-06-11 19:57:10 -07:00

phi4mm_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

phi4mm.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

phi.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

phimoe.py

[Misc] Fix PhiMoE expert mapping (#21085 )

2025-07-17 05:47:49 +00:00

pixtral.py

Remove xformers requirement for Mistral-format Pixtral and Mistral3 (#21154 )

2025-07-26 17:20:29 -06:00

plamo2.py

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674 )

2025-07-28 05:00:47 +00:00

prithvi_geospatial_mae.py

Add support for Prithvi in Online serving mode (#21518 )

2025-07-25 07:01:27 -07:00

qwen2_5_omni_thinker.py

[CI/Build] Ensure compatability with Transformers v4.53 (#20541 )

2025-07-11 20:53:07 -07:00

qwen2_5_vl.py

[fix] fix qwen image_embeds input (#21049 )

2025-07-16 15:17:20 +00:00

qwen2_audio.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

qwen2_moe.py

[Misc] Qwen MoE model supports LoRA (#20932 )

2025-07-17 18:32:52 +00:00

qwen2_rm.py

[Model][1/N] Support multiple poolers at model level (#21227 )

2025-07-21 02:22:21 -07:00

qwen2_vl.py

[Core] Rename get_max_tokens_per_item for backward compatibility (#20630 )

2025-07-08 23:11:30 +00:00

qwen2.py

[Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103 )

2025-07-18 07:15:07 +00:00

qwen3_moe.py

[Feature][EPLB] Add eplb support for Qwen3 (#20815 )

2025-07-30 06:27:57 -07:00

qwen3.py

[Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103 )

2025-07-18 07:15:07 +00:00

qwen_vl.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

qwen.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

registry.py

[Ernie 4.5] Name Change for Base 0.3B Model (#21735 )

2025-07-28 12:22:32 +00:00

roberta.py

Support encoder-only models without KV-Cache (#21270 )

2025-07-26 21:09:52 +08:00

siglip.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

skyworkr1v.py

[Core] Move multimodal placeholder from chat utils to model definition (#20355 )

2025-07-03 08:18:30 +00:00

smolvlm.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

solar.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

stablelm.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

starcoder2.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

tarsier.py

[Bugfix] Fix nightly transformers CI failure (#21427 )

2025-07-23 00:01:01 -07:00

telechat2.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

teleflm.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

transformers.py

Deduplicate Transformers backend code using inheritance (#21461 )

2025-07-24 00:16:23 -07:00

ultravox.py

[Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818 )

2025-07-25 18:12:31 -07:00

utils.py

[Quant] [Bugfix] Fix quantization config matching with hf_to_vllm_mapper (#20046 )

2025-07-01 19:20:34 +09:00

vision.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

voxtral.py

Voxtral (#20970 )

2025-07-15 07:35:30 -07:00

whisper.py

Voxtral (#20970 )

2025-07-15 07:35:30 -07:00

zamba2.py

[V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194 )

2025-07-19 19:27:21 +00:00