xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-12 23:34:33 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/vllm/model_executor/models
History
shaharmor98 fcd5306f65
Add latent MoE support (#30203) 
Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
2025-12-08 17:35:01 +00:00
..
transformers
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
__init__.py
…
adapters.py
[Model][7/N] Improve all pooling task | Deprecation as_reward_model. Extract hidden states prefer using new multi-vector retrieval API (#26686)
2025-12-08 08:10:09 +00:00
afmoe.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
aimv2.py
[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842)
2025-11-18 18:56:04 +00:00
apertus.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
arcee.py
Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542)
2025-11-19 09:06:36 -08:00
arctic.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
aria.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
aya_vision.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
baichuan.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
bailing_moe.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
bamba.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
bee.py
…
bert_with_rope.py
…
bert.py
Improve enable chunked_prefill & prefix_caching logic. (#26623)
2025-11-27 22:05:48 -08:00
blip2.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
blip.py
[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842)
2025-11-18 18:56:04 +00:00
bloom.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
chameleon.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
chatglm.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
clip.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
cohere2_vision.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
commandr.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
config.py
[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)
2025-12-05 09:48:43 -08:00
dbrx.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
deepencoder.py
[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842)
2025-11-18 18:56:04 +00:00
deepseek_eagle.py
[Misc] Remove redundant attention var constants (#29650)
2025-11-28 04:35:19 -08:00
deepseek_mtp.py
[Bugfix] Fix DeepSeek R1 MTP weight loading (#29545)
2025-12-02 15:52:18 +00:00
deepseek_ocr.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
deepseek_v2.py
[DeepSeek v3.2] Make top-k work for any logit values. (#27568)
2025-12-08 06:55:58 -08:00
deepseek_vl2.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
dots1.py
[Bugfix] fix dots.llm1.inst (#29687)
2025-11-28 15:25:26 -08:00
dots_ocr.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
ernie45_moe.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
ernie45_vl_moe.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
ernie45_vl.py
[Perf] Remove sync point in vit torch sdpa attn backend (#30232)
2025-12-08 07:12:42 +00:00
ernie45.py
…
ernie_mtp.py
…
exaone4.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
exaone.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
fairseq2_llama.py
…
falcon_h1.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
falcon.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
flex_olmo.py
…
fuyu.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
gemma2.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
gemma3_mm.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
gemma3.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
gemma3n_mm.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
gemma3n.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
gemma.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
glm4_1v.py
[Perf] Remove sync point in vit torch sdpa attn backend (#30232)
2025-12-08 07:12:42 +00:00
glm4_moe_mtp.py
[BugFix] Fix glm4_moe_mtp load weights bug (#28805)
2025-11-17 17:13:11 +08:00
glm4_moe.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
glm4.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
glm4v.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
glm.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
gpt2.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
gpt_bigcode.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
gpt_j.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
gpt_neox.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
gpt_oss.py
Fix parameter order in GPT-OSS weight loading function for non-MXFP4 weights (#29506)
2025-11-28 00:45:10 -08:00
granite_speech.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
granite.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
granitemoe.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
granitemoehybrid.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
granitemoeshared.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
gritlm.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
grok1.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
h2ovl.py
[Misc] Refactor tokenizer interface (#29693)
2025-11-29 04:02:21 -08:00
hunyuan_v1.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
hunyuan_vision.py
[Model] Move multimodal_cpu_fields definition to field config (#30181)
2025-12-06 13:40:02 +00:00
hyperclovax_vision.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
idefics2_vision_model.py
[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842)
2025-11-18 18:56:04 +00:00
idefics3.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
interfaces_base.py
Add missing return in _check_vllm_model_embed_input_ids (#29834)
2025-12-01 19:22:50 -08:00
interfaces.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
intern_vit.py
[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842)
2025-11-18 18:56:04 +00:00
internlm2_ve.py
Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542)
2025-11-19 09:06:36 -08:00
internlm2.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
interns1_vit.py
[Models] Replace all nn.Conv2d with vLLM's Conv2dLayer (#28842)
2025-11-18 18:56:04 +00:00
interns1.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
internvl.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
jais.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
jamba.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
jina_vl.py
Fix some Transformers nightly tests (#29802)
2025-12-02 07:05:27 +00:00
keye_vl1_5.py
[Misc] Various cleanups for MM input processing (#29970)
2025-12-04 06:22:20 +00:00
keye.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
kimi_linear.py
Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542)
2025-11-19 09:06:36 -08:00
kimi_vl.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
lfm2_moe.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
lfm2.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
lightonocr.py
[Chore] Deprecate merge_by_field_config arg (#30035)
2025-12-04 17:21:24 +00:00
llama4_eagle.py
[Bugfix][llama4_eagle] Fix missing 'lm_head' attribute (#29926)
2025-12-05 19:57:26 +00:00
llama4.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
llama_eagle3.py
[Spec Decode] Add support for EAGLE3 heads that do not use_aux_hidden_states (#27688)
2025-11-24 20:13:12 -05:00
llama_eagle.py
[Bugfix] Fix spec decode memory regression after #28549 (#28819)
2025-11-20 19:05:50 +08:00
llama.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
llava_next_video.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
llava_next.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
llava_onevision.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
llava.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
longcat_flash_mtp.py
…
longcat_flash.py
[Refactor] Optimize select_experts (#28069)
2025-11-19 18:53:15 -05:00
mamba2.py
[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear projections under custom op (#28587)
2025-11-18 16:49:36 -08:00
mamba.py
…
medusa.py
…
midashenglm.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
mimo_mtp.py
…
mimo.py
…
minicpm3.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
minicpm_eagle.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
minicpm.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
minicpmo.py
…
minicpmv.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
minimax_m2.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
minimax_text_01.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
minimax_vl_01.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
mistral3.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
mistral_large_3_eagle.py
Add Mistral Large 3 and Ministral 3 (#29757)
2025-12-02 10:29:00 +00:00
mistral_large_3.py
Add Mistral Large 3 and Ministral 3 (#29757)
2025-12-02 10:29:00 +00:00
mixtral.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
mllama4.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
mlp_speculator.py
…
modernbert.py
Fix some Transformers nightly tests (#29802)
2025-12-02 07:05:27 +00:00
module_mapping.py
…
molmo.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
moonvit.py
[XPU]fix Kimi-VL-A3B-thinking on xpu (#29309)
2025-11-24 21:02:21 +00:00
mpt.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
nano_nemotron_vl.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
nemotron_h.py
Add latent MoE support (#30203)
2025-12-08 17:35:01 +00:00
nemotron_nas.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
nemotron_vl.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
nemotron.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
nvlm_d.py
…
olmo2.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
olmo.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
olmoe.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
opencua.py
[Model] Move multimodal_cpu_fields definition to field config (#30181)
2025-12-06 13:40:02 +00:00
openpangu_mtp.py
…
openpangu.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
opt.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
orion.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
ouro.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
ovis2_5.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
ovis.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
paddleocr_vl.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
paligemma.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
persimmon.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
phi3.py
…
phi3v.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
phi4mm_audio.py
…
phi4mm_utils.py
…
phi4mm.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
phi.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
phimoe.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
pixtral.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
plamo2.py
[V0 deprecation] Remove more V0 references (#29088)
2025-11-21 11:56:59 +00:00
plamo3.py
[Bugfix] Fix Plamo3 rope handling (#29092)
2025-11-21 11:38:35 +08:00
qwen2_5_omni_thinker.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
qwen2_5_vl.py
[Model] Move multimodal_cpu_fields definition to field config (#30181)
2025-12-06 13:40:02 +00:00
qwen2_audio.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
qwen2_moe.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
qwen2_rm.py
…
qwen2_vl.py
[Perf] Remove sync point in vit torch sdpa attn backend (#30232)
2025-12-08 07:12:42 +00:00
qwen2.py
Fix some Transformers nightly tests (#29802)
2025-12-02 07:05:27 +00:00
qwen3_moe.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
qwen3_next_mtp.py
…
qwen3_next.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
qwen3_omni_moe_thinker.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
qwen3_vl_moe.py
[LoRA] Continue optimizing MoE LoRA weight loading (#29322)
2025-11-27 05:56:28 -08:00
qwen3_vl.py
[Model] Move multimodal_cpu_fields definition to field config (#30181)
2025-12-06 13:40:02 +00:00
qwen3.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
qwen_vl.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
qwen.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
radio.py
…
registry.py
Delete HF version of Phi 4 MM (#30049)
2025-12-04 13:44:50 +00:00
roberta.py
…
rvl.py
…
seed_oss.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
siglip2navit.py
Remove upstream fa checks (#29471)
2025-11-28 05:52:42 -08:00
siglip.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
skyworkr1v.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
smolvlm.py
…
solar.py
[LoRA] Cleanup LoRA unused code (#29611)
2025-11-28 22:52:58 -08:00
stablelm.py
Access partial_rotary_factor from rope_parameters (#29966)
2025-12-04 18:42:49 +00:00
starcoder2.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
step3_text.py
[Attention] Remove imports from vllm/attention/__init__.py (#29342)
2025-11-26 10:53:15 -07:00
step3_vl.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
swin.py
…
tarsier.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
telechat2.py
…
teleflm.py
[LoRA][2/2]Remove LoRA extra vocab (#28545)
2025-11-21 09:46:43 +08:00
terratorch.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
ultravox.py
[Chore] Deprecate SupportsMultiModal.merge_by_field_config (#30170)
2025-12-06 07:57:28 +00:00
utils.py
[Deprecation] Advance deprecation status (#29617)
2025-11-27 19:04:58 +00:00
vision.py
[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)
2025-12-05 09:48:43 -08:00
voxtral.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
whisper.py
Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)
2025-12-07 00:00:22 -08:00
zamba2.py
Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542)
2025-11-19 09:06:36 -08:00