vllm/models at 1230263e161caa9fd698e109d33437950769ec09 - vllm

__init__.py

[MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029 )

2024-09-05 12:48:10 +00:00

arctic.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

baichuan.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

bart.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

blip2.py

[VLM][Model] TP support for ViTs (#7186 )

2024-08-30 08:19:27 -07:00

blip.py

[Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061 )

2024-09-03 21:37:52 +08:00

bloom.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

chameleon.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

chatglm.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

clip.py

[Bugfix] Fix missing post_layernorm in CLIP (#8155 )

2024-09-10 08:22:50 +00:00

commandr.py

[Bugfix] Correct adapter usage for cohere and jamba (#8292 )

2024-09-09 11:20:46 -07:00

dbrx.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018 )

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

deepseek.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

eagle.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

exaone.py

[Bugfix] Fix import error in Exaone model (#8034 )

2024-08-30 08:03:28 -07:00

falcon.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

fuyu.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gemma2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gemma.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gpt2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gpt_bigcode.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gpt_j.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gpt_neox.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

granite.py

[Model] Add Granite model (#7436 )

2024-09-01 18:37:18 -07:00

idefics2_vision_model.py

[Model]Refactor MiniCPMV (#7020 )

2024-08-04 08:12:41 +00:00

interfaces.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126 )

2024-08-14 17:55:42 +00:00

intern_vit.py

[Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061 )

2024-09-03 21:37:52 +08:00

internlm2.py

Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860 )

2024-09-05 11:33:37 +00:00

internvl.py

[Bugfix] Fix InternVL2 vision embeddings process with pipeline parallel (#8299 )

2024-09-11 10:11:01 +08:00

jais.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

jamba.py

[Bugfix] Correct adapter usage for cohere and jamba (#8292 )

2024-09-09 11:20:46 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734 )

2024-05-11 11:30:37 -07:00

llama.py

[Model] Allow loading from original Mistral format (#8168 )

2024-09-06 17:02:05 -06:00

llava_next.py

[Model] Multi-input support for LLaVA (#8238 )

2024-09-07 02:57:24 +00:00

llava.py

[Model] Multi-input support for LLaVA (#8238 )

2024-09-07 02:57:24 +00:00

medusa.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

minicpm.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

minicpmv.py

[MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029 )

2024-09-05 12:48:10 +00:00

mixtral_quant.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

mixtral.py

[Misc] Fused MoE Marlin support for GPTQ (#8217 )

2024-09-09 23:02:52 -04:00

mlp_speculator.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

mpt.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

na_vit.py

[Model]Refactor MiniCPMV (#7020 )

2024-08-04 08:12:41 +00:00

nemotron.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

olmo.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

opt.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

orion.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

paligemma.py

[Model][VLM] Decouple weight loading logic for Paligemma (#8269 )

2024-09-07 17:45:44 +00:00

persimmon.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

phi3_small.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

phi3v.py

[Model] Multi-input support for LLaVA (#8238 )

2024-09-07 02:57:24 +00:00

phi.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

phimoe.py

[Bugfix] Fix import error in Phi-3.5-MoE (#8052 )

2024-08-30 22:26:55 -07:00

qwen2_moe.py

[Misc] Skip loading extra bias for Qwen2-MOE GPTQ models (#8329 )

2024-09-10 20:59:19 -04:00

qwen2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

qwen.py

[MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029 )

2024-09-05 12:48:10 +00:00

siglip.py

[Bugfix] Fix missing post_layernorm in CLIP (#8155 )

2024-09-10 08:22:50 +00:00

stablelm.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

starcoder2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

ultravox.py

[Model] Add Ultravox support for multiple audio chunks (#7963 )

2024-09-04 04:38:21 +00:00

utils.py

Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860 )

2024-09-05 11:33:37 +00:00

xverse.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00