vllm/models at 9dc7c6c7f332ac6c08311c7a946c6945e0782701 - vllm

__init__.py

[Model] Add OLMoE (#7922 )

2024-09-20 09:31:41 -07:00

arctic.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

baichuan.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

bart.py

[Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631 )

2024-09-17 07:35:01 -07:00

blip2.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

blip.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

bloom.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

chameleon.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

chatglm.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

clip.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

commandr.py

[Bugfix] Correct adapter usage for cohere and jamba (#8292 )

2024-09-09 11:20:46 -07:00

dbrx.py

[dbrx] refactor dbrx experts to extend FusedMoe class (#8518 )

2024-09-21 15:09:39 -06:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018 )

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

deepseek.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

eagle.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

exaone.py

[Bugfix] Fix import error in Exaone model (#8034 )

2024-08-30 08:03:28 -07:00

falcon.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

fuyu.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gemma2.py

[Gemma2] add bitsandbytes support for Gemma2 (#8338 )

2024-09-11 21:53:12 -07:00

gemma.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gpt2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gpt_bigcode.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gpt_j.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

gpt_neox.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

granite.py

[Bugfix] Fix TP > 1 for new granite (#8544 )

2024-09-17 23:17:08 +00:00

idefics2_vision_model.py

[Model]Refactor MiniCPMV (#7020 )

2024-08-04 08:12:41 +00:00

interfaces.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126 )

2024-08-14 17:55:42 +00:00

intern_vit.py

[Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061 )

2024-09-03 21:37:52 +08:00

internlm2.py

Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860 )

2024-09-05 11:33:37 +00:00

internvl.py

[Bugfix] Fix InternVL2 inference with various num_patches (#8375 )

2024-09-12 10:10:35 -07:00

jais.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

jamba.py

[Kernel][Misc] register ops to prevent graph breaks (#6917 )

2024-09-11 12:52:19 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734 )

2024-05-11 11:30:37 -07:00

llama.py

[Model] Allow loading from original Mistral format (#8168 )

2024-09-06 17:02:05 -06:00

llava_next_video.py

[model] Support for Llava-Next-Video model (#7559 )

2024-09-10 22:21:36 -07:00

llava_next.py

[Bugfix] Fix incorrect llava next feature size calculation (#8496 )

2024-09-20 22:48:32 +00:00

llava.py

[Model] Multi-input support for LLaVA (#8238 )

2024-09-07 02:57:24 +00:00

medusa.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

minicpm3.py

[Model] support minicpm3 (#8297 )

2024-09-14 14:50:26 +00:00

minicpm.py

[Model] support minicpm3 (#8297 )

2024-09-14 14:50:26 +00:00

minicpmv.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

mixtral_quant.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

mixtral.py

[Misc] Fused MoE Marlin support for GPTQ (#8217 )

2024-09-09 23:02:52 -04:00

mlp_speculator.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

mpt.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

na_vit.py

[Model]Refactor MiniCPMV (#7020 )

2024-08-04 08:12:41 +00:00

nemotron.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

olmo.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

olmoe.py

[Model] Add OLMoE (#7922 )

2024-09-20 09:31:41 -07:00

opt.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

orion.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

paligemma.py

[Model][VLM] Decouple weight loading logic for Paligemma (#8269 )

2024-09-07 17:45:44 +00:00

persimmon.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

phi3_small.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

phi3.py

[Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571 )

2024-09-20 08:54:02 +08:00

phi3v.py

[Model] Multi-input support for LLaVA (#8238 )

2024-09-07 02:57:24 +00:00

phi.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

phimoe.py

[Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571 )

2024-09-20 08:54:02 +08:00

pixtral.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

qwen2_moe.py

[Misc] Skip loading extra bias for Qwen2-MOE GPTQ models (#8329 )

2024-09-10 20:59:19 -04:00

qwen2_vl.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

qwen2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

qwen.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

siglip.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

solar.py

[Model] Support Solar Model (#8386 )

2024-09-18 11:04:00 -06:00

stablelm.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

starcoder2.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00

ultravox.py

[VLM] Use SequenceData.from_token_counts to create dummy data (#8687 )

2024-09-20 23:28:56 -07:00

utils.py

Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860 )

2024-09-05 11:33:37 +00:00

xverse.py

[Core] Logprobs support in Multi-step (#7652 )

2024-08-29 19:19:08 -07:00