Joe Runde 98f9713399

[Bugfix] Fix TP > 1 for new granite (#8544) ...

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

2024-09-17 23:17:08 +00:00

..

__init__.py

[Model] support minicpm3 (#8297)

2024-09-14 14:50:26 +00:00

arctic.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

baichuan.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

bart.py

[Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631)

2024-09-17 07:35:01 -07:00

blip2.py

[VLM][Model] TP support for ViTs (#7186)

2024-08-30 08:19:27 -07:00

blip.py

[Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061)

2024-09-03 21:37:52 +08:00

bloom.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

chameleon.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

chatglm.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

clip.py

[Bugfix] Fix missing post_layernorm in CLIP (#8155)

2024-09-10 08:22:50 +00:00

commandr.py

[Bugfix] Correct adapter usage for cohere and jamba (#8292)

2024-09-09 11:20:46 -07:00

dbrx.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018)

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

deepseek.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

eagle.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

exaone.py

[Bugfix] Fix import error in Exaone model (#8034)

2024-08-30 08:03:28 -07:00

falcon.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

fuyu.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gemma2.py

[Gemma2] add bitsandbytes support for Gemma2 (#8338)

2024-09-11 21:53:12 -07:00

gemma.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_bigcode.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_j.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_neox.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

granite.py

[Bugfix] Fix TP > 1 for new granite (#8544)

2024-09-17 23:17:08 +00:00

idefics2_vision_model.py

[Model]Refactor MiniCPMV (#7020)

2024-08-04 08:12:41 +00:00

interfaces.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

intern_vit.py

[Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061)

2024-09-03 21:37:52 +08:00

internlm2.py

Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860)

2024-09-05 11:33:37 +00:00

internvl.py

[Bugfix] Fix InternVL2 inference with various num_patches (#8375)

2024-09-12 10:10:35 -07:00

jais.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

jamba.py

[Kernel][Misc] register ops to prevent graph breaks (#6917)

2024-09-11 12:52:19 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

llama.py

[Model] Allow loading from original Mistral format (#8168)

2024-09-06 17:02:05 -06:00

llava_next_video.py

[model] Support for Llava-Next-Video model (#7559)

2024-09-10 22:21:36 -07:00

llava_next.py

[Model] Multi-input support for LLaVA (#8238)

2024-09-07 02:57:24 +00:00

llava.py

[Model] Multi-input support for LLaVA (#8238)

2024-09-07 02:57:24 +00:00

medusa.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

minicpm3.py

[Model] support minicpm3 (#8297)

2024-09-14 14:50:26 +00:00

minicpm.py

[Model] support minicpm3 (#8297)

2024-09-14 14:50:26 +00:00

minicpmv.py

[MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029)

2024-09-05 12:48:10 +00:00

mixtral_quant.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

mixtral.py

[Misc] Fused MoE Marlin support for GPTQ (#8217)

2024-09-09 23:02:52 -04:00

mlp_speculator.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

mpt.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

na_vit.py

[Model]Refactor MiniCPMV (#7020)

2024-08-04 08:12:41 +00:00

nemotron.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

olmo.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

opt.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

orion.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

paligemma.py

[Model][VLM] Decouple weight loading logic for Paligemma (#8269)

2024-09-07 17:45:44 +00:00

persimmon.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phi3_small.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phi3v.py

[Model] Multi-input support for LLaVA (#8238)

2024-09-07 02:57:24 +00:00

phi.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phimoe.py

[Bugfix] Fix weight loading issue by rename variable. (#8293)

2024-09-12 19:25:00 -04:00

pixtral.py

[Bugfix][Model] Fix Python 3.8 compatibility in Pixtral model by updating type annotations (#8490)

2024-09-15 04:20:05 +00:00

qwen2_moe.py

[Misc] Skip loading extra bias for Qwen2-MOE GPTQ models (#8329)

2024-09-10 20:59:19 -04:00

qwen2_vl.py

[Misc] Skip loading extra bias for Qwen2-VL GPTQ-Int8 (#8442)

2024-09-13 07:58:28 +00:00

qwen2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

qwen.py

[Model] Support multiple images for qwen-vl (#8247)

2024-09-12 10:10:54 -07:00

siglip.py

[Bugfix] Fix missing post_layernorm in CLIP (#8155)

2024-09-10 08:22:50 +00:00

stablelm.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

starcoder2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

ultravox.py

[Model] Add Ultravox support for multiple audio chunks (#7963)

2024-09-04 04:38:21 +00:00

utils.py

Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860)

2024-09-05 11:33:37 +00:00

xverse.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00