Wenxiang 1248e8506a

[Model] Adding support for MSFT Phi-3.5-MoE (#7729) ...

Co-authored-by: Your Name <you@example.com>
Co-authored-by: Zeqi Lin <zelin@microsoft.com>
Co-authored-by: Zeqi Lin <Zeqi.Lin@microsoft.com>

2024-08-30 13:42:57 -06:00

..

__init__.py

[Model] Adding support for MSFT Phi-3.5-MoE (#7729)

2024-08-30 13:42:57 -06:00

arctic.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

baichuan.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

bart.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

blip2.py

[VLM][Model] TP support for ViTs (#7186)

2024-08-30 08:19:27 -07:00

blip.py

[VLM][Model] TP support for ViTs (#7186)

2024-08-30 08:19:27 -07:00

bloom.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

chameleon.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

chatglm.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

clip.py

[VLM][Model] TP support for ViTs (#7186)

2024-08-30 08:19:27 -07:00

commandr.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

dbrx.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018)

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

deepseek.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

eagle.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

exaone.py

[Bugfix] Fix import error in Exaone model (#8034)

2024-08-30 08:03:28 -07:00

falcon.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

fuyu.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gemma2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gemma.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_bigcode.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_j.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

gpt_neox.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

idefics2_vision_model.py

[Model]Refactor MiniCPMV (#7020)

2024-08-04 08:12:41 +00:00

interfaces.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

intern_vit.py

[VLM][Model] TP support for ViTs (#7186)

2024-08-30 08:19:27 -07:00

internlm2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

internvl.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

jais.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

jamba.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

llama.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

llava_next.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

llava.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

medusa.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

minicpm.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

minicpmv.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

mixtral_quant.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

mixtral.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

mlp_speculator.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

mpt.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

na_vit.py

[Model]Refactor MiniCPMV (#7020)

2024-08-04 08:12:41 +00:00

nemotron.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

olmo.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

opt.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

orion.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

paligemma.py

[VLM][Model] TP support for ViTs (#7186)

2024-08-30 08:19:27 -07:00

persimmon.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phi3_small.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phi3v.py

[VLM][Model] TP support for ViTs (#7186)

2024-08-30 08:19:27 -07:00

phi.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

phimoe.py

[Model] Adding support for MSFT Phi-3.5-MoE (#7729)

2024-08-30 13:42:57 -06:00

qwen2_moe.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

qwen2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

qwen.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

siglip.py

[VLM][Model] TP support for ViTs (#7186)

2024-08-30 08:19:27 -07:00

stablelm.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

starcoder2.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

ultravox.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

utils.py

[VLM][Core] Fix exceptions on ragged NestedTensors (#7974)

2024-08-29 03:24:31 +00:00

xverse.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00