Robert Shaw 7c008c51a9

[ Misc ] Refactor MoE to isolate Fp8 From Mixtral (#5970) ...

Co-authored-by: Robert Shaw <rshaw@neuralmagic>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

2024-07-02 21:54:35 +00:00

..

__init__.py

Unmark more files as executable (#5962)

2024-06-28 17:34:56 -04:00

arctic.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

baichuan.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

bloom.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

chatglm.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

clip.py

[VLM] Remove image_input_type from VLM config (#5852)

2024-07-02 07:57:09 +00:00

commandr.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

dbrx.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018)

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

deepseek.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

falcon.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

gemma2.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

gemma.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

gpt2.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

gpt_bigcode.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

gpt_j.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

gpt_neox.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

interfaces.py

[Model][Bugfix] Implicit model flags and reenable Phi-3-Vision (#5896)

2024-06-27 09:08:10 -07:00

internlm2.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

jais.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

llama.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

llava_next.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

llava.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

minicpm.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

mixtral_quant.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

mixtral.py

[ Misc ] Refactor MoE to isolate Fp8 From Mixtral (#5970)

2024-07-02 21:54:35 +00:00

mlp_speculator.py

[Model] Changes to MLPSpeculator to support tie_weights and input_scale (#5965)

2024-07-01 16:40:02 -07:00

mpt.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

olmo.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

opt.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

orion.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

phi3_small.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

phi3v.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

phi.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

qwen2_moe.py

[ Misc ] Refactor MoE to isolate Fp8 From Mixtral (#5970)

2024-07-02 21:54:35 +00:00

qwen2.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

qwen.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

stablelm.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

starcoder2.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

xverse.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00