Woosuk Kwon e72ae80b06

[Bugfix] Support 2D input shape in MoE layer (#6287)

2024-07-10 09:03:16 -04:00

..

__init__.py

[Speculative Decoding] Medusa Implementation with Top-1 proposer (#4978)

2024-07-09 18:34:02 -07:00

arctic.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

baichuan.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

bloom.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

chatglm.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

clip.py

[VLM] Calculate maximum number of multi-modal tokens by model (#6121)

2024-07-04 16:37:23 -07:00

commandr.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

dbrx.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

decilm.py

[Model] Add base class for LoRA-supported models (#5018)

2024-06-27 16:03:04 +08:00

deepseek_v2.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

deepseek.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

falcon.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

gemma2.py

[Kernel][Model] logits_soft_cap for Gemma2 with flashinfer (#6051)

2024-07-04 16:35:51 -07:00

gemma.py

[Model] Add PaliGemma (#5189)

2024-07-07 09:25:50 +08:00

gpt2.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

gpt_bigcode.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

gpt_j.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

gpt_neox.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

interfaces.py

[vlm] Remove vision language config. (#6089)

2024-07-03 22:14:16 +00:00

internlm2.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

jais.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

jamba.py

[Bugfix] Mamba cache Cuda Graph padding (#6214)

2024-07-08 11:25:51 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

llama.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

llava_next.py

[VLM] Cleanup validation and update docs (#6149)

2024-07-05 05:49:38 +00:00

llava.py

[VLM] Cleanup validation and update docs (#6149)

2024-07-05 05:49:38 +00:00

medusa.py

[Speculative Decoding] Medusa Implementation with Top-1 proposer (#4978)

2024-07-09 18:34:02 -07:00

minicpm.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

mixtral_quant.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

mixtral.py

[Bugfix] Support 2D input shape in MoE layer (#6287)

2024-07-10 09:03:16 -04:00

mlp_speculator.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

mpt.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

olmo.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

opt.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

orion.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

paligemma.py

[Model] Add PaliGemma (#5189)

2024-07-07 09:25:50 +08:00

phi3_small.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

phi3v.py

[VLM] Cleanup validation and update docs (#6149)

2024-07-05 05:49:38 +00:00

phi.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

qwen2_moe.py

[Bugfix] Support 2D input shape in MoE layer (#6287)

2024-07-10 09:03:16 -04:00

qwen2.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

qwen.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

stablelm.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

starcoder2.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

utils.py

[Core] Dynamic image size support for VLMs (#5276)

2024-07-02 20:34:00 -07:00

xverse.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00