Jong-hun Shin 4934d49274

Support GPT-NeoX Models without attention biases (#2301)

2023-12-30 11:42:04 -05:00

..

__init__.py

Added DeciLM-7b and DeciLM-7b-instruct (#2062)

2023-12-19 02:29:33 -08:00

aquila.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

baichuan.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

bloom.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

chatglm.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

decilm.py

Added DeciLM-7b and DeciLM-7b-instruct (#2062)

2023-12-19 02:29:33 -08:00

falcon.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

gpt2.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

gpt_bigcode.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

gpt_j.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

gpt_neox.py

Support GPT-NeoX Models without attention biases (#2301)

2023-12-30 11:42:04 -05:00

internlm.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

llama.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

mistral.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

mixtral.py

[BugFix] Fix weight loading for Mixtral with TP (#2208)

2023-12-19 16:16:11 -08:00

mpt.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

opt.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

phi_1_5.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

qwen.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00

yi.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00