mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-13 22:04:58 +08:00
parent
05ff90b692
commit
d940ce497e
@ -26,7 +26,7 @@ This gives you the ability to modify the codebase and test your model.
|
|||||||
------------------------
|
------------------------
|
||||||
|
|
||||||
Clone the PyTorch model code from the HuggingFace Transformers repository and put it into the `vllm/model_executor/models <https://github.com/vllm-project/vllm/tree/main/vllm/model_executor/models>`_ directory.
|
Clone the PyTorch model code from the HuggingFace Transformers repository and put it into the `vllm/model_executor/models <https://github.com/vllm-project/vllm/tree/main/vllm/model_executor/models>`_ directory.
|
||||||
For instance, vLLM's `OPT model <https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/opt.py>`_ was adpated from the HuggingFace's `modeling_opt.py <https://github.com/huggingface/transformers/blob/main/src/transformers/models/opt/modeling_opt.py>`_ file.
|
For instance, vLLM's `OPT model <https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/opt.py>`_ was adapted from the HuggingFace's `modeling_opt.py <https://github.com/huggingface/transformers/blob/main/src/transformers/models/opt/modeling_opt.py>`_ file.
|
||||||
|
|
||||||
.. warning::
|
.. warning::
|
||||||
When copying the model code, make sure to review and adhere to the code's copyright and licensing terms.
|
When copying the model code, make sure to review and adhere to the code's copyright and licensing terms.
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user