mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-15 17:25:01 +08:00
7 lines
462 B
Markdown
7 lines
462 B
Markdown
---
|
|
title: NVIDIA Triton
|
|
---
|
|
[](){ #deployment-triton }
|
|
|
|
The [Triton Inference Server](https://github.com/triton-inference-server) hosts a tutorial demonstrating how to quickly deploy a simple [facebook/opt-125m](https://huggingface.co/facebook/opt-125m) model using vLLM. Please see [Deploying a vLLM model in Triton](https://github.com/triton-inference-server/tutorials/blob/main/Quick_Deploy/vLLM/README.md#deploying-a-vllm-model-in-triton) for more details.
|