From 4acfa3354a2e100c88db99f4bcb5b5fc098211cb Mon Sep 17 00:00:00 2001 From: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com> Date: Thu, 1 May 2025 14:01:28 -0400 Subject: [PATCH] [ROCm] update installation guide to include build aiter from source instructions (#17542) Signed-off-by: Hongxia Yang Co-authored-by: Cyrus Leung --- .../installation/gpu/rocm.inc.md | 17 ++++++++++++++++- 1 file changed, 16 insertions(+), 1 deletion(-) diff --git a/docs/source/getting_started/installation/gpu/rocm.inc.md b/docs/source/getting_started/installation/gpu/rocm.inc.md index 21c8d7d01adeb..dc74368fe2c96 100644 --- a/docs/source/getting_started/installation/gpu/rocm.inc.md +++ b/docs/source/getting_started/installation/gpu/rocm.inc.md @@ -73,7 +73,22 @@ Currently, there are no pre-built ROCm wheels. You might need to downgrade the "ninja" version to 1.10 it is not used when compiling flash-attention-2 (e.g. `pip install ninja==1.10.2.4`) ::: -3. Build vLLM. For example, vLLM on ROCM 6.3 can be built with the following steps: +3. If you choose to build AITER yourself to use a certain branch or commit, you can build AITER using the following steps: + + ```console + python3 -m pip uninstall -y aiter + git clone --recursive https://github.com/ROCm/aiter.git + cd aiter + git checkout $AITER_BRANCH_OR_COMMIT + git submodule sync; git submodule update --init --recursive + python3 setup.py develop + ``` + + :::{note} + You will need to config the `$AITER_BRANCH_OR_COMMIT` for your purpose. + ::: + +4. Build vLLM. For example, vLLM on ROCM 6.3 can be built with the following steps: ```bash $ pip install --upgrade pip