Skip to content

Commit 9237442

Browse files
authored
doc: use trtllm-llmapi-launch for multi-node Triton (#772)
Signed-off-by: Aurelien Chartier <2567591+achartier@users.noreply.github.com>
1 parent de54e7f commit 9237442

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/llmapi.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -102,7 +102,7 @@ srun -N 2 \
102102
--mpi=pmix \
103103
--container-image=<your image> \
104104
--container-mounts=$(pwd)/tensorrt_llm/:/code \
105-
bash /code/triton_backend/scripts/triton_task.sh
105+
trtllm-llmapi-launch /opt/tritonserver/bin/tritonserver --model-repository llmapi_repo
106106
107107
```
108108

0 commit comments

Comments
 (0)