From 6d6e4dfe50bf769f316296dd44163f69f3df4c1d Mon Sep 17 00:00:00 2001 From: eugr Date: Mon, 24 Nov 2025 16:23:00 -0800 Subject: [PATCH] Updated README --- README.md | 35 +++++++++++++++++++++++++++++++++++ 1 file changed, 35 insertions(+) diff --git a/README.md b/README.md index ef41382..8057a15 100644 --- a/README.md +++ b/README.md @@ -53,9 +53,44 @@ docker run -it --rm \ --ipc=host \ --privileged \ --name vllm_node \ + -v ~/.cache/huggingface:/root/.cache/huggingface \ vllm-node bash ``` +Or if you want to start the cluster node (head or regular), you can launch with the run-cluster.sh script (see details below): + +**On head node:** + +```bash +docker run --privileged --gpus all -it --rm \ + --ipc=host --shm-size 10.24g \ + --network host \ + --name vllm_node \ + -v ~/.cache/huggingface:/root/.cache/huggingface \ + vllm-node ./run-cluster-node.sh \ + --role head + --host-ip 192.168.177.11 + --eth-if enp1s0f1np1 + --ib-if rocep1s0f1 +``` + +**On worker node** + +```bash +docker run --privileged --gpus all -it --rm \ + --ipc=host --shm-size 10.24g \ + --network host \ + --name vllm_node \ + -v ~/.cache/huggingface:/root/.cache/huggingface \ + vllm-node ./run-cluster-node.sh \ + --role node + --host-ip 192.168.177.12 + --eth-if enp1s0f1np1 + --ib-if rocep1s0f1 + --head-ip 192.168.177.11 +``` + + **Flags Explained:** * `--net=host`: **Required.** Ray needs full control over network ports; port mapping is insufficient for multi-node clusters.