Updated README.md and added Networking Guide.

This commit is contained in:
Eugene Rakhmatulin
2026-02-03 12:54:38 -08:00
parent 4b9ab0de7c
commit f8eb294c58
2 changed files with 236 additions and 0 deletions

View File

@@ -77,6 +77,19 @@ Then run the following command that will build and distribute image across the c
**On a single node**:
**NEW** - `launch-cluster.sh` now supports solo mode, which is now a recommended way to run the container on a single Spark:
```bash
./launch-cluster.sh --solo exec \
vllm serve \
QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ \
--port 8000 --host 0.0.0.0 \
--gpu-memory-utilization 0.7 \
--load-format fastsafetensors
```
**To launch using regular `docker run`**
```bash
docker run \
--privileged \