software-engineering/spark-vllm-docker
2
0
Fork 0
Code Issues Actions Packages Projects Releases Wiki Activity

Added Table of Contents to README

Browse Source
This commit is contained in:
Eugene Rakhmatulin
2025-12-18 15:43:09 -08:00
parent 8be691e806
commit e6efd668cd
1 changed files with 13 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

13
README.md
View File

@@ -3,6 +3,19 @@
This repository contains the Docker configuration and startup scripts to run a multi-node vLLM inference cluster using Ray. It supports InfiniBand/RDMA (NCCL) and custom environment configuration for high-performance setups. This repository contains the Docker configuration and startup scripts to run a multi-node vLLM inference cluster using Ray. It supports InfiniBand/RDMA (NCCL) and custom environment configuration for high-performance setups.
## Table of Contents
- [DISCLAIMER](#disclaimer)
- [CHANGELOG](#changelog)
- [1. Building the Docker Image](#1-building-the-docker-image)
- [2. Launching the Cluster (Recommended)](#2-launching-the-cluster-recommended)
- [3. Running the Container (Manual)](#3-running-the-container-manual)
- [4. Using `run-cluster-node.sh` (Internal)](#4-using-run-cluster-nodesh-internal)
- [5. Configuration Details](#5-configuration-details)
- [6. Using cluster mode for inference](#6-using-cluster-mode-for-inference)
- [7. Fastsafetensors](#7-fastsafetensors)
- [8. Benchmarking](#8-benchmarking)
## DISCLAIMER ## DISCLAIMER
This repository is not affiliated with NVIDIA or their subsidiaries. The content is provided as a reference material only, not intended for production use. This repository is not affiliated with NVIDIA or their subsidiaries. The content is provided as a reference material only, not intended for production use.