software-engineering/spark-vllm-docker
2
0
Fork 0
Code Issues Actions Packages Projects Releases Wiki Activity

Pin nvidia-nvshmem-cu13 to <3.6 in Dockerfile.mxfp4

Browse Source 
nvidia-nvshmem-cu13 3.6.5 (released Mar 24) introduced a breaking
change — nvshmemi_device_state_d was removed from NVSHMEM headers,
which breaks FlashInfer AOT compilation of nvshmem_binding.cu.
This commit is contained in:
Artyom
2026-04-01 07:38:53 +02:00
parent 23fb7dcc20
commit 7b47235463
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
Dockerfile.mxfp4
View File

@@ -101,7 +101,7 @@ ARG FLASHINFER_SHA=f349e52496a72a00d8c4ac02c7a1e38523ff7194
ARG CUTLASS_SHA=c7516ad20f3d022fdbc93e9468643bf3b577e02c ARG CUTLASS_SHA=c7516ad20f3d022fdbc93e9468643bf3b577e02c
RUN --mount=type=cache,id=uv-cache,target=/root/.cache/uv \ RUN --mount=type=cache,id=uv-cache,target=/root/.cache/uv \
uv pip install nvidia-nvshmem-cu13 "apache-tvm-ffi<0.2" uv pip install "nvidia-nvshmem-cu13<3.6" "apache-tvm-ffi<0.2"
# Clone FlashInfer (cached for faster rebuilds) # Clone FlashInfer (cached for faster rebuilds)
RUN --mount=type=cache,id=git-flashinfer,target=/git-cache/flashinfer \ RUN --mount=type=cache,id=git-flashinfer,target=/git-cache/flashinfer \
@@ -272,7 +272,7 @@ ENV PATH=$VLLM_BASE_DIR:$PATH
# Final extra deps # Final extra deps
RUN --mount=type=cache,id=uv-cache,target=/root/.cache/uv \ RUN --mount=type=cache,id=uv-cache,target=/root/.cache/uv \
uv pip install ray[default] fastsafetensors nvidia-nvshmem-cu13 uv pip install ray[default] fastsafetensors "nvidia-nvshmem-cu13<3.6"
# Build metadata (generated by build-and-copy.sh) # Build metadata (generated by build-and-copy.sh)
COPY build-metadata.yaml /workspace/build-metadata.yaml COPY build-metadata.yaml /workspace/build-metadata.yaml