software-engineering/spark-vllm-docker
2
0
Fork 0
Code Issues Actions Packages Projects Releases Wiki Activity

Updated README

Browse Source
This commit is contained in:
Eugene Rakhmatulin
2026-04-13 11:27:57 -07:00
parent cf4cb35356
commit c026c92bd0
1 changed files with 12 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
README.md
View File

@@ -135,6 +135,18 @@ For periodic maintenance, I recommend using a filter: `docker builder prune --fi
## CHANGELOG ## CHANGELOG
### 2026-04-12
#### Drop-caches mod for Qwen3.5-397B
Updated Qwen3.5-397B recipe (for dual node configuration) to use the new mod `mods/drop-caches` which clears filesystem caches every minute while the container is running, resolving fastsafetensors getting stuck during loading and a few other bugs when operating close to max memory limit.
### 2026-04-11
#### Pinned PyTorch Version
Pinned PyTorch to version 2.11.0 (previously using nightly builds) to fix incompatibility with transformers 5.x and avoid torch version mismatch in builds.
### 2026-04-02 ### 2026-04-02
A new recipe for Gemma4-26B-A4B in "on-the-fly" FP8 quantization: A new recipe for Gemma4-26B-A4B in "on-the-fly" FP8 quantization: