software-engineering/spark-vllm-docker
2
0
Fork 0
Code Issues Actions Packages Projects Releases Wiki Activity

Changed KV type to fp8 in qwen3-coder-next recipe and reduced default context size to 131072 to ensure it all fits in a single Spark.

Browse Source
This commit is contained in:
Eugene Rakhmatulin
2026-02-17 13:07:54 -08:00
parent 0249f1fdde
commit 5b2313dddb
2 changed files with 5 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@@ -164,7 +164,7 @@ Don't do it every time you rebuild, because it will slow down compilation times.
For periodic maintenance, I recommend using a filter: `docker builder prune --filter until=72h`
### 2026-02-14
### 2026-02-17
#### Non-Privileged Mode Support
@@ -181,6 +181,8 @@ Example usage:
./launch-cluster.sh --non-privileged --mem-limit-gb 120 --shm-size-gb 64 exec vllm serve ...
```
May result in a slightly reduced performance (within 2%) in exchange for better reliability and stability.
### 2026-02-12
Added a mod for Qwen3-Coder-Next-FP8 that fixes: