software-engineering/spark-vllm-docker
2
0
Fork 0
Code Issues Actions Packages Projects Releases Wiki Activity

Bugfixes

Browse Source
This commit is contained in:
Eugene Rakhmatulin
2026-03-31 17:49:17 -07:00
parent ead749239d
commit 044557943c
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
recipes/3x-spark-cluster/qwen3.5-397b-int4-autoround.yaml
View File

@@ -55,6 +55,7 @@ command: |
--chat-template unsloth.jinja \ --chat-template unsloth.jinja \
-tp 1 \ -tp 1 \
-pp {pipeline_parallel} \ -pp {pipeline_parallel} \
--load-format fastsafetensors \
--distributed-executor-backend ray --distributed-executor-backend ray