software-engineering/spark-vllm-docker
2
0
Fork 0
Code Issues Actions Packages Projects Releases Wiki Activity

Renamed recipe for qwen3.5-35b-a3b-fp8 to match others

Browse Source
This commit is contained in:
Eugene Rakhmatulin
2026-03-06 13:56:06 -08:00
parent e88426646b
commit 9dc09bd04b
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
recipes/qwen35-35b-a3b-fp8.yaml → recipes/qwen3.5-35b-a3b-fp8.yaml
View File

@@ -24,7 +24,7 @@ defaults:
host: 0.0.0.0 host: 0.0.0.0
tensor_parallel: 2 tensor_parallel: 2
gpu_memory_utilization: 0.7 gpu_memory_utilization: 0.7
max_model_len: 131072 max_model_len: 262144
max_num_batched_tokens: 16384 max_num_batched_tokens: 16384
# Environment variables # Environment variables