Eugene Rakhmatulin
30919581ee
Included .gitgnore in wheels
2026-04-11 17:02:39 -07:00
Eugene Rakhmatulin
b7c8616743
Pinned pytorch version
2026-04-11 11:54:46 -07:00
Eugene Rakhmatulin
8e8e850ef1
fix for new requirements structure
2026-04-10 20:14:47 -07:00
Eugene Rakhmatulin
fc08740fba
Increased uv timeout
2026-04-10 19:38:38 -07:00
Eugene Rakhmatulin
288da8e911
Mod to fix Gemma4 tool parser
2026-04-04 16:48:07 -07:00
Eugene Rakhmatulin
7bc4e4ce5e
Fixes #158 by adding build args to gemma4 recipe
2026-04-04 10:46:06 -07:00
Eugene Rakhmatulin
49d6d9fefd
Removed PR2927 as it's been merged
2026-04-03 16:56:00 -07:00
Eugene Rakhmatulin
4afca860a5
Fix broken compilation (PR 38919)
2026-04-03 10:22:10 -07:00
Eugene Rakhmatulin
ed32612cdd
A recipe for Gemma4-26B
2026-04-02 23:53:55 -07:00
Eugene Rakhmatulin
44808f7018
Apply vLLM PR 35568
2026-04-02 17:13:54 -07:00
Eugene Rakhmatulin
12caec228e
switching gpt-oss-120b to solo only for now
2026-04-01 10:27:50 -07:00
Eugene Rakhmatulin
27eb35f08d
Fixed 4x qwen recipe
2026-04-01 10:09:01 -07:00
eugr
3335540972
Merge branch 'pr-152'
2026-04-01 08:59:01 -07:00
eugr
ae25d64ac0
Changed CUTLASS ref for mxfp4 build
2026-04-01 08:58:31 -07:00
Eugene Rakhmatulin
a770865834
Updated PRs to apply
2026-04-01 08:31:34 -07:00
Artyom
7b47235463
Pin nvidia-nvshmem-cu13 to <3.6 in Dockerfile.mxfp4
...
nvidia-nvshmem-cu13 3.6.5 (released Mar 24) introduced a breaking
change — nvshmemi_device_state_d was removed from NVSHMEM headers,
which breaks FlashInfer AOT compilation of nvshmem_binding.cu.
2026-04-01 07:38:53 +02:00
Eugene Rakhmatulin
3a3ab98b3e
Temporarily added PR2897 to Dockerfile
2026-03-31 22:06:08 -07:00
Eugene Rakhmatulin
23fb7dcc20
Merge branch '3-node-autodiscover'
2026-03-31 18:22:23 -07:00
Eugene Rakhmatulin
c4860b86a2
Updated README with 3-node support
2026-03-31 18:19:22 -07:00
Eugene Rakhmatulin
044557943c
Bugfixes
2026-03-31 17:49:17 -07:00
Eugene Rakhmatulin
ead749239d
Bugfix
2026-03-31 16:57:56 -07:00
Eugene Rakhmatulin
a889fed254
Updated README
2026-03-31 16:54:19 -07:00
Eugene Rakhmatulin
e89104d91b
Always rerun discovery when --discover is specified
2026-03-31 16:25:05 -07:00
Eugene Rakhmatulin
15a04ada32
Bug fixes
2026-03-31 16:20:23 -07:00
Eugene Rakhmatulin
a467a7a0bd
Updated README for 3-node
2026-03-31 13:47:04 -07:00
Eugene Rakhmatulin
48318380f9
Bugfix
2026-03-31 13:41:35 -07:00
Eugene Rakhmatulin
287d3c72e5
Fix for forced autodiscovery
2026-03-31 13:34:59 -07:00
Eugene Rakhmatulin
9370b2bb34
Don't start the cluster if only --setup/--discover is specified
2026-03-31 13:29:56 -07:00
Eugene Rakhmatulin
bb177383ff
Bugfix in autodiscovery dedup
2026-03-31 12:46:15 -07:00
Eugene Rakhmatulin
7f0be29fcc
Handle edge case when two sparks have both cables plugged and assigned IPs
2026-03-31 11:59:03 -07:00
Eugene Rakhmatulin
41c0ce2c9a
Fixed FI PR
2026-03-30 14:25:42 -07:00
Eugene Rakhmatulin
45494688d1
Updated README, added NVFP4 fix
2026-03-30 11:45:40 -07:00
Eugene Rakhmatulin
a3201f8873
--flashinfer-ref / --apply-flashinfer-pr
2026-03-29 22:40:35 -07:00
Eugene Rakhmatulin
e471ca2436
Don't copy if -c is not specified
2026-03-28 18:12:32 -07:00
Eugene Rakhmatulin
32674c2619
removed temporary patch as it causes more issues.
2026-03-28 17:49:17 -07:00
Eugene Rakhmatulin
47f5f931b5
Allow to specify config file when doing setup
2026-03-28 14:55:31 -07:00
Eugene Rakhmatulin
d37217bad0
moved PR patch before the requirements patching
2026-03-28 09:22:19 -07:00
Eugene Rakhmatulin
e70c87b4f6
Added PR38423 (temp)
2026-03-28 08:50:54 -07:00
Eugene Rakhmatulin
c1a6cec074
Updated documentation; default image tags in build script
2026-03-27 16:41:09 -07:00
Eugene Rakhmatulin
51d69c5c17
commenting out non-applicable PRs
2026-03-27 16:15:54 -07:00
Eugene Rakhmatulin
e7f2ee692f
Added temporary patch to apply PR38126 that fixes broken NVFP4 quants
2026-03-27 09:30:26 -07:00
Eugene Rakhmatulin
101ae6fd56
Merge branch 'main' into 3-node-autodiscover
2026-03-27 09:02:10 -07:00
Eugene Rakhmatulin
f4ca15ce18
Made autoround mod optional to support latest version of vLLM. Fixes #144 .
2026-03-27 09:00:50 -07:00
Eugene Rakhmatulin
3d918e0b82
Merge branch '3-node' into 3-node-autodiscover
2026-03-27 07:51:08 -07:00
eugr
47a896d722
Removed expert-parallel from 3x-node Qwen
2026-03-26 22:44:48 -07:00
Eugene Rakhmatulin
0fa585f909
Fix typo in pipeline_parallel setting in Qwen3.5-397B-INT4-Autoround recipe
2026-03-26 18:43:17 -07:00
Eugene Rakhmatulin
cecec74828
Add recipe for Qwen3.5-397B-INT4-Autoround in pipeline-parallel mode
2026-03-26 18:41:57 -07:00
Eugene Rakhmatulin
c8ee2a2511
Perform node count check in any mode
2026-03-26 18:15:09 -07:00
Eugene Rakhmatulin
ce293b5f05
Additional checks for parallelism and cluster size
2026-03-26 17:52:47 -07:00
Eugene Rakhmatulin
f872cc17a8
Fix for --setup behavior
2026-03-26 16:49:09 -07:00
