Eugene Rakhmatulin
|
518dc0108b
|
moved deps buster
|
2026-01-30 15:25:54 -08:00 |
|
Eugene Rakhmatulin
|
57c890b10c
|
Reduced MXFP4 container size
|
2026-01-30 15:18:42 -08:00 |
|
Eugene Rakhmatulin
|
008af21383
|
Merge branch 'main' into pytorch-base
|
2026-01-30 13:37:03 -08:00 |
|
Eugene Rakhmatulin
|
a13c7d3007
|
cosmetic changes
|
2026-01-30 13:26:57 -08:00 |
|
Eugene Rakhmatulin
|
7dd0642621
|
Reduced final image size
|
2026-01-30 13:16:55 -08:00 |
|
Eugene Rakhmatulin
|
be19675980
|
Fixed initial vllm source fetch if not using main branch
|
2026-01-30 11:24:51 -08:00 |
|
Eugene Rakhmatulin
|
3a68e1ca46
|
Fixed #25
|
2026-01-30 11:20:29 -08:00 |
|
Eugene Rakhmatulin
|
af6d5eae32
|
Temporarily removing incompatible triton-kernels
|
2026-01-30 11:17:38 -08:00 |
|
Eugene Rakhmatulin
|
7d232a305a
|
Reverted to Torch 2.9.1 in the source build to address #24
|
2026-01-30 10:43:12 -08:00 |
|
Eugene Rakhmatulin
|
34bd3ae39c
|
Fixed fetching vllm source code in MXFP4 version.
|
2026-01-30 09:07:01 -08:00 |
|
Eugene Rakhmatulin
|
458439706a
|
Build flashinfer from source
|
2026-01-30 09:05:22 -08:00 |
|
Eugene Rakhmatulin
|
ef0f996df6
|
Bumped base image version; reverted Triton to 3.5.1
|
2026-01-29 23:14:43 -08:00 |
|
Eugene Rakhmatulin
|
0ac438b4dd
|
Some optimizations
|
2026-01-29 22:08:05 -08:00 |
|
Eugene Rakhmatulin
|
a5b693cc1e
|
Merge branch 'main' into pytorch-base
|
2026-01-29 18:18:35 -08:00 |
|
Eugene Rakhmatulin
|
ace61c2d55
|
added new mod for glm4.7-flash-awq, solo model support.
|
2026-01-29 18:18:00 -08:00 |
|
Eugene Rakhmatulin
|
46fecd172a
|
added missing dependancy
|
2026-01-29 17:01:17 -08:00 |
|
Eugene Rakhmatulin
|
159460af0c
|
Migrated dockerfiles to pytorch-base image
|
2026-01-29 15:47:07 -08:00 |
|
Eugene Rakhmatulin
|
067bbbbb2d
|
Merge branch 'mxfp4'
|
2026-01-29 14:20:07 -08:00 |
|
Eugene Rakhmatulin
|
9a907caffc
|
mxfp4 dockerfile optimizations
|
2026-01-29 14:17:36 -08:00 |
|
Eugene Rakhmatulin
|
7a81e90cd2
|
added -e parameter
|
2026-01-29 13:06:22 -08:00 |
|
Eugene Rakhmatulin
|
53a8b45bcb
|
Added experimental MXFP4 optimizations
|
2026-01-29 11:56:17 -08:00 |
|
Eugene Rakhmatulin
|
b58ba7b19a
|
Added cubins and jit-cache
|
2026-01-29 11:42:04 -08:00 |
|
Eugene Rakhmatulin
|
36e3b7af27
|
Removed unnessesary dependencies
|
2026-01-29 09:58:44 -08:00 |
|
Eugene Rakhmatulin
|
e4b57633fe
|
moved everything to uv
|
2026-01-29 08:34:49 -08:00 |
|
Eugene Rakhmatulin
|
a3afb6f313
|
Merge branch 'main' into mxfp4
|
2026-01-28 13:25:26 -08:00 |
|
Eugene Rakhmatulin
|
74c02c37c2
|
warning message about wheel builds
|
2026-01-28 13:25:02 -08:00 |
|
Eugene Rakhmatulin
|
cef3727f26
|
Updated SHA for repos
|
2026-01-28 13:20:03 -08:00 |
|
Eugene Rakhmatulin
|
6b11902cc8
|
Updated README
|
2026-01-26 23:18:27 -08:00 |
|
Eugene Rakhmatulin
|
564afc1f6b
|
Working MXFP4 fork, updated build script
|
2026-01-26 22:31:46 -08:00 |
|
Eugene Rakhmatulin
|
90c8b30276
|
Merge branch 'main' into mxfp4
|
2026-01-26 16:17:58 -08:00 |
|
Eugene Rakhmatulin
|
e817f3dbec
|
Updated Triton version to 3.6.0
|
2026-01-26 14:24:58 -08:00 |
|
Eugene Rakhmatulin
|
aece2fad78
|
Initial import of MXFP4 branch
|
2026-01-24 22:40:36 -08:00 |
|
Eugene Rakhmatulin
|
25a16ef6c2
|
Fixed #11 and #12 - added a new dependency for OpenCV
|
2026-01-19 12:07:15 -08:00 |
|
Eugene Rakhmatulin
|
cd7678fe9f
|
Added MIT license
|
2026-01-13 19:38:24 +00:00 |
|
Eugene Rakhmatulin
|
18a25c8382
|
Updated README
|
2026-01-08 14:38:12 -08:00 |
|
Eugene Rakhmatulin
|
4ee090f632
|
Updated README re: hf-download option
|
2025-12-24 08:37:33 -08:00 |
|
Eugene Rakhmatulin
|
2a568481f0
|
Model download support
|
2025-12-24 00:30:15 -08:00 |
|
Eugene Rakhmatulin
|
04e6d27b84
|
Updated README re: mods functionality
|
2025-12-23 18:09:59 -08:00 |
|
Eugene Rakhmatulin
|
9ad61078ce
|
Added multiple mods support
|
2025-12-23 17:45:55 -08:00 |
|
Eugene Rakhmatulin
|
c90a6d0bde
|
Fixed remote docker execution
|
2025-12-23 13:49:38 -08:00 |
|
Eugene Rakhmatulin
|
19dec79c5c
|
initial mod implementation
|
2025-12-23 13:38:10 -08:00 |
|
Eugene Rakhmatulin
|
a9b1bb5947
|
fixed a bug with numpy version in wheels build when transformers 5 is used.
|
2025-12-21 22:53:31 -08:00 |
|
Eugene Rakhmatulin
|
1464b0dc8f
|
Display image name in launch-cluster.sh output
|
2025-12-21 22:44:01 -08:00 |
|
Eugene Rakhmatulin
|
786a50c5c7
|
Updated README
|
2025-12-21 22:41:48 -08:00 |
|
Eugene Rakhmatulin
|
1139a37324
|
Added transformers v5 support
|
2025-12-21 22:41:03 -08:00 |
|
Eugene Rakhmatulin
|
c37053adf6
|
Updated README
|
2025-12-21 14:57:35 -08:00 |
|
Eugene Rakhmatulin
|
82802f0cad
|
Added Quickstart section to README
|
2025-12-21 14:53:05 -08:00 |
|
Eugene Rakhmatulin
|
11db634aad
|
Switch to uv in the main Dockerfile
|
2025-12-21 13:28:40 -08:00 |
|
Eugene Rakhmatulin
|
bbd3469549
|
Support vLLM release wheels
|
2025-12-21 11:15:52 -08:00 |
|
Eugene Rakhmatulin
|
2aa545a810
|
Added PSA about build cache
|
2025-12-21 00:49:59 -08:00 |
|