Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• c655bca1bf use vlmm optomized for spark main HaimKortovich 2026-05-11 13:07:56 -05:00
• e991993636 optimize model HaimKortovich 2026-05-11 13:03:44 -05:00
• 689f7665af set fashinfer HaimKortovich 2026-05-11 11:59:32 -05:00
• 93d23bc46a remove swap arg HaimKortovich 2026-05-11 11:57:48 -05:00
• 82a411166a use less gpu and add swap HaimKortovich 2026-05-11 11:53:13 -05:00
• 9ea69aedb4 decrease memory HaimKortovich 2026-05-11 11:38:22 -05:00
• 2d2df4bb0a use defaults HaimKortovich 2026-05-11 11:36:59 -05:00
• db6efb188c fix quantization HaimKortovich 2026-05-11 11:36:17 -05:00
• ce65c6435b remove option HaimKortovich 2026-05-11 11:35:29 -05:00
• 08106b6693 use correct dtype HaimKortovich 2026-05-11 11:34:39 -05:00
• 719a6e3d11 fix list HaimKortovich 2026-05-11 11:33:45 -05:00
• 855cce3c54 fix list HaimKortovich 2026-05-11 11:32:56 -05:00
• 9594d6311a optimize model HaimKortovich 2026-05-11 11:30:01 -05:00
• b70f8063a8 fix memory util HaimKortovich 2026-05-08 09:42:50 -05:00
• 2f922279ef add more gpu and change model name served HaimKortovich 2026-05-08 09:30:48 -05:00
• de12558021 set limit HaimKortovich 2026-05-07 16:44:01 -05:00
• ab34446bcf set size limit HaimKortovich 2026-05-07 16:43:11 -05:00
• 95bcb06811 fix indent HaimKortovich 2026-05-07 16:19:49 -05:00
• c096777eca set probes HaimKortovich 2026-05-07 16:19:05 -05:00
• a092b6ffa5 set probes HaimKortovich 2026-05-07 16:16:21 -05:00
• 64abcb1483 addd parameters HaimKortovich 2026-05-07 16:05:19 -05:00
• 6ef281e06f set groupid HaimKortovich 2026-05-07 16:01:39 -05:00
• 62a42ed8f0 change backend HaimKortovich 2026-05-07 15:57:11 -05:00
• f9d81c3a17 set profile HaimKortovich 2026-05-07 15:33:04 -05:00
• 72bbe8789b disable download HaimKortovich 2026-05-07 15:31:43 -05:00
• 4dc4fc5fdf force backend HaimKortovich 2026-05-07 15:29:45 -05:00
• 6491c6cebe use vllm profiel HaimKortovich 2026-05-07 15:12:03 -05:00
• 1177264fd2 set profile HaimKortovich 2026-05-07 15:08:50 -05:00
• 40a7b1e117 fix backendref HaimKortovich 2026-05-07 15:04:49 -05:00
• c5db9144a9 pass args HaimKortovich 2026-05-07 15:03:56 -05:00
• 1a4e73b755 use vlmm openai HaimKortovich 2026-05-07 14:59:55 -05:00
• 2229daa1a3 use hf-api-secret HaimKortovich 2026-05-07 14:56:07 -05:00
• 2e1ab2ea2d try befier model HaimKortovich 2026-05-07 14:54:30 -05:00
• 5954bb5202 add HF cache HaimKortovich 2026-05-07 14:45:23 -05:00
• 138ebc8f61 add security policy HaimKortovich 2026-05-07 11:58:37 -05:00
• eca316efa4 add timeouts HaimKortovich 2026-05-07 11:42:59 -05:00
• e56d29528f set cache reuse to 1 HaimKortovich 2026-05-07 11:28:09 -05:00
• ebcc0cf045 enable cache reuse HaimKortovich 2026-05-07 11:26:30 -05:00
• 0997aa48b7 add max model len HaimKortovich 2026-05-07 11:19:11 -05:00
• 923679cb29 set env HaimKortovich 2026-05-07 11:13:23 -05:00
• 1e7630efe8 remove args for now HaimKortovich 2026-05-06 18:00:06 -05:00
• af8c9a1254 set profiles HaimKortovich 2026-05-06 17:52:14 -05:00
• 4287242035 set profiles HaimKortovich 2026-05-06 17:51:29 -05:00
• 59af501a82 set default profile HaimKortovich 2026-05-06 17:51:00 -05:00
• f602e1aec9 set string HaimKortovich 2026-05-06 17:48:20 -05:00
• da57ec24ee use qwen HaimKortovich 2026-05-06 17:46:54 -05:00
• 066554aa36 use 32b HaimKortovich 2026-05-06 17:42:18 -05:00
• 98f39b7c68 add qwen HaimKortovich 2026-05-06 17:33:57 -05:00
• e90c7eeaa8 add qwen cache HaimKortovich 2026-05-06 17:33:31 -05:00
• 7269275809 add toolchoice HaimKortovich 2026-05-06 17:22:36 -05:00
• 3989021efc use correct cert HaimKortovich 2026-05-06 17:05:16 -05:00
• 4af01f2d0a add issuer HaimKortovich 2026-05-06 17:03:36 -05:00
• 11cd367f94 allow all HaimKortovich 2026-05-06 16:49:25 -05:00
• 12020fb753 update hostname HaimKortovich 2026-05-06 16:46:17 -05:00
• 8bf88ebf2f set kustomization HaimKortovich 2026-05-06 16:37:50 -05:00
• a5416a75f3 add gateway and http route HaimKortovich 2026-05-06 16:37:39 -05:00
• 1c8cca8db0 add address pool HaimKortovich 2026-05-06 16:34:18 -05:00
• b268e01870 add metallb HaimKortovich 2026-05-06 16:32:36 -05:00
• 10ea7005d4 remove readonly HaimKortovich 2026-05-06 16:23:19 -05:00
• 2d6c9bbdfd fix model name HaimKortovich 2026-05-06 12:59:02 -05:00
• df29d77652 fix image name HaimKortovich 2026-05-06 12:53:46 -05:00
• 5e57329067 use nwer model HaimKortovich 2026-05-06 12:52:03 -05:00
• 314e730995 fix yaml HaimKortovich 2026-05-06 12:11:26 -05:00
• df78657374 add test model HaimKortovich 2026-05-06 12:07:59 -05:00
• 93fc5e52d7 fix chart name HaimKortovich 2026-05-06 12:00:43 -05:00
• 2c831b04da remove HaimKortovich 2026-05-06 11:59:24 -05:00
• b238eec199 fix typo HaimKortovich 2026-05-06 11:59:15 -05:00
• cb1ff576f1 add nim-operaotr HaimKortovich 2026-05-06 11:58:30 -05:00
• 4300d7e3cb add nim-operator HaimKortovich 2026-05-06 11:56:50 -05:00
• d877450fc0 remove granite HaimKortovich 2026-05-06 11:50:46 -05:00
• 0e50ac4e0e remove kserve HaimKortovich 2026-05-06 11:50:29 -05:00
• cb56f3838d no lb HaimKortovich 2026-05-05 15:21:10 -05:00
• 0bef50c896 use correct format HaimKortovich 2026-05-05 15:15:37 -05:00
• 778083b9f6 use correctly HaimKortovich 2026-05-05 15:13:59 -05:00
• 87f98fbca6 use alpha1 HaimKortovich 2026-05-05 15:11:49 -05:00
• 00f78688e5 set version HaimKortovich 2026-05-05 15:10:56 -05:00
• fa935586dc try v1 beta HaimKortovich 2026-05-05 15:06:11 -05:00
• ca6f6f4afc change name HaimKortovich 2026-05-05 15:04:38 -05:00
• f1306836f2 use v1 HaimKortovich 2026-05-05 15:01:07 -05:00
• a0c6b57628 add inference model HaimKortovich 2026-05-05 14:58:23 -05:00
• 973ffc99d1 change interval HaimKortovich 2026-05-05 14:56:33 -05:00
• 0d4b42a2a8 add class back HaimKortovich 2026-05-05 14:53:11 -05:00
• 40fe171ae4 dont add class yet HaimKortovich 2026-05-05 14:50:30 -05:00
• fd3e05184f remove kserve HaimKortovich 2026-05-05 14:49:36 -05:00
• 541caca9e9 depend on infra HaimKortovich 2026-05-05 14:46:46 -05:00
• 254705ca4e remove infer HaimKortovich 2026-05-05 14:30:09 -05:00
• 1cd264f559 remove servingruntime HaimKortovich 2026-05-05 14:26:59 -05:00
• f2e65a2f5c just install llmisvc HaimKortovich 2026-05-05 14:24:46 -05:00
• 981eb83ac9 create shared resources HaimKortovich 2026-05-05 14:06:17 -05:00
• 467f19f408 test tensorflow HaimKortovich 2026-05-05 14:01:20 -05:00
• b34cf2eee1 disable svc config HaimKortovich 2026-05-05 13:48:45 -05:00
• 9a3bdc2492 bump to 0.18 HaimKortovich 2026-05-05 13:45:30 -05:00
• a1f11b0cfe add serving runtimes HaimKortovich 2026-05-05 13:40:35 -05:00
• ee5939eef3 test qwen HaimKortovich 2026-05-05 13:31:20 -05:00
• 5f7c513090 add huihui inference HaimKortovich 2026-05-05 13:26:56 -05:00
• bb5dd80c82 fix issure parent ref HaimKortovich 2026-05-05 13:24:56 -05:00
• 27746aae1e change secret name HaimKortovich 2026-05-05 13:22:47 -05:00
• ab3e2935cd remove namespace HaimKortovich 2026-05-05 13:15:28 -05:00
• 6b18b26609 add kserve HaimKortovich 2026-05-05 13:14:47 -05:00
• a265d7d21a fix error HaimKortovich 2026-05-05 13:08:32 -05:00