8 Commits

Author	SHA1	Message	Date
Mor Zusman	9fb12f7848	[BugFix][Kernel] Fix Illegal memory access in causal_conv1d in H100 (#9838) ... Signed-off-by: mzusman <mor.zusmann@gmail.com>	2024-10-31 20:06:25 +00:00
wangshuai09	622b7ab955	[Hardware] using current_platform.seed_everything (#9785) ... Signed-off-by: wangshuai09 <391746016@qq.com>	2024-10-29 14:47:44 +00:00
Mor Zusman	fb60ae9b91	[Kernel][Model] Improve continuous batching for Jamba and Mamba (#9189)	2024-10-16 12:12:43 -04:00
Mor Zusman	f13a07b1f8	[Kernel][Model] Varlen prefill + Prefill chunking support for mamba kernels and Jamba model (#8533)	2024-09-29 17:35:58 -04:00
bnellnm	300da09177	[Kernel] Fullgraph and opcheck tests (#8479)	2024-09-25 08:35:52 -06:00
Cyrus Leung	6ffa3f314c	[CI/Build] Avoid CUDA initialization (#8534)	2024-09-18 10:38:11 +00:00
Tyler Michael Smith	8110e44529	[Kernel] Change interface to Mamba causal_conv1d_update for continuous batching (#8012)	2024-09-17 23:44:27 +00:00
Mor Zusman	fdd9daafa3	[Kernel/Model] Migrate mamba_ssm and causal_conv1d kernels to vLLM (#7651)	2024-08-28 15:06:52 -07:00