57 Commits

Author	SHA1	Message	Date
Cyrus Leung	7025b11d94	[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)	2024-08-13 05:33:41 +00:00
Woosuk Kwon	805a8a75f2	[Misc] Support attention logits soft-capping with flash-attn (#7022)	2024-08-01 13:14:37 -07:00
Michael Goin	f4fd390f5d	[Bugfix] Lower gemma's unloaded_params exception to warning (#7002)	2024-08-01 12:01:07 -07:00
Lily Liu	69ec3ca14c	[Kernel][Model] logits_soft_cap for Gemma2 with flashinfer (#6051) ... Co-authored-by: Simon Mo <simon.mo@hey.com>	2024-07-04 16:35:51 -07:00
Qubitium-ModelCloud	ee93f4f92a	[CORE] Quantized lm-head Framework (#4442) ... Co-authored-by: Robert Shaw <rshaw@neuralmagic.com> Co-authored-by: ZX <zx@lbx.dev>	2024-07-02 22:25:17 +00:00
Murali Andoorveedu	c5832d2ae9	[Core] Pipeline Parallel Support (#4412) ... Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>	2024-07-02 10:58:08 -07:00
Woosuk Kwon	79c92c7c8a	[Model] Add Gemma 2 (#5908)	2024-06-27 13:33:56 -07:00