9 Commits

Author	SHA1	Message	Date
Cyrus Leung	3f674a49b5	[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)	2024-08-14 17:55:42 +00:00
Peter Salas	00c3d68e45	[Frontend][Core] Add plumbing to support audio language models (#7446)	2024-08-13 17:39:33 +00:00
Cyrus Leung	7025b11d94	[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)	2024-08-13 05:33:41 +00:00
Roger Wang	e6e42e4b17	[Core][VLM] Support image embeddings as input (#6613)	2024-08-12 16:16:06 +08:00
Jungho Christopher Cho	c0d8f1636c	[Model] SiglipVisionModel ported from transformers (#6942) ... Co-authored-by: Roger Wang <ywang@roblox.com>	2024-08-05 06:22:12 +00:00
Michael Goin	f4fd390f5d	[Bugfix] Lower gemma's unloaded_params exception to warning (#7002)	2024-08-01 12:01:07 -07:00
Roger Wang	c66c7f86ac	[Bugfix] Fix PaliGemma MMP (#6930)	2024-07-30 02:20:57 -07:00
Cyrus Leung	024ad87cdc	[Bugfix] Fix dtype mismatch in PaliGemma (#6367)	2024-07-12 08:22:18 -07:00
Roger Wang	6206dcb29e	[Model] Add PaliGemma (#5189) ... Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>	2024-07-07 09:25:50 +08:00