11 Commits

Author	SHA1	Message	Date
Jungho Christopher Cho	f97be32d1d	[VLM][Model] TP support for ViTs (#7186) ... Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com> Co-authored-by: Roger Wang <ywang@roblox.com>	2024-08-30 08:19:27 -07:00
afeldman-nm	428dd1445e	[Core] Logprobs support in Multi-step (#7652)	2024-08-29 19:19:08 -07:00
Cyrus Leung	ef9baee3c5	[Bugfix][VLM] Fix incompatibility between #7902 and #7230 (#7948)	2024-08-28 08:11:18 -07:00
Peter Salas	fab5f53e2d	[Core][VLM] Stack multimodal tensors to represent multiple images within each prompt (#7902)	2024-08-28 01:53:56 +00:00
Zijian Hu	f4fc7337bf	[Bugfix] support tie_word_embeddings for all models (#5724)	2024-08-19 20:00:04 -07:00
SangBin Cho	ff7ec82c4d	[Core] Optimize SPMD architecture with delta + serialization optimization (#7109)	2024-08-18 17:57:20 -07:00
Cyrus Leung	3f674a49b5	[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)	2024-08-14 17:55:42 +00:00
Peter Salas	00c3d68e45	[Frontend][Core] Add plumbing to support audio language models (#7446)	2024-08-13 17:39:33 +00:00
Cyrus Leung	7025b11d94	[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)	2024-08-13 05:33:41 +00:00
Roger Wang	e6e42e4b17	[Core][VLM] Support image embeddings as input (#6613)	2024-08-12 16:16:06 +08:00
Cyrus Leung	1ad86acf17	[Model] Initial support for BLIP-2 (#5920) ... Co-authored-by: ywang96 <ywang@roblox.com>	2024-07-27 11:53:07 +00:00