6 Commits

Author	SHA1	Message	Date
Woosuk Kwon	a08df8322e	[TPU] Support multi-host inference (#7457)	2024-08-13 16:31:20 -07:00
Woosuk Kwon	90bab18f24	[TPU] Use mark_dynamic to reduce compilation time (#7340)	2024-08-10 18:12:22 -07:00
Woosuk Kwon	fad5576c58	[TPU] Reduce compilation time & Upgrade PyTorch XLA version (#6856)	2024-07-27 10:28:33 -07:00
Woosuk Kwon	c467dff24f	[Hardware][TPU] Support MoE with Pallas GMM kernel (#6457)	2024-07-16 09:56:28 -07:00
Woosuk Kwon	8c00f9c15d	[Docs][TPU] Add installation tip for TPU (#5761)	2024-06-21 23:09:40 -07:00
Woosuk Kwon	1a8bfd92d5	[Hardware] Initial TPU integration (#5292)	2024-06-12 11:53:03 -07:00