219 Commits

Author	SHA1	Message	Date
youkaichao	e4d652ea3e	[torch.compile] integration with compilation control (#9058)	2024-10-10 12:39:36 -07:00
Cyrus Leung	26a68d5d7e	[CI/Build] Add test decorator for minimum GPU memory (#8925)	2024-09-29 02:50:51 +00:00
Tyler Titsworth	260024a374	[Bugfix][Intel] Fix XPU Dockerfile Build (#7824) ... Signed-off-by: tylertitsworth <tyler.titsworth@intel.com> Co-authored-by: youkaichao <youkaichao@126.com>	2024-09-27 23:45:50 -07:00
Cyrus Leung	6ffa3f314c	[CI/Build] Avoid CUDA initialization (#8534)	2024-09-18 10:38:11 +00:00
Li, Jiang	0b952af458	[Hardware][Intel] Support compressed-tensor W8A8 for CPU backend (#7257)	2024-09-11 09:46:46 -07:00
youkaichao	bc6e42a9b1	[hardware][rocm] allow rocm to override default env var (#7926)	2024-08-27 19:50:06 -07:00
youkaichao	ed6f002d33	[cuda][misc] error on empty CUDA_VISIBLE_DEVICES (#7924)	2024-08-27 12:06:11 -07:00
youkaichao	70c094ade6	[misc][cuda] improve pynvml warning (#7852)	2024-08-25 14:30:09 -07:00
Woosuk Kwon	eeee1c3b1a	[TPU] Avoid initializing TPU runtime in is_tpu (#7763)	2024-08-21 21:31:49 -07:00
youkaichao	ad28a74beb	[misc][cuda] add warning for pynvml user (#7675)	2024-08-20 00:35:09 -07:00
youkaichao	e54ebc2f8f	[doc] fix doc build error caused by msgspec (#7659)	2024-08-19 17:50:59 -07:00
youkaichao	eed020f673	[misc] use nvml to get consistent device name (#7582)	2024-08-16 21:15:13 -07:00
youkaichao	4d2dc5072b	[hardware] unify usage of is_tpu to current_platform.is_tpu() (#7102)	2024-08-13 00:16:42 -07:00
Cyrus Leung	9ba85bc152	[mypy] Misc. typing improvements (#7417)	2024-08-13 09:20:20 +08:00
youkaichao	639159b2a6	[distributed][misc] add specialized method for cuda platform (#7249)	2024-08-07 08:54:52 -07:00
Woosuk Kwon	42de2cefcb	[Misc] Add a wrapper for torch.inference_mode (#6618)	2024-07-21 18:43:11 -07:00
Benjamin Muskalla	b422d4961a	[CI/Build] Enable mypy typing for remaining folders (#6268)	2024-07-10 22:15:55 +08:00
youkaichao	a3c9435d93	[hardware][cuda] use device id under CUDA_VISIBLE_DEVICES for get_device_capability (#6216)	2024-07-08 20:02:15 -07:00
youkaichao	482045ee77	[hardware][misc] introduce platform abstraction (#6080)	2024-07-02 20:12:22 -07:00