vllm/vllm/triton_utils/__init__.py
Thomas Parnell eaec4b9153
[Bugfix] Add custom Triton cache manager to resolve MoE MP issue (#6140)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Chih-Chieh-Yang <chih.chieh.yang@ibm.com>
2024-07-15 10:12:47 -07:00

7 lines
142 B
Python

from vllm.triton_utils.custom_cache_manager import (
maybe_set_triton_cache_manager)
__all__ = [
"maybe_set_triton_cache_manager",
]