再使用 A100 部署遇到:

ERROR 02-11 17:02:05 worker_base.py:572]     assert builder.options.allow_fp8e4nv, "fp8e4nv data type is not supported on CUDA arch < 89"ERROR 02-11 17:02:05 worker_base.py:572] AssertionError: fp8e4nv data type is not supported on CUDA arch < 89
该模型能否支持 A100
This commit is contained in:
muhuadao 2025-02-11 11:08:24 +00:00
parent d0dbc94035
commit c4540c8c46

Diff Content Not Available