Jee Li 8af890a865

Enable more models to inference based on LoRA (#3382) ...

Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

2024-03-25 18:09:31 -07:00

..

bgmv_bf16_bf16_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_bf16_bf16_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_bf16_fp16_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_bf16_fp16_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_bf16_fp32_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_bf16_fp32_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_config.h

Enable more models to inference based on LoRA (#3382)

2024-03-25 18:09:31 -07:00

bgmv_fp16_bf16_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp16_bf16_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp16_fp16_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp16_fp16_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp16_fp32_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp16_fp32_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp32_bf16_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp32_bf16_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp32_fp16_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp32_fp16_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp32_fp32_bf16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_fp32_fp32_fp16.cu

Speed up Punica compilation (#2632)

2024-01-27 17:46:56 -08:00

bgmv_impl.cuh

[Experimental] Add multi-LoRA support (#1804)

2024-01-23 15:26:37 -08:00

generator.py

[Misc] fix line length for entire codebase (#3444)

2024-03-16 00:36:29 -07:00

vec_dtypes.cuh

[Experimental] Add multi-LoRA support (#1804)

2024-01-23 15:26:37 -08:00