Antoni Baum ad932a221d

[Core] Faster startup for LoRA enabled models (#4634)

2024-05-08 10:33:18 -07:00

..

__init__.py

[Experimental] Add multi-LoRA support (#1804)

2024-01-23 15:26:37 -08:00

fully_sharded_layers.py

[Bugfix] Fixed error in slice_lora_b for MergedQKVParallelLinearWithLora (#4609)

2024-05-07 10:59:07 -07:00

layers.py

[Bugfix] Fixed error in slice_lora_b for MergedQKVParallelLinearWithLora (#4609)

2024-05-07 10:59:07 -07:00

lora.py

[Mypy] Typing lora folder (#4337)

2024-04-25 19:13:50 +00:00

models.py

[Core] Faster startup for LoRA enabled models (#4634)

2024-05-08 10:33:18 -07:00

punica.py

[Kernel] Full Tensor Parallelism for LoRA Layers (#3524)

2024-04-27 00:03:48 -07:00

request.py

[Experimental] Add multi-LoRA support (#1804)

2024-01-23 15:26:37 -08:00

utils.py

[Kernel] Full Tensor Parallelism for LoRA Layers (#3524)

2024-04-27 00:03:48 -07:00

worker_manager.py

[Core] Faster startup for LoRA enabled models (#4634)

2024-05-08 10:33:18 -07:00