Jee Jee Li b278557935

[Kernel][LoRA]Punica prefill kernels fusion (#11234) ...

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Zhonghua Deng <abatom@163.com>

2025-01-07 04:01:39 +00:00

..

data

[mypy] Enable type checking for test directory (#5017)

2024-06-15 04:45:31 +00:00

__init__.py

[Experimental] Add multi-LoRA support (#1804)

2024-01-23 15:26:37 -08:00

conftest.py

[MODEL] LoRA support for Jamba model (#11209)

2024-12-27 17:58:21 +00:00

test_baichuan.py

[MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510)

2024-10-18 14:30:55 -07:00

test_chatglm3_tp.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_gemma.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_jamba.py

[MODEL] LoRA support for Jamba model (#11209)

2024-12-27 17:58:21 +00:00

test_layers.py

[Misc][LoRA] Abstract PunicaWrapper (#10955)

2024-12-09 12:54:44 -08:00

test_llama_tp.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_long_context.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_lora_bias_e2e.py

[LoRA] Adds support for bias in LoRA (#5733)

2024-11-12 11:08:40 -08:00

test_lora_checkpoints.py

[Misc][LoRA] Fix LoRA weight mapper (#11495)

2024-12-26 15:52:48 +08:00

test_lora_huggingface.py

[Core] Support dynamically loading Lora adapter from HuggingFace (#6234)

2024-07-22 15:42:40 -07:00

test_lora_manager.py

[Misc][LoRA] Support Rank Stabilized LoRA (RSLoRA) (#6909)

2024-12-30 22:15:58 -08:00

test_minicpmv_tp.py

[Kernel][LoRA]Punica prefill kernels fusion (#11234)

2025-01-07 04:01:39 +00:00

test_mixtral.py

[Bugfix] Fix fully sharded LoRAs with Mixtral (#11390)

2024-12-22 23:25:10 +08:00

test_phi.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_punica_sizes.py

[Kernel][LoRA]Punica prefill kernels fusion (#11234)

2025-01-07 04:01:39 +00:00

test_punica_variation.py

[Kernel][LoRA]Punica prefill kernels fusion (#11234)

2025-01-07 04:01:39 +00:00

test_quant_model.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_qwen2vl.py

[Misc] Optimize Qwen2-VL LoRA test (#11663)

2025-01-01 14:42:23 +08:00

test_tokenizer_group.py

[LoRA] Change lora_tokenizers capacity (#10796)

2024-12-04 17:40:16 +00:00

test_utils.py

[LoRA] Adds support for bias in LoRA (#5733)

2024-11-12 11:08:40 -08:00

test_worker.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

utils.py

[Kernel][LoRA]Punica prefill kernels fusion (#11234)

2025-01-07 04:01:39 +00:00