Woosuk Kwon cd4a72a28d

[V1][Spec decode] Move drafter to model runner (#13363) ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2025-02-17 15:40:12 -08:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[WIP] TPU V1 Support Refactored (#13049)

2025-02-14 00:21:53 -08:00

gpu_input_batch.py

[V1][Spec decode] Move drafter to model runner (#13363)

2025-02-17 15:40:12 -08:00

gpu_model_runner.py

[V1][Spec decode] Move drafter to model runner (#13363)

2025-02-17 15:40:12 -08:00

gpu_worker.py

[V1] LoRA - Enable Serving Usecase (#12883)

2025-02-14 14:21:12 +08:00

lora_model_runner_mixin.py

[V1] LoRA - Enable Serving Usecase (#12883)

2025-02-14 14:21:12 +08:00

tpu_model_runner.py

[V1][Spec decode] Move drafter to model runner (#13363)

2025-02-17 15:40:12 -08:00

tpu_worker.py

[WIP] TPU V1 Support Refactored (#13049)

2025-02-14 00:21:53 -08:00

worker_base.py

[V1][Core] Add worker_base for v1 worker (#12816)

2025-02-13 20:35:18 +08:00