Zhonghua Deng d345f409b7

[V1] EngineCore supports profiling (#10564) ...

Signed-off-by: Abatom <abzhonghua@gmail.com>

2024-11-22 17:16:15 -08:00

..

attention

[torch.compile] support all attention backends (#10558)

2024-11-22 14:04:42 -08:00

core

[v1] Refactor KVCacheManager for more hash input than token ids (#10507)

2024-11-22 23:27:25 +00:00

engine

[V1] EngineCore supports profiling (#10564)

2024-11-22 17:16:15 -08:00

executor

[V1] Fix Configs (#9971)

2024-11-04 00:24:40 +00:00

sample

[V1] Support per-request seed (#9945)

2024-11-03 09:14:17 -08:00

worker

[V1] EngineCore supports profiling (#10564)

2024-11-22 17:16:15 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

outputs.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

request.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00

serial_utils.py

[V1] Use pickle for serializing EngineCoreRequest & Add multimodal inputs to EngineCoreRequest (#10245)

2024-11-12 08:57:14 -08:00

utils.py

[V1] Add all_token_ids attribute to Request (#10135)

2024-11-07 17:08:24 -08:00