Cyrus Leung 8f10d5e393

[Misc] Split up pooling tasks (#10820) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2024-12-11 01:28:00 -08:00

..

__init__.py

[V1] VLM - Run the mm_mapper preprocessor in the frontend process (#10640)

2024-12-03 10:33:10 +00:00

async_llm.py

[Bugfix] Backport request id validation to v0 (#11036)

2024-12-10 16:38:23 +00:00

async_stream.py

[Misc] Rename embedding classes to pooling (#10801)

2024-12-01 14:36:51 +08:00

core_client.py

[Core] v1: Use atexit to handle engine core client shutdown (#11076)

2024-12-11 01:26:36 -08:00

core.py

[Misc] Split up pooling tasks (#10820)

2024-12-11 01:28:00 -08:00

detokenizer.py

[V1] Add missing tokenizer options for Detokenizer (#10288)

2024-11-13 11:02:56 +00:00

llm_engine.py

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856)

2024-12-10 06:28:14 +00:00

mm_input_mapper.py

[V1] Initial support of multimodal models for V1 re-arch (#10699)

2024-12-08 12:50:51 +00:00

processor.py

[3/N] Support and implement merged input processor for LLaVA model (#10676)

2024-12-07 00:50:58 -08:00