Nick Hill aea94362c9

[Frontend][V1] Online serving performance improvements (#12287)

2025-01-22 22:22:12 +00:00

..

__init__.py

[Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

async_llm.py

[Frontend][V1] Online serving performance improvements (#12287)

2025-01-22 22:22:12 +00:00

core_client.py

[Frontend][V1] Online serving performance improvements (#12287)

2025-01-22 22:22:12 +00:00

core.py

[Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

detokenizer.py

[V1] [2/n] Logging and Metrics - OutputProcessor Abstraction (#11973)

2025-01-13 04:54:10 +00:00

llm_engine.py

[Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

mm_input_mapper.py

[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)

2025-01-06 19:58:16 +00:00

output_processor.py

[Frontend][V1] Online serving performance improvements (#12287)

2025-01-22 22:22:12 +00:00

processor.py

[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)

2025-01-06 19:58:16 +00:00