mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-10 02:05:01 +08:00
bf214ca226
Signed-off-by: wang.yuqi <noooop@126.com> Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Pooling models
Cohere rerank usage
python examples/online_serving/pooling/cohere_rerank_client.py
Jinaai rerank usage
python examples/online_serving/pooling/jinaai_rerank_client.py
Openai chat embedding for multimodal usage
python examples/online_serving/pooling/openai_chat_embedding_client_for_multimodal.py
Openai classification usage
python examples/online_serving/pooling/openai_classification_client.py
Openai embedding usage
python examples/online_serving/pooling/openai_embedding_client.py
Openai embedding matryoshka dimensions usage
python examples/online_serving/pooling/openai_embedding_matryoshka_fy.py
Openai pooling usage
python examples/online_serving/pooling/openai_pooling_client.py