mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-10 02:15:01 +08:00
5f696c33b1
Signed-off-by: wang.yuqi <noooop@126.com> Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Pooling models
Cohere rerank usage
python examples/online_serving/pooling/cohere_rerank_client.py
Jinaai rerank usage
python examples/online_serving/pooling/jinaai_rerank_client.py
Named Entity Recognition (NER) usage
python examples/online_serving/pooling/ner.py
Openai chat embedding for multimodal usage
python examples/online_serving/pooling/openai_chat_embedding_client_for_multimodal.py
Openai classification usage
python examples/online_serving/pooling/openai_classification_client.py
Openai embedding usage
python examples/online_serving/pooling/openai_embedding_client.py
Openai embedding matryoshka dimensions usage
python examples/online_serving/pooling/openai_embedding_matryoshka_fy.py
Openai pooling usage
python examples/online_serving/pooling/openai_pooling_client.py