mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-09 03:44:58 +08:00
1.1 KiB
1.1 KiB
Pooling models
Cohere rerank usage
python examples/online_serving/pooling/cohere_rerank_client.py
Embedding embed_dtype usage
python examples/online_serving/pooling/embedding_embed_dtype_client.py
Jinaai rerank usage
python examples/online_serving/pooling/jinaai_rerank_client.py
Multi vector retrieval usage
python examples/online_serving/pooling/multi_vector_retrieval_client.py
Named Entity Recognition (NER) usage
python examples/online_serving/pooling/ner_client.py
Openai chat embedding for multimodal usage
python examples/online_serving/pooling/openai_chat_embedding_client_for_multimodal.py
Openai classification usage
python examples/online_serving/pooling/openai_classification_client.py
Openai embedding usage
python examples/online_serving/pooling/openai_embedding_client.py
Openai embedding matryoshka dimensions usage
python examples/online_serving/pooling/openai_embedding_matryoshka_fy.py
Openai pooling usage
python examples/online_serving/pooling/openai_pooling_client.py