mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-16 12:55:02 +08:00
Pooling models
Cohere rerank usage
python examples/online_serving/pooling/cohere_rerank_client.py
Embedding requests base64 encoding_format usage
python examples/online_serving/pooling/embedding_requests_base64_client.py
Embedding requests bytes encoding_format usage
python examples/online_serving/pooling/embedding_requests_bytes_client.py
Jinaai rerank usage
python examples/online_serving/pooling/jinaai_rerank_client.py
Multi vector retrieval usage
python examples/online_serving/pooling/multi_vector_retrieval_client.py
Named Entity Recognition (NER) usage
python examples/online_serving/pooling/ner_client.py
Openai chat embedding for multimodal usage
python examples/online_serving/pooling/openai_chat_embedding_client_for_multimodal.py
Openai classification usage
python examples/online_serving/pooling/openai_classification_client.py
Openai embedding usage
python examples/online_serving/pooling/openai_embedding_client.py
Openai embedding matryoshka dimensions usage
python examples/online_serving/pooling/openai_embedding_matryoshka_fy.py
Openai pooling usage
python examples/online_serving/pooling/openai_pooling_client.py