vllm/examples/online_serving/pooling

Pooling models

Cohere rerank usage

python examples/online_serving/pooling/cohere_rerank_client.py

Jinaai rerank usage

python examples/online_serving/pooling/jinaai_rerank_client.py

Named Entity Recognition (NER) usage

python examples/online_serving/pooling/ner.py

Openai chat embedding for multimodal usage

python examples/online_serving/pooling/openai_chat_embedding_client_for_multimodal.py

Openai classification usage

python examples/online_serving/pooling/openai_classification_client.py

Openai embedding usage

python examples/online_serving/pooling/openai_embedding_client.py

Openai embedding matryoshka dimensions usage

python examples/online_serving/pooling/openai_embedding_matryoshka_fy.py

Openai pooling usage

python examples/online_serving/pooling/openai_pooling_client.py