/generate
Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Optional[x]
x | None
Union[x, y]
x | y
VLLM_USE_V1
PoolerConfig
config/__init__.py
config/pooler.py
reasoning_content
reasoning
PyNcclConnector
vllm.entrypoints.openai.api_server
vllm serve