vllm.entrypoints.openai.api_server
vllm serve
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
prompt_token_ids
LLM.generate
LLM.embed