Signed-off-by: angelayi <yiangela7@gmail.com>
prompt_token_ids
LLM.generate
LLM.embed
vllm.entrypoints.openai.api_server
vllm serve