mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 12:25:01 +08:00

History

[Model] Interface to enable batch-level DP support (#23733 )

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2025-08-27 06:41:22 -07:00

conserving_memory.md

[Core] Use key-only cache for BaseMultiModalProcessor (#23018 )

2025-08-27 14:19:13 +08:00

engine_args.md

[Docs] Add comprehensive CLI reference for all large vllm subcommands (#22601 )

2025-08-11 00:13:33 -07:00

env_vars.md

Make distinct code and console admonitions so readers are less likely to miss them (#20585 )

2025-07-07 19:55:28 -07:00

model_resolution.md

[Misc] unify variable for LLM instance (#20996 )

2025-07-21 12:18:33 +01:00

optimization.md

[Model] Interface to enable batch-level DP support (#23733 )

2025-08-27 06:41:22 -07:00

README.md

[Doc] Move examples and further reorganize user guide (#18666 )

2025-05-26 07:38:04 -07:00

serve_args.md

Add full serve CLI reference back to docs (#20978 )

2025-07-15 17:42:30 +00:00

tpu.md

[Docs] Fix a 1-2-3 list and style issues in tpu.md (#23729 )

2025-08-27 05:37:52 -07:00

README.md

Configuration Options

This section lists the most common options for running vLLM.

There are three main levels of configuration, from highest priority to lowest priority:

[Request parameters][completions-api] and [input arguments][sampling-params]
Engine arguments
Environment variables